-- Logs begin at Tue 2022-08-30 04:29:49 UTC, end at Tue 2022-08-30 05:24:58 UTC. -- Aug 30 04:55:20.185976 dv-cinder-853910-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 04:55:20.193712 dv-cinder-853910-4-smb devstack@keystone.service[81662]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 04:55:20.195716 dv-cinder-853910-4-smb devstack@keystone.service[81662]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 04:55:20 2022] *** Aug 30 04:55:20.195716 dv-cinder-853910-4-smb devstack@keystone.service[81662]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 04:55:20.195716 dv-cinder-853910-4-smb devstack@keystone.service[81662]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 04:55:20.195716 dv-cinder-853910-4-smb devstack@keystone.service[81662]: nodename: dv-cinder-853910-4-smb Aug 30 04:55:20.195716 dv-cinder-853910-4-smb devstack@keystone.service[81662]: machine: x86_64 Aug 30 04:55:20.195716 dv-cinder-853910-4-smb devstack@keystone.service[81662]: clock source: unix Aug 30 04:55:20.195716 dv-cinder-853910-4-smb devstack@keystone.service[81662]: pcre jit disabled Aug 30 04:55:20.195716 dv-cinder-853910-4-smb devstack@keystone.service[81662]: detected number of CPU cores: 4 Aug 30 04:55:20.195716 dv-cinder-853910-4-smb devstack@keystone.service[81662]: current working directory: / Aug 30 04:55:20.195716 dv-cinder-853910-4-smb devstack@keystone.service[81662]: detected binary path: /usr/bin/uwsgi-core Aug 30 04:55:20.195716 dv-cinder-853910-4-smb devstack@keystone.service[81662]: your processes number limit is 47680 Aug 30 04:55:20.196397 dv-cinder-853910-4-smb devstack@keystone.service[81662]: your memory page size is 4096 bytes Aug 30 04:55:20.196397 dv-cinder-853910-4-smb devstack@keystone.service[81662]: detected max file descriptor number: 2048 Aug 30 04:55:20.196397 dv-cinder-853910-4-smb devstack@keystone.service[81662]: lock engine: pthread robust mutexes Aug 30 04:55:20.196397 dv-cinder-853910-4-smb devstack@keystone.service[81662]: thunder lock: enabled Aug 30 04:55:20.198286 dv-cinder-853910-4-smb devstack@keystone.service[81662]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 04:55:20.198286 dv-cinder-853910-4-smb devstack@keystone.service[81662]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 04:55:20.237833 dv-cinder-853910-4-smb devstack@keystone.service[81662]: Python main interpreter initialized at 0x55b9177df9c0 Aug 30 04:55:20.237833 dv-cinder-853910-4-smb devstack@keystone.service[81662]: python threads support enabled Aug 30 04:55:20.237833 dv-cinder-853910-4-smb devstack@keystone.service[81662]: your server socket listen backlog is limited to 100 connections Aug 30 04:55:20.237833 dv-cinder-853910-4-smb devstack@keystone.service[81662]: your mercy for graceful operations on workers is 90 seconds Aug 30 04:55:20.238207 dv-cinder-853910-4-smb devstack@keystone.service[81662]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 04:55:20.238207 dv-cinder-853910-4-smb devstack@keystone.service[81662]: *** Operational MODE: preforking *** Aug 30 04:55:20.238461 dv-cinder-853910-4-smb devstack@keystone.service[81662]: *** uWSGI is running in multiple interpreter mode *** Aug 30 04:55:20.238461 dv-cinder-853910-4-smb devstack@keystone.service[81662]: spawned uWSGI master process (pid: 81662) Aug 30 04:55:20.238665 dv-cinder-853910-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 04:55:20.244045 dv-cinder-853910-4-smb devstack@keystone.service[81662]: spawned uWSGI worker 1 (pid: 81675, cores: 1) Aug 30 04:55:20.244045 dv-cinder-853910-4-smb devstack@keystone.service[81662]: spawned uWSGI worker 2 (pid: 81676, cores: 1) Aug 30 04:55:20.244045 dv-cinder-853910-4-smb devstack@keystone.service[81662]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 04:55:24.524979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:55:24.524979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: from cryptography.utils import int_from_bytes Aug 30 04:55:24.525771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:55:24.525771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: from cryptography.utils import int_from_bytes Aug 30 04:55:24.530157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:55:24.530157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: from cryptography.utils import int_from_bytes Aug 30 04:55:24.530617 dv-cinder-853910-4-smb devstack@keystone.service[81675]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:55:24.530617 dv-cinder-853910-4-smb devstack@keystone.service[81675]: from cryptography.utils import int_from_bytes Aug 30 04:55:24.575682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:55:24.575859 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:55:24.576078 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] command line args: [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:55:24.576349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:55:24.576527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ================================================================================ {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:55:24.576777 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] admin_token = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.577023 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] config_dir = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.577210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.577390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] config_source = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.577567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] debug = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.577762 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.578262 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.578347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.578545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.578789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:55:24.578877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.579534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:55:24.579627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.579736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] command line args: [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:55:24.579817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_config_append = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.579883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.580036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:55:24.580228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_dir = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.580413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ================================================================================ {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:55:24.580573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_file = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.580674 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] admin_token = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.580738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.580800 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] config_dir = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.580867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.580933 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.580997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.581060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] config_source = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.581162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] debug = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.581285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.581383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.581465 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.581570 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.581646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.581725 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.581802 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.581942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.582050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.582173 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.582251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.582396 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.582475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.582614 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_config_append = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.582799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.582883 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.582961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.583045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_dir = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.583123 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.583199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_file = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.583276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.583341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.583516 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.583647 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.583754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.584029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.584124 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.584197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.584328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] publish_errors = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.584410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.584483 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.584607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.584683 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.584806 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.584887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.585026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.585104 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.585251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.585372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.585505 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] standard_threads = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.585600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.585693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.585769 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.585929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.586005 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.586101 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.586186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.586278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] use_journal = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.586421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.586512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] use_json = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.586612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] use_stderr = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.586784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] use_syslog = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.586904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.587010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.587099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] publish_errors = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.587259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.587343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.587492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.587576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.587701 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.587781 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.587900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.587994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.588156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.588234 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.588369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] standard_threads = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.588447 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.588596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.588681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.588830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.588908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.589066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.589145 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.589241 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] use_journal = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.589347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.589426 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] use_json = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.589595 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.589684 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] use_stderr = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.589778 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] use_syslog = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.589856 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.590061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.590147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:55:24.590289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.590378 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.590531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.590609 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.590772 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.590850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.591003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.591092 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.591253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.591331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.591500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.591587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.591754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.591844 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.591983 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.592064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.592237 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.592315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.592491 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.592586 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.592738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.592818 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.592981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.593059 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.593208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.593364 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.593439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.593520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.593647 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.593726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.593876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.593955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.594112 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.594188 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.594351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.594428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.594601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.594680 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.594828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.594907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.595065 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.595140 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.595305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.595391 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.595537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.595616 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.595778 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.595862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.596029 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.596135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.596264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.596407 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.596495 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.596643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.596733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.596872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.596950 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.597101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.597179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.597344 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.597429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.597572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.597669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.597803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.597920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.598030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.598127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.598259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.598343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.598486 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.598564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.598720 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.598873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.598948 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.599018 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.599173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.599257 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.599403 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.599490 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.599635 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.599712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.599858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.599934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.600108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.600199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.600335 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.600413 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.600559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.600637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.600783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.600869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.601026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.601166 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.601246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.601307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.601468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.601554 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.601693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.601780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.601932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.602033 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.602137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.602247 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.602367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.602480 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.602579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.602676 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.602812 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.602944 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.603044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.603166 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.603278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.603356 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.603508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.603592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.603725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.603802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.603968 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.604062 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.604216 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.604296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.604467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.604563 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.604664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.604742 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.604892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.604984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.605124 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.605204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.605363 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.605451 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.605590 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.605675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.605822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.605908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.606052 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.606131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.606281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.606362 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.606514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.606596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.606745 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.606825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.606975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.607057 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.607205 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.607285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.607435 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.607513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.607664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.607749 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.607905 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.608015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.608167 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.608249 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.608397 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.608475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.608630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.608710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.608861 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.608942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.609090 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.609229 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.609314 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.609387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.609535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.609613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.609762 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.609842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.609990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.610064 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.610234 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.610315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.610472 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.610561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.610704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.610799 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.610944 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.611022 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.611174 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.611252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.611406 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.611493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.611650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.611729 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.611885 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.612023 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.612138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.external = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.612230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.612369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.612448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.612593 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.612679 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.612807 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.612894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.613035 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.613123 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.password = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.613265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.613344 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.token = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.613493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.613601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.613730 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.613819 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.613960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.614039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.614185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.614263 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.614423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.614511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.614663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.614742 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.614893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.614972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.615125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.615214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.615355 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.external = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.615433 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.615581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.615669 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.615830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.615921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.616095 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.616179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.616330 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.password = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.616409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.616559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.token = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.616652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.616794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.616875 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.617025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.617104 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.617266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.617396 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.617478 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.617591 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.617722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.617802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.617964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.618052 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.618192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.618272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.618424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.618503 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.618667 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.618756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.618911 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.618991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.619147 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.619226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.619390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.619478 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.619627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.619708 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.619854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.619932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.620115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.620207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.620351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.620430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.620580 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.620659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.620825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.620906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.621077 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.621157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.621311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.621391 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.621554 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.621636 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.621784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.621866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.622028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.622107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.622254 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.622334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.622487 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.622566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.622715 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.622793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.622954 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.623041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.623179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.623258 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.623414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.623493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.623642 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.623717 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.623876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.624010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.624128 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.624209 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.624354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.624436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.624583 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.624664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.624823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.624902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.625050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.625130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.625292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.625374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.625536 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.625616 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.626290 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.626379 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.626521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.626601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.626762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.626842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.626989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.627071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.627215 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.627294 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.627449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.627528 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.627677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.627758 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.627908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.628003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.628158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.628238 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.628390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.628473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.628629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.628709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.628854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.628939 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.629097 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.629179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.629340 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.629420 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.629572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.629651 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.629816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.629897 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.630054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.630133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.630278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.630360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.630500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.630580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.630726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.630846 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.630960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.631077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.631193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.631308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.631431 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.631547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.631665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.631785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.631898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.632061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.632168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.632293 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.632421 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.632789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.632862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.633013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.633084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.633242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.633323 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.633496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.633597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.633725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.633810 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.633949 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.634030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.634184 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.634307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.634394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.634468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.634629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.634709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.634861 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.634943 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.635096 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.635176 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.635327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.635407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.635560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.635641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.635800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.635884 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.636055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.636138 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.636282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.636370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.636512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.636591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.636744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.636823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.636978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.637059 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.637205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.637285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.637432 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.637511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.637663 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.637745 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.637889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.637968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.638125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.638204 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.638365 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.638446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.638591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.638669 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.638830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.638908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.639064 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.639146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.639297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.639376 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.639523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.639601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.639748 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.639829 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.639998 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.640082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.640231 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.640311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.640463 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.640545 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.640685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.640764 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.640925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.641005 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.641164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.641244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.641442 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.642065 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.642205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.642286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.642439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.642522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.642698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.642837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.642943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.643084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.643176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.643318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.643399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.643556 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.643635 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.643795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.643889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.644068 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.644189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.644313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.644391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.644545 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.644639 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.644790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.644871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.645014 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.645093 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.645254 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.645343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.645485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.645565 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.645714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.645794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.645946 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.646039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.646176 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] role.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.646255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.646410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.646488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] role.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.646639 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.646720 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.646869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.646947 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.647103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.647184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.647331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.647407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.647574 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.647653 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.647804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.647883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.648066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.648151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.648312 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.648392 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.648543 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.648623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.648772 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.648854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.649001 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.649080 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.649236 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.649316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.649467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] role.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.649549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.649709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.649788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] role.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.649933 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.650099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.650188 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.650334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.650414 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.650579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.650660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.650826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.650914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.651069 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.651150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.651313 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.651393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.651544 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.651633 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.651782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.651862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.652030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.652114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.652276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.652368 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.652505 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.652584 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.652734 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.652814 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.652963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.653045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.653211 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.653346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.653461 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.653582 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.653706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.653829 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.653939 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.654073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.654153 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.654317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.654406 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.654562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.654642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.654793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.654872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.655041 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.655129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.655270 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.655350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.655510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.655589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.655738 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.655826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.655995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.656113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.656225 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.656308 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.656448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.656540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.656700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.656781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.656933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.657013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.657195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.657284 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.657429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.657508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.657656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.657735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.657888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.657976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.658120 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.658201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.658362 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.658451 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.658593 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.658673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.658840 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.658922 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.connection = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.659082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.659161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.659313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.659392 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.659545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.659627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.659780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.659858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.660030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.660113 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.660264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.660347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.660495 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.660573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.660723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.660802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.660961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.661041 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.661192 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.661272 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.661431 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.661511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.661661 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.661751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.661904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.661986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.662134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.662214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.connection = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.662373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.662453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.662598 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.662679 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.662832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.662918 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.663061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.663140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.663221 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:55:24.663297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.663506 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.663738 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.664027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.664269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.664501 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.664740 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.664971 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.665213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.665443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.665681 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.665906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.666140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.666369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:55:24.666541 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:55:24.692712 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.692938 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.693160 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.695106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.695333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.695555 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.701495 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.703868 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.729775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.729999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.730096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.730228 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.784169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.784322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.833061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.833288 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.833625 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.833858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.988820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.989050 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.989272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.989488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.989704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.989933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.990931 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.991162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.991382 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.991598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.991813 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:24.992053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.013925 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.014072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.014156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.014251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.014363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.014472 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.014584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.014667 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.014798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.014880 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.015008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.015102 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.015218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.015302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.026266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.026398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.039101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.039273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.039360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.039490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.039573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.039707 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.039792 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.039919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.040026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.040190 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.040272 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.040402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.040485 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.040612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:55:25.057654 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.057858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 04:55:25.058196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.058281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.058393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 04:55:25.058477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 04:55:25.058665 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.058799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.058928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.059012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 04:55:25.059257 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.059435 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.059517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.059695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.059778 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.060030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.069585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.069860 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.070136 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.070273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.070409 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.070497 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.070739 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.071018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.077356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.077969 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.080355 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.080639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.080905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.081000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.081185 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.081267 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.081466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.081546 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.081720 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.081802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.081985 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.082066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.082255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.082336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.082524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.082634 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.082795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.082908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.083063 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.083177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.083333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.083595 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.106455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.107020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.107903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.108208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.108514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.108798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.113392 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.113671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.113885 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.113969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.114168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.114450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.120289 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.120547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.120913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.121196 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.124605 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.124892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.125173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.125271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.125455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.125539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.125789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.126378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.126594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.126679 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.126861 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.126943 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.127135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.128945 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.129236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.129520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.144626 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.144901 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.145375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.145652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.148763 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.149527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.151964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.152264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.152648 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.152944 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.156465 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.157321 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.159621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.160470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.162859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.163170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.163450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.163559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.164065 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.164179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.164260 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.164336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.164410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.164500 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.164693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.165076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.180557 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.180842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.181106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.181367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.181449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.181652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.181924 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.182188 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.188794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.189494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.190323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.191144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.191934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.192240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.192706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.192997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.194877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.195249 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.195624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.195722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.195902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.196006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.196211 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.196309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.196495 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.196787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.207470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.207751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.208151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.208236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.208432 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.208515 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.208712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.208809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.208989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.209072 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.209266 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.209347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.209541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.209823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.225030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.225274 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.228357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.228462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.230984 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.231266 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.232450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.232736 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.234171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.234271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.234458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.234622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.234785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.234917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.241733 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.242389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.243193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.243868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.246189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.246485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.246765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.246895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.247027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.247158 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.247336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.247614 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.255336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.255622 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.255900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.256137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.256429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.256713 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.263037 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.263320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.263601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.263854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:55:25.264023 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.264153 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.264280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.264432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.264562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.264704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.264844 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.264976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.265116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.265254 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.265432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.265563 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.265690 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.265820 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.265950 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.266088 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.266230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.266360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.266981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.267109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.267242 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.267373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.267545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.267815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:55:25.301792 dv-cinder-853910-4-smb devstack@keystone.service[81675]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b9177df9c0 pid: 81675 (default app) Aug 30 04:55:25.302272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b9177df9c0 pid: 81676 (default app) Aug 30 04:55:25.305118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea62b9-5857-4f5c-a200-bca28c5808d8 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:25.305400 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea62b9-5857-4f5c-a200-bca28c5808d8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:25.305668 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea62b9-5857-4f5c-a200-bca28c5808d8 None None] PATH_INFO: `/v3` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:25.310539 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Tue Aug 30 04:55:25 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:31.902766 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ce56a-9be3-438d-a0ce-2dae878b894f None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:31.903311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ce56a-9be3-438d-a0ce-2dae878b894f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:31.903311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ce56a-9be3-438d-a0ce-2dae878b894f None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:31.908130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:55:31.913960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a81f43-6d7c-4c06-8518-5b633895ae43 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:31.914548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a81f43-6d7c-4c06-8518-5b633895ae43 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:31.914548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a81f43-6d7c-4c06-8518-5b633895ae43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:31.985267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: INFO dbcounter [None req-f9a81f43-6d7c-4c06-8518-5b633895ae43 None None] Registered counter for database keystone Aug 30 04:55:32.003672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG oslo_db.sqlalchemy.engines [None req-f9a81f43-6d7c-4c06-8518-5b633895ae43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:55:32.010230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writer thread running {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:55:32.192991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG passlib.handlers.bcrypt [None req-f9a81f43-6d7c-4c06-8518-5b633895ae43 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81675) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 04:55:32.193291 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG passlib.handlers.bcrypt [None req-f9a81f43-6d7c-4c06-8518-5b633895ae43 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81675) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 04:55:32.251295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f9a81f43-6d7c-4c06-8518-5b633895ae43 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:32.252903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f9a81f43-6d7c-4c06-8518-5b633895ae43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:32.384196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 30 04:55:32.834352 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ce56a-9be3-438d-a0ce-2dae878b894f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:32.904680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: INFO dbcounter [None req-597ce56a-9be3-438d-a0ce-2dae878b894f None None] Registered counter for database keystone Aug 30 04:55:32.928161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG oslo_db.sqlalchemy.engines [None req-597ce56a-9be3-438d-a0ce-2dae878b894f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:55:32.934539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writer thread running {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:55:33.053376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ce56a-9be3-438d-a0ce-2dae878b894f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:33.058568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e391b-2d7b-49c4-8333-cd66da97ed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:33.059192 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e391b-2d7b-49c4-8333-cd66da97ed31 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:33.059470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e391b-2d7b-49c4-8333-cd66da97ed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:33.059741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e391b-2d7b-49c4-8333-cd66da97ed31 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:33.067814 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e391b-2d7b-49c4-8333-cd66da97ed31 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:33.118997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: WARNING keystone.common.rbac_enforcer.enforcer [None req-799e391b-2d7b-49c4-8333-cd66da97ed31 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 04:55:33.119332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e391b-2d7b-49c4-8333-cd66da97ed31 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:33.129127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Aug 30 04:55:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:55:33.135350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a81f43-6d7c-4c06-8518-5b633895ae43 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:33.149509 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a81f43-6d7c-4c06-8518-5b633895ae43 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:33.154061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef72241-1181-4250-b404-33e4bf12358a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:33.155025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef72241-1181-4250-b404-33e4bf12358a admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:33.155326 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef72241-1181-4250-b404-33e4bf12358a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:33.155579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef72241-1181-4250-b404-33e4bf12358a admin admin] PATH_INFO: `/v3/projects/30fb7a46e3a647738501ffab48bae602` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:33.158118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef72241-1181-4250-b404-33e4bf12358a admin admin] RBAC: Authorizing `identity:get_project(project_id=30fb7a46e3a647738501ffab48bae602)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:33.210830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1ef72241-1181-4250-b404-33e4bf12358a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 04:55:33.211172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef72241-1181-4250-b404-33e4bf12358a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:33.215664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Aug 30 04:55:33 2022] GET /identity/v3/projects/30fb7a46e3a647738501ffab48bae602 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:35.094909 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61ff91-e593-4294-af35-f2a6036a8d9a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:35.095475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61ff91-e593-4294-af35-f2a6036a8d9a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:35.095475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61ff91-e593-4294-af35-f2a6036a8d9a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:35.099648 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:35.105193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199342e-7ac1-42ea-bc0c-f6d7fdddba49 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:35.105610 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199342e-7ac1-42ea-bc0c-f6d7fdddba49 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:35.105730 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199342e-7ac1-42ea-bc0c-f6d7fdddba49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:35.126214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d199342e-7ac1-42ea-bc0c-f6d7fdddba49 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:35.128341 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d199342e-7ac1-42ea-bc0c-f6d7fdddba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:35.137424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 04:55:35.416752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61ff91-e593-4294-af35-f2a6036a8d9a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:35.428970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61ff91-e593-4294-af35-f2a6036a8d9a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:35.433206 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28def501-627d-4843-9d33-495dd115e495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:35.433803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28def501-627d-4843-9d33-495dd115e495 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:35.434083 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28def501-627d-4843-9d33-495dd115e495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:35.434356 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28def501-627d-4843-9d33-495dd115e495 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:35.442508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28def501-627d-4843-9d33-495dd115e495 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:35.444332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28def501-627d-4843-9d33-495dd115e495 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:35.452978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Aug 30 04:55:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:55:35.459764 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199342e-7ac1-42ea-bc0c-f6d7fdddba49 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:35.470159 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199342e-7ac1-42ea-bc0c-f6d7fdddba49 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:35.474511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf8c36-e5f1-411d-8b52-af9de354951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:35.475138 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf8c36-e5f1-411d-8b52-af9de354951f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:35.476717 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf8c36-e5f1-411d-8b52-af9de354951f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:35.476717 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf8c36-e5f1-411d-8b52-af9de354951f admin admin] PATH_INFO: `/v3/users/4149212a50524852b6dbbdcbbc227d29` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:35.477581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf8c36-e5f1-411d-8b52-af9de354951f admin admin] RBAC: Authorizing `identity:get_user(user_id=4149212a50524852b6dbbdcbbc227d29)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:35.478814 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf8c36-e5f1-411d-8b52-af9de354951f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:35.480381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Aug 30 04:55:35 2022] GET /identity/v3/users/4149212a50524852b6dbbdcbbc227d29 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:37.471977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50ef1b-f34b-4e38-9324-2d20970a703d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:37.472514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50ef1b-f34b-4e38-9324-2d20970a703d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:37.472514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50ef1b-f34b-4e38-9324-2d20970a703d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:37.473823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:37.478910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15c3c9-5da9-4f0a-bf2e-2e431c4753bc None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:37.479374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15c3c9-5da9-4f0a-bf2e-2e431c4753bc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:37.479524 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15c3c9-5da9-4f0a-bf2e-2e431c4753bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:37.501063 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-fe15c3c9-5da9-4f0a-bf2e-2e431c4753bc None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:37.502497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fe15c3c9-5da9-4f0a-bf2e-2e431c4753bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:37.558550 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d95c9-e549-4d39-9808-755ce0d7e038 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:37.558830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d95c9-e549-4d39-9808-755ce0d7e038 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:37.559103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d95c9-e549-4d39-9808-755ce0d7e038 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:37.560454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:55:37.566105 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432f893-7c81-4dfb-ad04-d03d4f6f23db None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:37.566381 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432f893-7c81-4dfb-ad04-d03d4f6f23db None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:37.566647 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432f893-7c81-4dfb-ad04-d03d4f6f23db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:37.585259 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:55:37.609692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG passlib.handlers.bcrypt [None req-3432f893-7c81-4dfb-ad04-d03d4f6f23db None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81676) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 04:55:37.610084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG passlib.handlers.bcrypt [None req-3432f893-7c81-4dfb-ad04-d03d4f6f23db None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81676) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 04:55:37.659564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3432f893-7c81-4dfb-ad04-d03d4f6f23db None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:37.661172 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3432f893-7c81-4dfb-ad04-d03d4f6f23db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:37.763935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:55:37.849816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15c3c9-5da9-4f0a-bf2e-2e431c4753bc None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:37.873073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:37.952078 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15c3c9-5da9-4f0a-bf2e-2e431c4753bc None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:37.985976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b2f37-ef6f-447e-8e0a-3c3fae4f022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:37.986591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b2f37-ef6f-447e-8e0a-3c3fae4f022f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:37.986869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b2f37-ef6f-447e-8e0a-3c3fae4f022f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:37.987140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b2f37-ef6f-447e-8e0a-3c3fae4f022f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:38.033315 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432f893-7c81-4dfb-ad04-d03d4f6f23db None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:38.056244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b2f37-ef6f-447e-8e0a-3c3fae4f022f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:38.057722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b2f37-ef6f-447e-8e0a-3c3fae4f022f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:38.081330 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:38.135440 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432f893-7c81-4dfb-ad04-d03d4f6f23db None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:38.138021 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:38.161664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 7/14] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:55:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:38.167255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b2f37-ef6f-447e-8e0a-3c3fae4f022f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:38.180406 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307114e5-97cd-437c-a850-0cb2b6faba7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:38.181533 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307114e5-97cd-437c-a850-0cb2b6faba7b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:38.181815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307114e5-97cd-437c-a850-0cb2b6faba7b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:38.182081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307114e5-97cd-437c-a850-0cb2b6faba7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:38.196495 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307114e5-97cd-437c-a850-0cb2b6faba7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-307114e5-97cd-437c-a850-0cb2b6faba7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:55:38.205600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:55:38.206521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:55:38.207374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:55:38.207374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:55:38.207374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:55:38.207374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:55:38.207374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:55:38.207374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:55:38.207374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:55:38.207374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:55:38.207374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:55:38.207374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:55:38.207374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:55:38.207374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:55:38.207374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:55:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:55:38.212567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307114e5-97cd-437c-a850-0cb2b6faba7b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:38.267335 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b2f37-ef6f-447e-8e0a-3c3fae4f022f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:38.288916 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:38.300934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735f966-95a2-40ab-aa42-0c17c59018b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:38.301566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735f966-95a2-40ab-aa42-0c17c59018b1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:38.301848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735f966-95a2-40ab-aa42-0c17c59018b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:38.302120 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735f966-95a2-40ab-aa42-0c17c59018b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:38.311595 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307114e5-97cd-437c-a850-0cb2b6faba7b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:38.312167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735f966-95a2-40ab-aa42-0c17c59018b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:38.314147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735f966-95a2-40ab-aa42-0c17c59018b1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-5735f966-95a2-40ab-aa42-0c17c59018b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:55:38.332564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:55:38.333504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:55:38.334300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:55:38.334300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:55:38.334300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:55:38.334300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 8/16] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:55:38.339433 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735f966-95a2-40ab-aa42-0c17c59018b1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:38.349262 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af4d8c-1d63-4289-8e73-2777769e874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:38.349895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af4d8c-1d63-4289-8e73-2777769e874b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:38.350175 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af4d8c-1d63-4289-8e73-2777769e874b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:38.350445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af4d8c-1d63-4289-8e73-2777769e874b None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:38.351133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af4d8c-1d63-4289-8e73-2777769e874b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:38.351434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af4d8c-1d63-4289-8e73-2777769e874b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:38.352902 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af4d8c-1d63-4289-8e73-2777769e874b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:38.364873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:55:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:55:38.370604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af4d8c-1d63-4289-8e73-2777769e874b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:38.398391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:38.447664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735f966-95a2-40ab-aa42-0c17c59018b1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:38.470303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af4d8c-1d63-4289-8e73-2777769e874b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:38.483502 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a67b8-d78c-4603-addc-80c8dfbf0bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:38.485151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a67b8-d78c-4603-addc-80c8dfbf0bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:38.485423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a67b8-d78c-4603-addc-80c8dfbf0bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:38.485693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a67b8-d78c-4603-addc-80c8dfbf0bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:38.486358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a67b8-d78c-4603-addc-80c8dfbf0bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:38.486656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a67b8-d78c-4603-addc-80c8dfbf0bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:38.488072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a67b8-d78c-4603-addc-80c8dfbf0bd5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:38.504454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee34439-2fa4-4fdc-aefc-6ed1ad415cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:38.505081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee34439-2fa4-4fdc-aefc-6ed1ad415cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:38.505356 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee34439-2fa4-4fdc-aefc-6ed1ad415cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:38.505625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee34439-2fa4-4fdc-aefc-6ed1ad415cc1 None admin] PATH_INFO: `/v3/users/4149212a50524852b6dbbdcbbc227d29` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:38.505834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:55:38.507521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee34439-2fa4-4fdc-aefc-6ed1ad415cc1 None admin] RBAC: Authorizing `identity:get_user(user_id=4149212a50524852b6dbbdcbbc227d29)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:38.509014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee34439-2fa4-4fdc-aefc-6ed1ad415cc1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:38.510659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:55:38 2022] GET /identity/v3/users/4149212a50524852b6dbbdcbbc227d29 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:55:38.516717 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a67b8-d78c-4603-addc-80c8dfbf0bd5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:38.558693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:38.629785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a67b8-d78c-4603-addc-80c8dfbf0bd5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:38.664396 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948ac38-42e9-424d-a12e-5c446041f06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:38.665029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948ac38-42e9-424d-a12e-5c446041f06c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:38.665304 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948ac38-42e9-424d-a12e-5c446041f06c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:38.665577 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948ac38-42e9-424d-a12e-5c446041f06c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:38.666685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948ac38-42e9-424d-a12e-5c446041f06c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:38.668164 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948ac38-42e9-424d-a12e-5c446041f06c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:38.669717 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 10/20] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:55:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:38.676203 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee34439-2fa4-4fdc-aefc-6ed1ad415cc1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:38.776523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:38.783905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee34439-2fa4-4fdc-aefc-6ed1ad415cc1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:38.820942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf749c6f-348b-4e43-bf36-2533edeab025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:38.821466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf749c6f-348b-4e43-bf36-2533edeab025 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:38.821744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf749c6f-348b-4e43-bf36-2533edeab025 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:38.822030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf749c6f-348b-4e43-bf36-2533edeab025 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:38.822795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf749c6f-348b-4e43-bf36-2533edeab025 None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.domain.id=default, user.id=4149212a50524852b6dbbdcbbc227d29) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:38.823054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf749c6f-348b-4e43-bf36-2533edeab025 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:38.824610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf749c6f-348b-4e43-bf36-2533edeab025 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:38.835784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 11/21] 10.222.0.48 () {56 vars in 1322 bytes} [Tue Aug 30 04:55:38 2022] GET /identity/v3/role_assignments?user.id=4149212a50524852b6dbbdcbbc227d29&scope.domain.id=default&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:40.611689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d2cc1-829d-4d25-8eaf-a1c071fe4015 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:40.612235 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d2cc1-829d-4d25-8eaf-a1c071fe4015 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:40.612235 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d2cc1-829d-4d25-8eaf-a1c071fe4015 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:40.613574 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 11/22] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:40.618752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c92486-a4ba-4068-8f9f-a9515ee9c1e5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:40.619183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c92486-a4ba-4068-8f9f-a9515ee9c1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:40.619258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c92486-a4ba-4068-8f9f-a9515ee9c1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:40.638753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d9c92486-a4ba-4068-8f9f-a9515ee9c1e5 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:40.639970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d9c92486-a4ba-4068-8f9f-a9515ee9c1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:40.730255 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:55:40.989612 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af985a58-3f0f-4514-a8e2-bddc5583d575 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:40.989898 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af985a58-3f0f-4514-a8e2-bddc5583d575 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:40.990178 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af985a58-3f0f-4514-a8e2-bddc5583d575 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:40.991576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:40.996957 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d970-7c64-4256-884a-48156f140dee None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:40.997244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d970-7c64-4256-884a-48156f140dee None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:40.997520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d970-7c64-4256-884a-48156f140dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:41.024204 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9450d970-7c64-4256-884a-48156f140dee None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:41.028138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9450d970-7c64-4256-884a-48156f140dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:41.119151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 13/25] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:55:41.196521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af985a58-3f0f-4514-a8e2-bddc5583d575 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:41.298298 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ed812-dc11-41c2-b08a-e66c4d0d2556 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:41.298547 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ed812-dc11-41c2-b08a-e66c4d0d2556 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:41.298774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ed812-dc11-41c2-b08a-e66c4d0d2556 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:41.300458 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 14/26] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:55:41.310439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab7eb2-07a8-4edb-b038-bd9240218469 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:41.310727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab7eb2-07a8-4edb-b038-bd9240218469 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:41.311006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab7eb2-07a8-4edb-b038-bd9240218469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:41.340785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af985a58-3f0f-4514-a8e2-bddc5583d575 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:41.343820 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:41.349754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-20ab7eb2-07a8-4edb-b038-bd9240218469 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:41.350991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-20ab7eb2-07a8-4edb-b038-bd9240218469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:41.371017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:41.450371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59535a63-12f5-42b6-9cdf-cbcdf2b0e091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:41.451082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59535a63-12f5-42b6-9cdf-cbcdf2b0e091 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:41.451366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59535a63-12f5-42b6-9cdf-cbcdf2b0e091 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:41.451713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59535a63-12f5-42b6-9cdf-cbcdf2b0e091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:41.454390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 15/27] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:55:41.471458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59535a63-12f5-42b6-9cdf-cbcdf2b0e091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:41.472983 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59535a63-12f5-42b6-9cdf-cbcdf2b0e091 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-59535a63-12f5-42b6-9cdf-cbcdf2b0e091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:55:41.495741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:55:41.496688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:55:41.497495 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:55:41.497495 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:55:41.497495 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:55:41.497495 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 13/28] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:55:41.499231 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab7eb2-07a8-4edb-b038-bd9240218469 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:41.508912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59535a63-12f5-42b6-9cdf-cbcdf2b0e091 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:41.674531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab7eb2-07a8-4edb-b038-bd9240218469 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:41.699835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59535a63-12f5-42b6-9cdf-cbcdf2b0e091 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:41.738867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b77e23-cb7e-4910-ae15-e804cb60d060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:41.739567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b77e23-cb7e-4910-ae15-e804cb60d060 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:41.739849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b77e23-cb7e-4910-ae15-e804cb60d060 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:41.740159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b77e23-cb7e-4910-ae15-e804cb60d060 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:41.741027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b77e23-cb7e-4910-ae15-e804cb60d060 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:41.742543 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b77e23-cb7e-4910-ae15-e804cb60d060 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:41.747238 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c344a0-072b-4fb9-8877-615292e89ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:41.747918 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c344a0-072b-4fb9-8877-615292e89ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:41.748228 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c344a0-072b-4fb9-8877-615292e89ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:41.748499 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c344a0-072b-4fb9-8877-615292e89ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:41.749186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c344a0-072b-4fb9-8877-615292e89ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:41.749700 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c344a0-072b-4fb9-8877-615292e89ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:41.751843 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c344a0-072b-4fb9-8877-615292e89ef6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:41.767160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 14/29] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:41.772019 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb0f0d-033e-4539-90e2-d38ad9342d56 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:41.772019 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb0f0d-033e-4539-90e2-d38ad9342d56 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:41.772019 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb0f0d-033e-4539-90e2-d38ad9342d56 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:41.772019 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 15/30] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:41.772019 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb0f0d-033e-4539-90e2-d38ad9342d56 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:41.793905 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:41.894537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb0f0d-033e-4539-90e2-d38ad9342d56 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:41.908045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 16/31] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Aug 30 04:55:41 2022] POST /identity/v3/roles => generated 225 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:55:41.910051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b61b42-0d77-4e1b-8fae-17be1f82023a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:41.910572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b61b42-0d77-4e1b-8fae-17be1f82023a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:41.911049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b61b42-0d77-4e1b-8fae-17be1f82023a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:41.951580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d2b61b42-0d77-4e1b-8fae-17be1f82023a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:41.956154 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d2b61b42-0d77-4e1b-8fae-17be1f82023a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:41.960312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:41.965646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08314b5d-2d1a-4b0d-b0fe-78066467084a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:41.966591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08314b5d-2d1a-4b0d-b0fe-78066467084a None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:41.966882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08314b5d-2d1a-4b0d-b0fe-78066467084a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:41.967158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08314b5d-2d1a-4b0d-b0fe-78066467084a None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:41.969486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08314b5d-2d1a-4b0d-b0fe-78066467084a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:41.972814 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08314b5d-2d1a-4b0d-b0fe-78066467084a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:42.114018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 17/32] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:55:42.114849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b61b42-0d77-4e1b-8fae-17be1f82023a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:42.134801 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 16/33] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Aug 30 04:55:41 2022] POST /identity/v3/roles => generated 219 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:55:42.253753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b61b42-0d77-4e1b-8fae-17be1f82023a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:42.301138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e603ea-0d21-4135-bdb4-650aeccd821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:42.301782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e603ea-0d21-4135-bdb4-650aeccd821d None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:42.302072 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e603ea-0d21-4135-bdb4-650aeccd821d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:42.302404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e603ea-0d21-4135-bdb4-650aeccd821d None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:42.303276 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e603ea-0d21-4135-bdb4-650aeccd821d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:42.305098 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e603ea-0d21-4135-bdb4-650aeccd821d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:42.328246 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:42.337062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd76fd7-9ba8-451d-950f-dc69ff9266aa None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:42.337684 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd76fd7-9ba8-451d-950f-dc69ff9266aa None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:42.338920 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd76fd7-9ba8-451d-950f-dc69ff9266aa None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:42.341090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 17/34] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:42.348102 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d601dc-c198-47cf-9cd1-c9e513350cb9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:42.348658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d601dc-c198-47cf-9cd1-c9e513350cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:42.349143 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d601dc-c198-47cf-9cd1-c9e513350cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:42.365145 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 18/35] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Aug 30 04:55:42 2022] POST /identity/v3/projects => generated 301 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:55:42.374011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-74d601dc-c198-47cf-9cd1-c9e513350cb9 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:42.376179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-74d601dc-c198-47cf-9cd1-c9e513350cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:42.456578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 18/36] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:55:42.511043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e603ea-0d21-4135-bdb4-650aeccd821d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:42.626703 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e603ea-0d21-4135-bdb4-650aeccd821d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:42.665965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6b62a-29aa-4c80-97ce-08d6201ebcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:42.666990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6b62a-29aa-4c80-97ce-08d6201ebcd2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:42.667470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6b62a-29aa-4c80-97ce-08d6201ebcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:42.667975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6b62a-29aa-4c80-97ce-08d6201ebcd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:42.679350 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6b62a-29aa-4c80-97ce-08d6201ebcd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b9e6b62a-29aa-4c80-97ce-08d6201ebcd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:55:42.684929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:55:42.685775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:55:42.686537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:55:42.686537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:55:42.686537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:55:42.686537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:55:42.686537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:55:42.686537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:55:42.686537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:55:42.686537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:55:42.686537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:55:42.686537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:55:42.686537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:55:42.686537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:55:42.688356 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 19/37] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:55:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:55:42.694244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d601dc-c198-47cf-9cd1-c9e513350cb9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:42.697936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:42.708244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877c66a-a625-4abe-acf3-4cfaa930b317 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:42.708530 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877c66a-a625-4abe-acf3-4cfaa930b317 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:42.708804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877c66a-a625-4abe-acf3-4cfaa930b317 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:42.710314 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 20/38] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:55:42.715095 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2631-522b-4134-9c59-3ba679967fe4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:42.715384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2631-522b-4134-9c59-3ba679967fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:42.715668 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2631-522b-4134-9c59-3ba679967fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:42.733782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-de3f2631-522b-4134-9c59-3ba679967fe4 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:42.735147 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-de3f2631-522b-4134-9c59-3ba679967fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:42.783872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:42.800441 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d601dc-c198-47cf-9cd1-c9e513350cb9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:42.807027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 21/39] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:55:42.807609 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f2631-522b-4134-9c59-3ba679967fe4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:42.835300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef38f8a-b78d-4103-9f68-08d399a9705a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:42.835914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef38f8a-b78d-4103-9f68-08d399a9705a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:42.836236 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef38f8a-b78d-4103-9f68-08d399a9705a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:42.836513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef38f8a-b78d-4103-9f68-08d399a9705a None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:42.837193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef38f8a-b78d-4103-9f68-08d399a9705a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:42.837499 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef38f8a-b78d-4103-9f68-08d399a9705a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:42.839023 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef38f8a-b78d-4103-9f68-08d399a9705a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:42.850850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 19/40] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:55:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:42.856660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef38f8a-b78d-4103-9f68-08d399a9705a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:42.915905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f2631-522b-4134-9c59-3ba679967fe4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:42.926344 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:42.956757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd3988-5e39-42a6-8e8a-9a0ee2f5b17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:42.957351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd3988-5e39-42a6-8e8a-9a0ee2f5b17e None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:42.957624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd3988-5e39-42a6-8e8a-9a0ee2f5b17e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:42.957895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd3988-5e39-42a6-8e8a-9a0ee2f5b17e None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:42.958550 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd3988-5e39-42a6-8e8a-9a0ee2f5b17e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:42.959998 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd3988-5e39-42a6-8e8a-9a0ee2f5b17e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:42.967837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef38f8a-b78d-4103-9f68-08d399a9705a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:42.974203 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 22/41] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Aug 30 04:55:42 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:55:43.014035 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955762dd-bf6a-4ec7-904d-ac3b38c267fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:43.014691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955762dd-bf6a-4ec7-904d-ac3b38c267fe None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:43.014972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955762dd-bf6a-4ec7-904d-ac3b38c267fe None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:43.015285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955762dd-bf6a-4ec7-904d-ac3b38c267fe None admin] PATH_INFO: `/v3/users/4149212a50524852b6dbbdcbbc227d29` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:43.016539 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955762dd-bf6a-4ec7-904d-ac3b38c267fe None admin] RBAC: Authorizing `identity:get_user(user_id=4149212a50524852b6dbbdcbbc227d29)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:43.018146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955762dd-bf6a-4ec7-904d-ac3b38c267fe None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:43.020095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 20/42] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:55:42 2022] GET /identity/v3/users/4149212a50524852b6dbbdcbbc227d29 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:55:43.025702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd3988-5e39-42a6-8e8a-9a0ee2f5b17e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:43.079641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:43.080217 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955762dd-bf6a-4ec7-904d-ac3b38c267fe None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:43.156044 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd3988-5e39-42a6-8e8a-9a0ee2f5b17e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:43.192696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb3b4d-1573-4329-8691-8da93b21dcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:43.193335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb3b4d-1573-4329-8691-8da93b21dcbf None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:43.193661 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb3b4d-1573-4329-8691-8da93b21dcbf None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:43.193974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb3b4d-1573-4329-8691-8da93b21dcbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:43.195085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb3b4d-1573-4329-8691-8da93b21dcbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:43.196573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb3b4d-1573-4329-8691-8da93b21dcbf None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:43.198139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 23/43] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:55:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:43.198244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955762dd-bf6a-4ec7-904d-ac3b38c267fe None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:43.203691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb3b4d-1573-4329-8691-8da93b21dcbf None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:43.232072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6861954-1bc4-413a-bd12-4076707a2c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:43.232706 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6861954-1bc4-413a-bd12-4076707a2c9d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:43.232989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6861954-1bc4-413a-bd12-4076707a2c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:43.233263 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6861954-1bc4-413a-bd12-4076707a2c9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:43.234892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6861954-1bc4-413a-bd12-4076707a2c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:43.236378 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6861954-1bc4-413a-bd12-4076707a2c9d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:43.237992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 21/44] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:55:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:55:43.243474 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6861954-1bc4-413a-bd12-4076707a2c9d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:43.246121 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:43.301741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb3b4d-1573-4329-8691-8da93b21dcbf None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:43.310536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:43.335185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccaff2-3ef3-4228-a2f4-4a94f7d7fb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:43.335775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccaff2-3ef3-4228-a2f4-4a94f7d7fb1c None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:43.336101 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccaff2-3ef3-4228-a2f4-4a94f7d7fb1c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:43.336381 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccaff2-3ef3-4228-a2f4-4a94f7d7fb1c None admin] PATH_INFO: `/v3/domains/default/users/4149212a50524852b6dbbdcbbc227d29/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:43.338306 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccaff2-3ef3-4228-a2f4-4a94f7d7fb1c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4149212a50524852b6dbbdcbbc227d29, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:43.339757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccaff2-3ef3-4228-a2f4-4a94f7d7fb1c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:43.343912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6861954-1bc4-413a-bd12-4076707a2c9d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:43.353953 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 24/45] 10.222.0.48 () {58 vars in 1361 bytes} [Tue Aug 30 04:55:43 2022] PUT /identity/v3/domains/default/users/4149212a50524852b6dbbdcbbc227d29/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:55:43.380391 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae612df-fc96-461e-ad48-5ef61f137d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:43.381052 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae612df-fc96-461e-ad48-5ef61f137d48 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:43.381392 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae612df-fc96-461e-ad48-5ef61f137d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:43.381604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae612df-fc96-461e-ad48-5ef61f137d48 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:43.382549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae612df-fc96-461e-ad48-5ef61f137d48 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:43.384076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae612df-fc96-461e-ad48-5ef61f137d48 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:43.417197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 22/46] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Aug 30 04:55:43 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:55:45.246808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f40ccb-4fcc-4b73-af76-b9e355297285 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:45.247316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f40ccb-4fcc-4b73-af76-b9e355297285 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:45.247316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f40ccb-4fcc-4b73-af76-b9e355297285 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:45.248665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 25/47] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:45.253862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783803c-c08b-43a8-ad15-f61c5d4e1c6a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:45.254239 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783803c-c08b-43a8-ad15-f61c5d4e1c6a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:45.254550 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783803c-c08b-43a8-ad15-f61c5d4e1c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:45.381226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e783803c-c08b-43a8-ad15-f61c5d4e1c6a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:45.382695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e783803c-c08b-43a8-ad15-f61c5d4e1c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:45.383116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbecd7-d070-477f-ac75-fc0d8ef523cd None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:45.383397 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbecd7-d070-477f-ac75-fc0d8ef523cd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:45.383697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbecd7-d070-477f-ac75-fc0d8ef523cd None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:45.385065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 26/48] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:45.389965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb52826-e1de-4c28-90a2-c8756073392c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:45.390842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb52826-e1de-4c28-90a2-c8756073392c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:45.391130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb52826-e1de-4c28-90a2-c8756073392c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:45.409612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3cb52826-e1de-4c28-90a2-c8756073392c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:45.410823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3cb52826-e1de-4c28-90a2-c8756073392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:45.437939 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:45.456935 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 23/49] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:55:45.483227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 27/50] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:55:45.723314 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783803c-c08b-43a8-ad15-f61c5d4e1c6a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:45.768729 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb52826-e1de-4c28-90a2-c8756073392c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:45.831370 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783803c-c08b-43a8-ad15-f61c5d4e1c6a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:45.868346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e452353-9eb0-4c82-a019-14d40fdb5d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:45.869015 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e452353-9eb0-4c82-a019-14d40fdb5d6c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:45.869287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e452353-9eb0-4c82-a019-14d40fdb5d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:45.869556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e452353-9eb0-4c82-a019-14d40fdb5d6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:45.870009 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:45.876375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb52826-e1de-4c28-90a2-c8756073392c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:45.883230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e452353-9eb0-4c82-a019-14d40fdb5d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8e452353-9eb0-4c82-a019-14d40fdb5d6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:55:45.889585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:55:45.891126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:55:45.892126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:55:45.892126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:55:45.892126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:55:45.892126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:55:45.892126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:55:45.892126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:55:45.892126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:55:45.892126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:55:45.892126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:55:45.892126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:55:45.892126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:55:45.892126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:55:45.892126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 24/51] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:55:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:55:45.897164 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e452353-9eb0-4c82-a019-14d40fdb5d6c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:45.914562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d35468-035a-480d-acca-fe316e09f206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:45.915211 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d35468-035a-480d-acca-fe316e09f206 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:45.915486 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d35468-035a-480d-acca-fe316e09f206 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:45.915760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d35468-035a-480d-acca-fe316e09f206 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:45.917342 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d35468-035a-480d-acca-fe316e09f206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:45.918611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d35468-035a-480d-acca-fe316e09f206 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:45.920003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 28/52] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:55:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:55:45.925781 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d35468-035a-480d-acca-fe316e09f206 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:45.952473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:46.013831 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e452353-9eb0-4c82-a019-14d40fdb5d6c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:46.041507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d35468-035a-480d-acca-fe316e09f206 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:46.050407 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b3a5a-1b76-4f62-b41d-37de4ae15cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:46.051027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b3a5a-1b76-4f62-b41d-37de4ae15cef None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:46.051301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b3a5a-1b76-4f62-b41d-37de4ae15cef None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:46.051572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b3a5a-1b76-4f62-b41d-37de4ae15cef None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:46.052269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b3a5a-1b76-4f62-b41d-37de4ae15cef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:46.052573 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b3a5a-1b76-4f62-b41d-37de4ae15cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:46.053967 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b3a5a-1b76-4f62-b41d-37de4ae15cef None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:46.063000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 25/53] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:55:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:55:46.068624 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b3a5a-1b76-4f62-b41d-37de4ae15cef None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:46.081670 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d55a8-b803-4c19-abdd-5cf9bcf27e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:46.082281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d55a8-b803-4c19-abdd-5cf9bcf27e07 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:46.082560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d55a8-b803-4c19-abdd-5cf9bcf27e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:46.082830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d55a8-b803-4c19-abdd-5cf9bcf27e07 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:46.083479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d55a8-b803-4c19-abdd-5cf9bcf27e07 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:46.084981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d55a8-b803-4c19-abdd-5cf9bcf27e07 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:46.117204 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 29/54] 10.222.0.48 () {60 vars in 1140 bytes} [Tue Aug 30 04:55:45 2022] POST /identity/v3/projects => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:55:46.188641 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b3a5a-1b76-4f62-b41d-37de4ae15cef None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:46.196582 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:46.236101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c9a52-6d3f-45e3-b610-59cf2da261ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:46.236758 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c9a52-6d3f-45e3-b610-59cf2da261ff None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:46.237036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c9a52-6d3f-45e3-b610-59cf2da261ff None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:46.237305 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c9a52-6d3f-45e3-b610-59cf2da261ff None admin] PATH_INFO: `/v3/users/4149212a50524852b6dbbdcbbc227d29` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:46.238597 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c9a52-6d3f-45e3-b610-59cf2da261ff None admin] RBAC: Authorizing `identity:get_user(user_id=4149212a50524852b6dbbdcbbc227d29)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:46.240063 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c9a52-6d3f-45e3-b610-59cf2da261ff None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:46.241703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 26/55] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:55:46 2022] GET /identity/v3/users/4149212a50524852b6dbbdcbbc227d29 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:46.247612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d55a8-b803-4c19-abdd-5cf9bcf27e07 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:46.269752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:46.462798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d55a8-b803-4c19-abdd-5cf9bcf27e07 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:46.497132 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2683309-7196-4d9e-8f1c-9215642541c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:46.497691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2683309-7196-4d9e-8f1c-9215642541c2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:46.497967 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2683309-7196-4d9e-8f1c-9215642541c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:46.498247 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2683309-7196-4d9e-8f1c-9215642541c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:46.499891 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2683309-7196-4d9e-8f1c-9215642541c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:46.501354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2683309-7196-4d9e-8f1c-9215642541c2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:46.502928 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 30/56] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:55:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:46.509596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c9a52-6d3f-45e3-b610-59cf2da261ff None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:46.618709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c9a52-6d3f-45e3-b610-59cf2da261ff None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:46.656104 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee559cf5-6564-4b06-8a49-2123e2d906d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:46.656722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee559cf5-6564-4b06-8a49-2123e2d906d9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:46.657002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee559cf5-6564-4b06-8a49-2123e2d906d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:46.657276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee559cf5-6564-4b06-8a49-2123e2d906d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:46.658014 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee559cf5-6564-4b06-8a49-2123e2d906d9 None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.domain.id=default, user.id=4149212a50524852b6dbbdcbbc227d29) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:46.658322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee559cf5-6564-4b06-8a49-2123e2d906d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:46.659785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee559cf5-6564-4b06-8a49-2123e2d906d9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:46.667269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 27/57] 10.222.0.48 () {56 vars in 1322 bytes} [Tue Aug 30 04:55:46 2022] GET /identity/v3/role_assignments?user.id=4149212a50524852b6dbbdcbbc227d29&scope.domain.id=default&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:48.063760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e576b-9f44-48f2-a4ac-d88e48e38d4a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:48.064299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e576b-9f44-48f2-a4ac-d88e48e38d4a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:48.064299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e576b-9f44-48f2-a4ac-d88e48e38d4a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:48.065654 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 31/58] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:48.070889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c9310-f0fa-47b8-b64f-fc4a8c09dce3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:48.071290 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c9310-f0fa-47b8-b64f-fc4a8c09dce3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:48.071445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c9310-f0fa-47b8-b64f-fc4a8c09dce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:48.089541 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-926c9310-f0fa-47b8-b64f-fc4a8c09dce3 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:48.090756 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-926c9310-f0fa-47b8-b64f-fc4a8c09dce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:48.120888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:48.158195 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 28/59] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:55:48.428705 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e576b-9f44-48f2-a4ac-d88e48e38d4a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:48.513117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:48.529309 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e576b-9f44-48f2-a4ac-d88e48e38d4a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:48.563968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc24f3-f0a6-4ab6-9dfe-1a229489537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:48.564623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc24f3-f0a6-4ab6-9dfe-1a229489537a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:48.564901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc24f3-f0a6-4ab6-9dfe-1a229489537a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:48.565174 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc24f3-f0a6-4ab6-9dfe-1a229489537a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:48.566280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc24f3-f0a6-4ab6-9dfe-1a229489537a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:48.567740 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc24f3-f0a6-4ab6-9dfe-1a229489537a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:48.569346 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 32/60] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:55:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:48.575194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c9310-f0fa-47b8-b64f-fc4a8c09dce3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:48.673792 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c9310-f0fa-47b8-b64f-fc4a8c09dce3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:48.707270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f7fd7-4f43-422f-ad72-c10a451760e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:48.707813 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f7fd7-4f43-422f-ad72-c10a451760e4 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:48.708135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f7fd7-4f43-422f-ad72-c10a451760e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:48.708412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f7fd7-4f43-422f-ad72-c10a451760e4 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:48.709070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f7fd7-4f43-422f-ad72-c10a451760e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:48.710532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f7fd7-4f43-422f-ad72-c10a451760e4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:48.736849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 29/61] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:55:48 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:55:51.650810 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac6802-6e12-4752-9cb0-f3a8918ddca0 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:51.651319 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac6802-6e12-4752-9cb0-f3a8918ddca0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:51.651392 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac6802-6e12-4752-9cb0-f3a8918ddca0 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:51.652737 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 33/62] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:51.658600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb16df-608c-4007-9bf9-35b6d9c06b50 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:51.658988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb16df-608c-4007-9bf9-35b6d9c06b50 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:51.659147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb16df-608c-4007-9bf9-35b6d9c06b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:51.682279 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-87cb16df-608c-4007-9bf9-35b6d9c06b50 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:51.683483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-87cb16df-608c-4007-9bf9-35b6d9c06b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:51.707660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:51.772906 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cebaf-e490-4bce-996a-74883ad57a68 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:51.773243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cebaf-e490-4bce-996a-74883ad57a68 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:51.773457 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cebaf-e490-4bce-996a-74883ad57a68 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:51.774793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 34/63] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:51.780004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabff54-3e7a-4a55-a91b-3668caa46038 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:51.780827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabff54-3e7a-4a55-a91b-3668caa46038 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:51.781104 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabff54-3e7a-4a55-a91b-3668caa46038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:51.789375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 30/64] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:55:51.809483 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ccabff54-3e7a-4a55-a91b-3668caa46038 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:51.810684 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ccabff54-3e7a-4a55-a91b-3668caa46038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:51.911798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 35/65] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:55:52.084360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb16df-608c-4007-9bf9-35b6d9c06b50 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:52.193549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de5411-bbf9-4871-a512-d72479abe46a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:52.194149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de5411-bbf9-4871-a512-d72479abe46a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:52.194654 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de5411-bbf9-4871-a512-d72479abe46a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:52.196461 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 36/66] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:52.217205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106f0b0-19f4-4238-8bfd-21ae8c4932ad None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:52.218384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106f0b0-19f4-4238-8bfd-21ae8c4932ad None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:52.218848 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106f0b0-19f4-4238-8bfd-21ae8c4932ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:52.246475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c106f0b0-19f4-4238-8bfd-21ae8c4932ad None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:52.249102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c106f0b0-19f4-4238-8bfd-21ae8c4932ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:52.267542 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb16df-608c-4007-9bf9-35b6d9c06b50 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:52.347484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdf36a-71e9-4dd3-a821-3741ed4ebc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:52.347484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdf36a-71e9-4dd3-a821-3741ed4ebc70 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:52.347484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdf36a-71e9-4dd3-a821-3741ed4ebc70 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:52.347484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdf36a-71e9-4dd3-a821-3741ed4ebc70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:52.380103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdf36a-71e9-4dd3-a821-3741ed4ebc70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-c5bdf36a-71e9-4dd3-a821-3741ed4ebc70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:55:52.393872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:55:52.394803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:55:52.395556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:55:52.395556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:55:52.395556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:55:52.395556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:55:52.395556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:55:52.395556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:55:52.395556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:55:52.395556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:55:52.395556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:55:52.395556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:55:52.395556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:55:52.395556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:55:52.396167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 31/67] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:55:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:55:52.401664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdf36a-71e9-4dd3-a821-3741ed4ebc70 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:52.410587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 37/68] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 30 04:55:52.428362 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:52.534434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106f0b0-19f4-4238-8bfd-21ae8c4932ad None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:52.556526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:52.572639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdf36a-71e9-4dd3-a821-3741ed4ebc70 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:52.620176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365c236-144c-454c-9439-954703d655de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:52.621153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365c236-144c-454c-9439-954703d655de None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:52.621715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365c236-144c-454c-9439-954703d655de None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:52.622174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365c236-144c-454c-9439-954703d655de None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:52.623112 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365c236-144c-454c-9439-954703d655de None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:52.623600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365c236-144c-454c-9439-954703d655de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:52.626083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365c236-144c-454c-9439-954703d655de None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:52.635475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 32/69] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:55:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:52.636932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd10f4-fad8-468a-8c49-ffe22f8df0a8 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:52.637409 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd10f4-fad8-468a-8c49-ffe22f8df0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:52.637871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd10f4-fad8-468a-8c49-ffe22f8df0a8 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:52.643909 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 33/70] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:52.644704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd10f4-fad8-468a-8c49-ffe22f8df0a8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:52.683317 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106f0b0-19f4-4238-8bfd-21ae8c4932ad None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:52.722717 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee4501-3b30-4eba-8519-903f207f268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:52.723670 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee4501-3b30-4eba-8519-903f207f268e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:52.723960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee4501-3b30-4eba-8519-903f207f268e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:52.724248 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee4501-3b30-4eba-8519-903f207f268e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:52.734980 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee4501-3b30-4eba-8519-903f207f268e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:55:52.735456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f7ee4501-3b30-4eba-8519-903f207f268e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:55:52.739493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:55:52.740625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:55:52.746170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:55:52.746170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:55:52.746170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:55:52.746170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:55:52.746170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:55:52.746170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:55:52.746170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:55:52.746170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:55:52.746170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:55:52.746170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:55:52.746170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:55:52.746170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:55:52.746170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 38/71] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:55:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:55:52.746170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eecebe-26e2-41b9-bafe-60d057a1d599 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:52.746838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eecebe-26e2-41b9-bafe-60d057a1d599 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:52.746838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eecebe-26e2-41b9-bafe-60d057a1d599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:52.763161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-33eecebe-26e2-41b9-bafe-60d057a1d599 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:52.764378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-33eecebe-26e2-41b9-bafe-60d057a1d599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:52.767318 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd10f4-fad8-468a-8c49-ffe22f8df0a8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:52.804440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57310275-37aa-4315-b402-543a2a058b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:52.805111 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57310275-37aa-4315-b402-543a2a058b5c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:52.805385 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57310275-37aa-4315-b402-543a2a058b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:52.805652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57310275-37aa-4315-b402-543a2a058b5c None admin] PATH_INFO: `/v3/users/3cf964840139481f9a2810f3576d0b10` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:52.820853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57310275-37aa-4315-b402-543a2a058b5c None admin] RBAC: Authorizing `identity:get_user(user_id=3cf964840139481f9a2810f3576d0b10)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:52.822431 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57310275-37aa-4315-b402-543a2a058b5c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:52.824746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 34/72] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:55:52 2022] GET /identity/v3/users/3cf964840139481f9a2810f3576d0b10 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:52.825997 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0863f5-f708-420e-a14d-0f848932aa2e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:52.826399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0863f5-f708-420e-a14d-0f848932aa2e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:52.826672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0863f5-f708-420e-a14d-0f848932aa2e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:52.831991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 35/73] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:52.831991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0863f5-f708-420e-a14d-0f848932aa2e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:52.834409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 39/74] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:55:52.835300 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eecebe-26e2-41b9-bafe-60d057a1d599 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:52.845441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:52.938458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0863f5-f708-420e-a14d-0f848932aa2e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:52.948444 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eecebe-26e2-41b9-bafe-60d057a1d599 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:52.977405 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65786b-a5ab-41ce-90c9-969709d4db83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:52.978023 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65786b-a5ab-41ce-90c9-969709d4db83 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:52.978463 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65786b-a5ab-41ce-90c9-969709d4db83 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:52.978772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65786b-a5ab-41ce-90c9-969709d4db83 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:52.980038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65786b-a5ab-41ce-90c9-969709d4db83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:52.980396 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65786b-a5ab-41ce-90c9-969709d4db83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:52.981779 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65786b-a5ab-41ce-90c9-969709d4db83 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:52.983271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:52.986936 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca41828-d995-4084-a274-44c85cfdad89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:52.987621 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca41828-d995-4084-a274-44c85cfdad89 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:52.988358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca41828-d995-4084-a274-44c85cfdad89 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:52.988358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca41828-d995-4084-a274-44c85cfdad89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:52.993385 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 36/75] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:55:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:52.994280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65786b-a5ab-41ce-90c9-969709d4db83 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:53.004774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca41828-d995-4084-a274-44c85cfdad89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-8ca41828-d995-4084-a274-44c85cfdad89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:55:53.011489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:55:53.012375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:55:53.013134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:55:53.013134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:55:53.013134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:55:53.013134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:55:53.013134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:55:53.013134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:55:53.013134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:55:53.013134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:55:53.013134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:55:53.013134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:55:53.013134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:55:53.013134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:55:53.013134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 40/76] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:55:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:55:53.013763 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a417f-b8bb-4b49-85b4-a735cf90d491 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:53.014445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a417f-b8bb-4b49-85b4-a735cf90d491 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:53.014445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a417f-b8bb-4b49-85b4-a735cf90d491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:53.033736 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-539a417f-b8bb-4b49-85b4-a735cf90d491 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:53.034963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-539a417f-b8bb-4b49-85b4-a735cf90d491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:53.098585 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:53.115967 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 41/77] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:55:53.115967 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a417f-b8bb-4b49-85b4-a735cf90d491 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:53.121527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65786b-a5ab-41ce-90c9-969709d4db83 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:53.163720 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdb580-0a1d-485c-8a91-6c80ba419c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:53.164722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdb580-0a1d-485c-8a91-6c80ba419c04 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:53.165008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdb580-0a1d-485c-8a91-6c80ba419c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:53.165285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdb580-0a1d-485c-8a91-6c80ba419c04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:53.223375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a417f-b8bb-4b49-85b4-a735cf90d491 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:53.232419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:53.239860 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfdb580-0a1d-485c-8a91-6c80ba419c04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:53.241420 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfdb580-0a1d-485c-8a91-6c80ba419c04 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:53.260582 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443815c7-efad-46fd-84ae-a03c6fcd7962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:53.261247 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443815c7-efad-46fd-84ae-a03c6fcd7962 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:53.261529 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443815c7-efad-46fd-84ae-a03c6fcd7962 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:53.261805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443815c7-efad-46fd-84ae-a03c6fcd7962 None admin] PATH_INFO: `/v3/users/4149212a50524852b6dbbdcbbc227d29` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:53.263349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443815c7-efad-46fd-84ae-a03c6fcd7962 None admin] RBAC: Authorizing `identity:get_user(user_id=4149212a50524852b6dbbdcbbc227d29)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:53.265554 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443815c7-efad-46fd-84ae-a03c6fcd7962 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:53.271866 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 42/78] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:55:53 2022] GET /identity/v3/users/4149212a50524852b6dbbdcbbc227d29 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:53.272726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443815c7-efad-46fd-84ae-a03c6fcd7962 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:53.342123 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:53.343935 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 37/79] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:55:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:53.344796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdb580-0a1d-485c-8a91-6c80ba419c04 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:53.387913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443815c7-efad-46fd-84ae-a03c6fcd7962 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:53.421907 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e83cf-880d-4c99-834c-1418fa224f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:53.422517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e83cf-880d-4c99-834c-1418fa224f96 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:53.422795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e83cf-880d-4c99-834c-1418fa224f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:53.423067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e83cf-880d-4c99-834c-1418fa224f96 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:53.423727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e83cf-880d-4c99-834c-1418fa224f96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:53.424059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e83cf-880d-4c99-834c-1418fa224f96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:53.425426 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e83cf-880d-4c99-834c-1418fa224f96 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:53.433518 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 43/80] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:55:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:53.434396 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e83cf-880d-4c99-834c-1418fa224f96 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:53.445601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:53.452743 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdb580-0a1d-485c-8a91-6c80ba419c04 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:53.486966 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda16d10-b8ad-4fc6-bb40-338590e0db00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:53.487588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda16d10-b8ad-4fc6-bb40-338590e0db00 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:53.487866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda16d10-b8ad-4fc6-bb40-338590e0db00 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:53.488158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda16d10-b8ad-4fc6-bb40-338590e0db00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:53.498118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda16d10-b8ad-4fc6-bb40-338590e0db00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-bda16d10-b8ad-4fc6-bb40-338590e0db00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:55:53.503424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:55:53.504329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:55:53.505416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:55:53.505416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:55:53.505416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:55:53.505416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:55:53.505416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:55:53.505416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:55:53.505416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:55:53.505416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:55:53.505416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:55:53.505416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:55:53.505416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:55:53.505416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:55:53.505416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 38/81] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:55:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:55:53.505416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda16d10-b8ad-4fc6-bb40-338590e0db00 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:53.539901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e83cf-880d-4c99-834c-1418fa224f96 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:53.564532 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:53.575467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c6cd1-53db-4e66-acd1-9ebd9b8848e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:53.576109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c6cd1-53db-4e66-acd1-9ebd9b8848e8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:53.576388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c6cd1-53db-4e66-acd1-9ebd9b8848e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:53.576657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c6cd1-53db-4e66-acd1-9ebd9b8848e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:53.607502 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda16d10-b8ad-4fc6-bb40-338590e0db00 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:53.641445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f1911-fa01-41f5-8417-91903d01a8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:53.641993 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f1911-fa01-41f5-8417-91903d01a8fa None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:53.642267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f1911-fa01-41f5-8417-91903d01a8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:53.642533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f1911-fa01-41f5-8417-91903d01a8fa None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:53.642620 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c6cd1-53db-4e66-acd1-9ebd9b8848e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:53.643656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f1911-fa01-41f5-8417-91903d01a8fa None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:53.644070 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c6cd1-53db-4e66-acd1-9ebd9b8848e8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:53.645128 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f1911-fa01-41f5-8417-91903d01a8fa None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:53.646758 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 39/82] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:55:53 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:53.647512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f1911-fa01-41f5-8417-91903d01a8fa None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:53.676299 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:53.743588 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 44/83] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:55:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:53.744461 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c6cd1-53db-4e66-acd1-9ebd9b8848e8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:53.753961 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f1911-fa01-41f5-8417-91903d01a8fa None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:53.768817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:53.787550 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2564f-c287-403e-bc43-e329838ce502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:53.788214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2564f-c287-403e-bc43-e329838ce502 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:53.788494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2564f-c287-403e-bc43-e329838ce502 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:53.788764 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2564f-c287-403e-bc43-e329838ce502 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:53.789892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2564f-c287-403e-bc43-e329838ce502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:53.791333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2564f-c287-403e-bc43-e329838ce502 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:53.792941 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 40/84] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:55:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:53.793700 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2564f-c287-403e-bc43-e329838ce502 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:53.843201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c6cd1-53db-4e66-acd1-9ebd9b8848e8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:53.876405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dc595-2bf2-4b3f-bbba-5adf0dcd3840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:53.877027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dc595-2bf2-4b3f-bbba-5adf0dcd3840 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:53.877305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dc595-2bf2-4b3f-bbba-5adf0dcd3840 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:53.877575 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dc595-2bf2-4b3f-bbba-5adf0dcd3840 None admin] PATH_INFO: `/v3/users/3cf964840139481f9a2810f3576d0b10` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:53.878710 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dc595-2bf2-4b3f-bbba-5adf0dcd3840 None admin] RBAC: Authorizing `identity:get_user(user_id=3cf964840139481f9a2810f3576d0b10)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:53.882102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dc595-2bf2-4b3f-bbba-5adf0dcd3840 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:53.883695 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 45/85] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:55:53 2022] GET /identity/v3/users/3cf964840139481f9a2810f3576d0b10 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:53.884479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dc595-2bf2-4b3f-bbba-5adf0dcd3840 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:53.888989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:53.898746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2564f-c287-403e-bc43-e329838ce502 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:53.932833 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5cc1f-0074-4fb6-bf76-aaac87998e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:53.933446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5cc1f-0074-4fb6-bf76-aaac87998e5a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:53.933725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5cc1f-0074-4fb6-bf76-aaac87998e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:53.934008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5cc1f-0074-4fb6-bf76-aaac87998e5a None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:53.934672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5cc1f-0074-4fb6-bf76-aaac87998e5a None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:53.934974 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5cc1f-0074-4fb6-bf76-aaac87998e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:53.936387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5cc1f-0074-4fb6-bf76-aaac87998e5a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:53.944671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 41/86] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:55:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:53.945377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5cc1f-0074-4fb6-bf76-aaac87998e5a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:53.982261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:53.992836 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dc595-2bf2-4b3f-bbba-5adf0dcd3840 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:54.026920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780d949-715f-4f2f-a444-6df22f57b10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:54.027518 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780d949-715f-4f2f-a444-6df22f57b10b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:54.027795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780d949-715f-4f2f-a444-6df22f57b10b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:54.028106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780d949-715f-4f2f-a444-6df22f57b10b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:54.028825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780d949-715f-4f2f-a444-6df22f57b10b None admin] RBAC: Adding query filter params (role.id=b0fa1b252ab74641b309e4a3d6aacc68, scope.project.id=aa51b8e01e6242dcb98f562872154655, user.id=3cf964840139481f9a2810f3576d0b10) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:54.029127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780d949-715f-4f2f-a444-6df22f57b10b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:54.031108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780d949-715f-4f2f-a444-6df22f57b10b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:54.036710 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 46/87] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:55:53 2022] GET /identity/v3/role_assignments?user.id=3cf964840139481f9a2810f3576d0b10&scope.project.id=aa51b8e01e6242dcb98f562872154655&role.id=b0fa1b252ab74641b309e4a3d6aacc68 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:54.037692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780d949-715f-4f2f-a444-6df22f57b10b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:54.054327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5cc1f-0074-4fb6-bf76-aaac87998e5a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:54.093236 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f62bf0-89f1-4aed-a286-39e6e3ec4ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:54.093899 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f62bf0-89f1-4aed-a286-39e6e3ec4ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:54.094180 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f62bf0-89f1-4aed-a286-39e6e3ec4ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:54.094450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f62bf0-89f1-4aed-a286-39e6e3ec4ad7 None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:54.095662 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f62bf0-89f1-4aed-a286-39e6e3ec4ad7 None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:54.097189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f62bf0-89f1-4aed-a286-39e6e3ec4ad7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:54.098901 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 42/88] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:55:53 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:54.099788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f62bf0-89f1-4aed-a286-39e6e3ec4ad7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:54.128686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:54.160065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780d949-715f-4f2f-a444-6df22f57b10b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:54.199105 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93e4e6-3775-45f4-91c0-7fa80eb1b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:54.199773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e4e6-3775-45f4-91c0-7fa80eb1b44a None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:54.200290 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e4e6-3775-45f4-91c0-7fa80eb1b44a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:54.200612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e4e6-3775-45f4-91c0-7fa80eb1b44a None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:54.201275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93e4e6-3775-45f4-91c0-7fa80eb1b44a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:54.203316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93e4e6-3775-45f4-91c0-7fa80eb1b44a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:54.223340 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f62bf0-89f1-4aed-a286-39e6e3ec4ad7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:54.231656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 47/89] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:55:54 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:55:54.232746 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93e4e6-3775-45f4-91c0-7fa80eb1b44a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:54.267238 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:54.268871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa8649-c885-45a9-a9b4-507d1597b20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:54.269552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa8649-c885-45a9-a9b4-507d1597b20b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:54.269836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa8649-c885-45a9-a9b4-507d1597b20b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:54.270108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa8649-c885-45a9-a9b4-507d1597b20b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:54.356561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa8649-c885-45a9-a9b4-507d1597b20b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:54.358201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa8649-c885-45a9-a9b4-507d1597b20b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:54.388095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:54.393096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93e4e6-3775-45f4-91c0-7fa80eb1b44a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:54.432793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a554e2c-41dc-4195-a2b1-0ce024f6b9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:54.433502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a554e2c-41dc-4195-a2b1-0ce024f6b9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:54.433873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a554e2c-41dc-4195-a2b1-0ce024f6b9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:54.434239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a554e2c-41dc-4195-a2b1-0ce024f6b9f5 None admin] PATH_INFO: `/v3/users/3cf964840139481f9a2810f3576d0b10` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:54.435486 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a554e2c-41dc-4195-a2b1-0ce024f6b9f5 None admin] RBAC: Authorizing `identity:get_user(user_id=3cf964840139481f9a2810f3576d0b10)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:54.437772 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a554e2c-41dc-4195-a2b1-0ce024f6b9f5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:54.439995 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 48/90] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:55:54 2022] GET /identity/v3/users/3cf964840139481f9a2810f3576d0b10 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:54.440787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a554e2c-41dc-4195-a2b1-0ce024f6b9f5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:54.490274 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 43/91] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:54.490274 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa8649-c885-45a9-a9b4-507d1597b20b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:54.559616 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:54.587681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a554e2c-41dc-4195-a2b1-0ce024f6b9f5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:54.631414 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa8649-c885-45a9-a9b4-507d1597b20b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:54.634710 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174edc3-929e-4557-9f59-d1e25919d829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:54.635140 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174edc3-929e-4557-9f59-d1e25919d829 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:54.635419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174edc3-929e-4557-9f59-d1e25919d829 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:54.635689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174edc3-929e-4557-9f59-d1e25919d829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:54.636469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174edc3-929e-4557-9f59-d1e25919d829 None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=aa51b8e01e6242dcb98f562872154655, user.id=4149212a50524852b6dbbdcbbc227d29) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:54.636771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174edc3-929e-4557-9f59-d1e25919d829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:54.638253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174edc3-929e-4557-9f59-d1e25919d829 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:54.645983 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 49/92] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:55:54 2022] GET /identity/v3/role_assignments?user.id=4149212a50524852b6dbbdcbbc227d29&scope.project.id=aa51b8e01e6242dcb98f562872154655&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:54.646828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174edc3-929e-4557-9f59-d1e25919d829 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:54.661060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:54.677646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a472e-b8f5-493d-bdcf-30c5963d1ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:54.678432 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a472e-b8f5-493d-bdcf-30c5963d1ded None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:54.678719 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a472e-b8f5-493d-bdcf-30c5963d1ded None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:54.679004 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a472e-b8f5-493d-bdcf-30c5963d1ded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:54.783513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174edc3-929e-4557-9f59-d1e25919d829 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:54.809172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a472e-b8f5-493d-bdcf-30c5963d1ded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:54.810682 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a472e-b8f5-493d-bdcf-30c5963d1ded None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:54.828229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9131d86-c75c-4f67-8dfc-ba33a461956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:54.828883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9131d86-c75c-4f67-8dfc-ba33a461956f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:54.829162 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9131d86-c75c-4f67-8dfc-ba33a461956f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:54.829437 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9131d86-c75c-4f67-8dfc-ba33a461956f None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:54.836770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9131d86-c75c-4f67-8dfc-ba33a461956f None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:54.838264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9131d86-c75c-4f67-8dfc-ba33a461956f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:54.839996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 50/93] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:55:54 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:54.846686 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9131d86-c75c-4f67-8dfc-ba33a461956f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:54.868907 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:54.998478 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 44/94] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:55.009581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a472e-b8f5-493d-bdcf-30c5963d1ded None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:55.015655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9131d86-c75c-4f67-8dfc-ba33a461956f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:55.056736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:55.057489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6ffdc-f1a0-4132-91c2-2bac2a0301c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:55.058182 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ffdc-f1a0-4132-91c2-2bac2a0301c4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:55.058502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ffdc-f1a0-4132-91c2-2bac2a0301c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:55.058776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ffdc-f1a0-4132-91c2-2bac2a0301c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:55.059631 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6ffdc-f1a0-4132-91c2-2bac2a0301c4 None admin] RBAC: Adding query filter params (role.id=1201453b538f4257a1dc8723d67c0cdd, scope.project.id=aa51b8e01e6242dcb98f562872154655, user.id=3cf964840139481f9a2810f3576d0b10) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:55.059974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6ffdc-f1a0-4132-91c2-2bac2a0301c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:55.063571 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6ffdc-f1a0-4132-91c2-2bac2a0301c4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:55.074844 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 51/95] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:55:54 2022] GET /identity/v3/role_assignments?user.id=3cf964840139481f9a2810f3576d0b10&scope.project.id=aa51b8e01e6242dcb98f562872154655&role.id=1201453b538f4257a1dc8723d67c0cdd => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:55:55.191933 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a472e-b8f5-493d-bdcf-30c5963d1ded None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:55.246489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6b672-9d05-4fe5-bbea-d0da4f37827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:55.246489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6b672-9d05-4fe5-bbea-d0da4f37827c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:55.246489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6b672-9d05-4fe5-bbea-d0da4f37827c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:55.246845 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6b672-9d05-4fe5-bbea-d0da4f37827c None admin] PATH_INFO: `/v3/projects/cbd94ed5353945b08a6042f1cb548930` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:55.248466 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6b672-9d05-4fe5-bbea-d0da4f37827c None admin] RBAC: Authorizing `identity:get_project(project_id=cbd94ed5353945b08a6042f1cb548930)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:55.249842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6b672-9d05-4fe5-bbea-d0da4f37827c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:55.251608 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 45/96] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:55:55 2022] GET /identity/v3/projects/cbd94ed5353945b08a6042f1cb548930 => generated 312 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:55:55.258225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6ffdc-f1a0-4132-91c2-2bac2a0301c4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:55.376247 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:55.406059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6ffdc-f1a0-4132-91c2-2bac2a0301c4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:55.456858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d4b87-d6b8-467d-9b59-f4a04104cae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:55.457472 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d4b87-d6b8-467d-9b59-f4a04104cae7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:55.457749 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d4b87-d6b8-467d-9b59-f4a04104cae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:55.458021 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d4b87-d6b8-467d-9b59-f4a04104cae7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:55.458748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d4b87-d6b8-467d-9b59-f4a04104cae7 None admin] RBAC: Adding query filter params (role.id=b0fa1b252ab74641b309e4a3d6aacc68, scope.project.id=cbd94ed5353945b08a6042f1cb548930, user.id=3cf964840139481f9a2810f3576d0b10) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:55.459053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d4b87-d6b8-467d-9b59-f4a04104cae7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:55.460521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d4b87-d6b8-467d-9b59-f4a04104cae7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:55.472491 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 52/97] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:55:55 2022] GET /identity/v3/role_assignments?user.id=3cf964840139481f9a2810f3576d0b10&scope.project.id=cbd94ed5353945b08a6042f1cb548930&role.id=b0fa1b252ab74641b309e4a3d6aacc68 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:56.596903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396e626-e71a-4c7b-84c5-3f75ba1f874e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:56.597460 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396e626-e71a-4c7b-84c5-3f75ba1f874e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:56.597460 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396e626-e71a-4c7b-84c5-3f75ba1f874e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:56.598833 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 46/98] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:56.612541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbabd8-fc87-4495-b4d5-2a7fbf986a8a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:56.613038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbabd8-fc87-4495-b4d5-2a7fbf986a8a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:56.613110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbabd8-fc87-4495-b4d5-2a7fbf986a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:56.639860 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d8dbabd8-fc87-4495-b4d5-2a7fbf986a8a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:56.641049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d8dbabd8-fc87-4495-b4d5-2a7fbf986a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:56.726948 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 53/99] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:55:57.163157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee234b-5927-445a-8b6c-97d22737a92e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:57.163578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee234b-5927-445a-8b6c-97d22737a92e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:57.163756 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee234b-5927-445a-8b6c-97d22737a92e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:57.165140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 47/100] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:57.185933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af452a3-fd11-4416-b5a0-3126810c58c2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:57.186551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af452a3-fd11-4416-b5a0-3126810c58c2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:57.187049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af452a3-fd11-4416-b5a0-3126810c58c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:57.206572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6af452a3-fd11-4416-b5a0-3126810c58c2 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:57.208097 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6af452a3-fd11-4416-b5a0-3126810c58c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:57.275501 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:57.284097 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 54/101] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:55:57.305048 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee234b-5927-445a-8b6c-97d22737a92e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:57.419313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:57.431750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee234b-5927-445a-8b6c-97d22737a92e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:57.475108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d691c-6e49-46ef-ae5c-b61a2a5dc168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:57.475772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d691c-6e49-46ef-ae5c-b61a2a5dc168 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:57.476078 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d691c-6e49-46ef-ae5c-b61a2a5dc168 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:57.476349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d691c-6e49-46ef-ae5c-b61a2a5dc168 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:57.497777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d691c-6e49-46ef-ae5c-b61a2a5dc168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-040d691c-6e49-46ef-ae5c-b61a2a5dc168 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:55:57.502643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:55:57.503591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:55:57.504372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:55:57.504372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:55:57.504372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:55:57.504372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:55:57.504372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:55:57.504372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:55:57.504372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:55:57.504372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:55:57.504372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:55:57.504372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:55:57.504372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:55:57.504372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:55:57.504372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 48/102] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:55:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:55:57.511322 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af452a3-fd11-4416-b5a0-3126810c58c2 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:57.622680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af452a3-fd11-4416-b5a0-3126810c58c2 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:57.659621 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f37854-b556-478f-9a1a-c94f472748b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:57.660260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f37854-b556-478f-9a1a-c94f472748b5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:57.660535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f37854-b556-478f-9a1a-c94f472748b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:57.660804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f37854-b556-478f-9a1a-c94f472748b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:57.661466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f37854-b556-478f-9a1a-c94f472748b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:57.661760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f37854-b556-478f-9a1a-c94f472748b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:57.663136 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f37854-b556-478f-9a1a-c94f472748b5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:57.671793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 55/103] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:55:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:57.677385 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d691c-6e49-46ef-ae5c-b61a2a5dc168 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:57.705501 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e2a08-0b8d-4a9e-ac73-fe7e249200b8 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:57.705793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e2a08-0b8d-4a9e-ac73-fe7e249200b8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:57.706048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e2a08-0b8d-4a9e-ac73-fe7e249200b8 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:57.707679 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 56/104] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:57.725269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5b3c4-4632-47f3-bd30-4deb21a64674 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:57.725595 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5b3c4-4632-47f3-bd30-4deb21a64674 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:57.725866 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5b3c4-4632-47f3-bd30-4deb21a64674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:57.754729 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c6f5b3c4-4632-47f3-bd30-4deb21a64674 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:57.755920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c6f5b3c4-4632-47f3-bd30-4deb21a64674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:57.828406 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:57.838782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 57/105] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:55:57.840191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60790c1f-7d07-41b7-8ff7-37da4c4fa731 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:57.840536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60790c1f-7d07-41b7-8ff7-37da4c4fa731 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:57.840874 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60790c1f-7d07-41b7-8ff7-37da4c4fa731 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:57.842324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 58/106] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:57.847689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcea5f-fe54-4d9a-905e-c8f9fadf3670 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:57.848015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcea5f-fe54-4d9a-905e-c8f9fadf3670 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:57.848345 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcea5f-fe54-4d9a-905e-c8f9fadf3670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:57.863168 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d691c-6e49-46ef-ae5c-b61a2a5dc168 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:57.867437 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4dfcea5f-fe54-4d9a-905e-c8f9fadf3670 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:57.868714 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4dfcea5f-fe54-4d9a-905e-c8f9fadf3670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:57.949526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 59/107] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:55:57.950884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9084833-ae6f-495c-ae1d-47d1d2e8c6af None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:57.951189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9084833-ae6f-495c-ae1d-47d1d2e8c6af None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:57.951449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9084833-ae6f-495c-ae1d-47d1d2e8c6af None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:57.952951 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 60/108] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:57.953848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cdc5e-9309-40ac-bac5-d219367d5282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:57.954772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cdc5e-9309-40ac-bac5-d219367d5282 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:57.955248 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cdc5e-9309-40ac-bac5-d219367d5282 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:57.960006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9084833-ae6f-495c-ae1d-47d1d2e8c6af None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:57.963721 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cdc5e-9309-40ac-bac5-d219367d5282 None admin] PATH_INFO: `/v3/users/3cf964840139481f9a2810f3576d0b10` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:57.965444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cdc5e-9309-40ac-bac5-d219367d5282 None admin] RBAC: Authorizing `identity:get_user(user_id=3cf964840139481f9a2810f3576d0b10)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:57.970915 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cdc5e-9309-40ac-bac5-d219367d5282 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:57.974786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 49/109] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:55:57 2022] GET /identity/v3/users/3cf964840139481f9a2810f3576d0b10 => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:57.976233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd501a-27f8-40e4-bf57-749b9d628aa1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:57.976767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd501a-27f8-40e4-bf57-749b9d628aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:57.977259 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd501a-27f8-40e4-bf57-749b9d628aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:58.020178 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d6bd501a-27f8-40e4-bf57-749b9d628aa1 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:58.028204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d6bd501a-27f8-40e4-bf57-749b9d628aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:58.064151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:58.132711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9084833-ae6f-495c-ae1d-47d1d2e8c6af None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:58.176027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:58.204766 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20361e95-df95-4411-86ae-b8d1ff9793bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:58.205757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20361e95-df95-4411-86ae-b8d1ff9793bd None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:58.206213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20361e95-df95-4411-86ae-b8d1ff9793bd None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:58.206628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20361e95-df95-4411-86ae-b8d1ff9793bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:58.208548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20361e95-df95-4411-86ae-b8d1ff9793bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:58.210167 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20361e95-df95-4411-86ae-b8d1ff9793bd None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:58.213500 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 61/110] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:55:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:58.214424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20361e95-df95-4411-86ae-b8d1ff9793bd None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:58.226100 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 50/111] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:55:58.227218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd501a-27f8-40e4-bf57-749b9d628aa1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:58.400762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd501a-27f8-40e4-bf57-749b9d628aa1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:58.413286 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20361e95-df95-4411-86ae-b8d1ff9793bd None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:58.441637 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e48cb-6720-414d-ab74-9f17a3dd9527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:58.442948 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e48cb-6720-414d-ab74-9f17a3dd9527 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:58.443515 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e48cb-6720-414d-ab74-9f17a3dd9527 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:58.444214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e48cb-6720-414d-ab74-9f17a3dd9527 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:58.456547 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce74d5c-abca-441c-aa5c-618e589e2726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:58.457081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e48cb-6720-414d-ab74-9f17a3dd9527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:55:58.457201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce74d5c-abca-441c-aa5c-618e589e2726 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:58.457425 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce74d5c-abca-441c-aa5c-618e589e2726 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:58.457693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce74d5c-abca-441c-aa5c-618e589e2726 None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:58.458893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce74d5c-abca-441c-aa5c-618e589e2726 None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:58.460343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce74d5c-abca-441c-aa5c-618e589e2726 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:58.462020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 62/112] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:55:58 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:58.466798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce74d5c-abca-441c-aa5c-618e589e2726 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-496e48cb-6720-414d-ab74-9f17a3dd9527 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:55:58.469470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:55:58.470292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:55:58.471038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:55:58.471038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:55:58.471038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:55:58.471038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:55:58.471038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:55:58.471038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:55:58.471038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:55:58.471038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:55:58.471038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:55:58.471038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:55:58.471038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:55:58.471038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:55:58.474342 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 51/113] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:55:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:55:58.476069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e48cb-6720-414d-ab74-9f17a3dd9527 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:58.509615 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:58.558762 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:58.607303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce74d5c-abca-441c-aa5c-618e589e2726 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:58.629275 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e48cb-6720-414d-ab74-9f17a3dd9527 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:58.641223 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d98d91-501f-4fd6-80ab-3c79e674f92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:58.641832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d98d91-501f-4fd6-80ab-3c79e674f92f None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:58.642114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d98d91-501f-4fd6-80ab-3c79e674f92f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:58.642387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d98d91-501f-4fd6-80ab-3c79e674f92f None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:58.643035 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d98d91-501f-4fd6-80ab-3c79e674f92f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:58.644548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d98d91-501f-4fd6-80ab-3c79e674f92f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:58.664523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e925f-193b-42ad-9dee-c0ddc3d98cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:58.665160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e925f-193b-42ad-9dee-c0ddc3d98cca None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:58.665443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e925f-193b-42ad-9dee-c0ddc3d98cca None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:58.665719 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e925f-193b-42ad-9dee-c0ddc3d98cca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:58.672316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 63/114] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Aug 30 04:55:58 2022] POST /identity/v3/projects => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:55:58.673112 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d98d91-501f-4fd6-80ab-3c79e674f92f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:58.677074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e925f-193b-42ad-9dee-c0ddc3d98cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-995e925f-193b-42ad-9dee-c0ddc3d98cca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:55:58.682234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:55:58.683724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:55:58.684514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:55:58.684514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:55:58.684514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:55:58.684514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:55:58.684514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:55:58.684514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:55:58.684514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:55:58.684514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:55:58.684514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:55:58.684514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:55:58.684514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:55:58.684514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:55:58.684514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 52/115] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:55:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:55:58.685160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e925f-193b-42ad-9dee-c0ddc3d98cca None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:58.767445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:58.799230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d98d91-501f-4fd6-80ab-3c79e674f92f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:58.805681 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e925f-193b-42ad-9dee-c0ddc3d98cca None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:58.813493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:58.847060 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e102a-59c4-4c0d-949c-b4f36257ec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:58.847736 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e102a-59c4-4c0d-949c-b4f36257ec8b None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:58.848117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e102a-59c4-4c0d-949c-b4f36257ec8b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:58.848342 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e102a-59c4-4c0d-949c-b4f36257ec8b None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655/users/3cf964840139481f9a2810f3576d0b10/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:58.850414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e102a-59c4-4c0d-949c-b4f36257ec8b None admin] RBAC: Authorizing `identity:create_grant(project_id=aa51b8e01e6242dcb98f562872154655, user_id=3cf964840139481f9a2810f3576d0b10, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:58.850876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b6861-5d00-4d17-8142-670743b810cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:58.851494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b6861-5d00-4d17-8142-670743b810cd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:58.851776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b6861-5d00-4d17-8142-670743b810cd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:58.851863 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e102a-59c4-4c0d-949c-b4f36257ec8b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:58.852097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b6861-5d00-4d17-8142-670743b810cd None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:58.852777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b6861-5d00-4d17-8142-670743b810cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:58.853084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b6861-5d00-4d17-8142-670743b810cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:58.854466 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b6861-5d00-4d17-8142-670743b810cd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:58.863763 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 53/116] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:55:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:58.865134 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c752e4-b4e4-41dd-980a-b23acd176dda None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:58.865498 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c752e4-b4e4-41dd-980a-b23acd176dda None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:58.865826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 64/117] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:55:58 2022] PUT /identity/v3/projects/aa51b8e01e6242dcb98f562872154655/users/3cf964840139481f9a2810f3576d0b10/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:55:58.865929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c752e4-b4e4-41dd-980a-b23acd176dda None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:58.866666 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e102a-59c4-4c0d-949c-b4f36257ec8b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:58.867588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 54/118] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:55:58.868492 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c752e4-b4e4-41dd-980a-b23acd176dda None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:58.995775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e102a-59c4-4c0d-949c-b4f36257ec8b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:59.010951 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c752e4-b4e4-41dd-980a-b23acd176dda None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:59.047472 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dfb57-8f0c-4c07-adb6-6753a454107e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:59.048227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dfb57-8f0c-4c07-adb6-6753a454107e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:59.048917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dfb57-8f0c-4c07-adb6-6753a454107e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:59.048917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dfb57-8f0c-4c07-adb6-6753a454107e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:59.051619 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:59.063118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de35f5-b65d-48d1-80a1-cb06068d0b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:59.063740 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de35f5-b65d-48d1-80a1-cb06068d0b59 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:59.064088 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de35f5-b65d-48d1-80a1-cb06068d0b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:59.064366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de35f5-b65d-48d1-80a1-cb06068d0b59 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:59.065047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de35f5-b65d-48d1-80a1-cb06068d0b59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:59.065350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de35f5-b65d-48d1-80a1-cb06068d0b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:59.066730 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de35f5-b65d-48d1-80a1-cb06068d0b59 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:59.067095 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981dfb57-8f0c-4c07-adb6-6753a454107e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-981dfb57-8f0c-4c07-adb6-6753a454107e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:55:59.072738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:55:59.073573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:55:59.074393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:55:59.074393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:55:59.074393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:55:59.074393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:55:59.074393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:55:59.074393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:55:59.074393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:55:59.074393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:55:59.074393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:55:59.074393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:55:59.074393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:55:59.074393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:55:59.074393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 65/119] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:55:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:55:59.075986 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2e305-2ec6-413d-9392-1dda90876b18 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:59.075986 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2e305-2ec6-413d-9392-1dda90876b18 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:59.075986 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2e305-2ec6-413d-9392-1dda90876b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:59.082801 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 55/120] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:55:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:59.085062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de35f5-b65d-48d1-80a1-cb06068d0b59 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:59.097416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-53c2e305-2ec6-413d-9392-1dda90876b18 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:59.098749 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-53c2e305-2ec6-413d-9392-1dda90876b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:59.133705 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:59.195399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 66/121] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:55:59.196403 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2e305-2ec6-413d-9392-1dda90876b18 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:59.220121 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de35f5-b65d-48d1-80a1-cb06068d0b59 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:59.260242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad64012-3890-4bf9-a7a4-9334e1cc5700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:59.261253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad64012-3890-4bf9-a7a4-9334e1cc5700 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:59.261873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad64012-3890-4bf9-a7a4-9334e1cc5700 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:59.262346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad64012-3890-4bf9-a7a4-9334e1cc5700 None admin] PATH_INFO: `/v3/users/4149212a50524852b6dbbdcbbc227d29` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:59.263776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad64012-3890-4bf9-a7a4-9334e1cc5700 None admin] RBAC: Authorizing `identity:get_user(user_id=4149212a50524852b6dbbdcbbc227d29)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:59.266093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad64012-3890-4bf9-a7a4-9334e1cc5700 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:59.268168 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 56/122] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:55:59 2022] GET /identity/v3/users/4149212a50524852b6dbbdcbbc227d29 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:59.269195 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad64012-3890-4bf9-a7a4-9334e1cc5700 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:59.301301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2e305-2ec6-413d-9392-1dda90876b18 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:59.337019 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061cbee-4eb6-490e-97f0-f601aac79587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:59.337626 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061cbee-4eb6-490e-97f0-f601aac79587 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:59.337901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061cbee-4eb6-490e-97f0-f601aac79587 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:59.338172 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061cbee-4eb6-490e-97f0-f601aac79587 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:59.338844 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061cbee-4eb6-490e-97f0-f601aac79587 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:59.339145 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061cbee-4eb6-490e-97f0-f601aac79587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:59.339557 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:59.340550 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061cbee-4eb6-490e-97f0-f601aac79587 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:59.349500 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 67/123] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:55:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:59.354847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061cbee-4eb6-490e-97f0-f601aac79587 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:59.380506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:59.388896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad64012-3890-4bf9-a7a4-9334e1cc5700 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:59.426957 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72e67a-b3ec-4cfe-a578-19143b8fca28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:59.428096 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72e67a-b3ec-4cfe-a578-19143b8fca28 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:59.428622 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72e67a-b3ec-4cfe-a578-19143b8fca28 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:59.429168 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72e67a-b3ec-4cfe-a578-19143b8fca28 None admin] PATH_INFO: `/v3/users/3cf964840139481f9a2810f3576d0b10` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:59.430539 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72e67a-b3ec-4cfe-a578-19143b8fca28 None admin] RBAC: Authorizing `identity:get_user(user_id=3cf964840139481f9a2810f3576d0b10)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:59.432280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72e67a-b3ec-4cfe-a578-19143b8fca28 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:59.434126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 57/124] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:55:59 2022] GET /identity/v3/users/3cf964840139481f9a2810f3576d0b10 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:59.435109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72e67a-b3ec-4cfe-a578-19143b8fca28 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:59.469450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061cbee-4eb6-490e-97f0-f601aac79587 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:59.519298 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a3338-72f2-488f-b850-f292ef07913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:59.520368 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a3338-72f2-488f-b850-f292ef07913e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:59.520840 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a3338-72f2-488f-b850-f292ef07913e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:59.521300 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a3338-72f2-488f-b850-f292ef07913e None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:59.522962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a3338-72f2-488f-b850-f292ef07913e None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:59.524625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a3338-72f2-488f-b850-f292ef07913e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:59.526879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 68/125] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:55:59 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:59.527826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a3338-72f2-488f-b850-f292ef07913e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:59.622009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72e67a-b3ec-4cfe-a578-19143b8fca28 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:59.636647 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:59.650531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a3338-72f2-488f-b850-f292ef07913e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:59.658670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc771b4-d307-499d-afac-eaf9beb739bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:59.659316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc771b4-d307-499d-afac-eaf9beb739bc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:59.659598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc771b4-d307-499d-afac-eaf9beb739bc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:59.659872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc771b4-d307-499d-afac-eaf9beb739bc None admin] PATH_INFO: `/v3/users/de1f7b258bcd4a1eae06cbb00646cc23` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:59.672337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:59.676513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc771b4-d307-499d-afac-eaf9beb739bc None admin] RBAC: Authorizing `identity:get_user(user_id=de1f7b258bcd4a1eae06cbb00646cc23)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:59.678875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc771b4-d307-499d-afac-eaf9beb739bc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:59.681875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 58/126] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:55:59 2022] GET /identity/v3/users/de1f7b258bcd4a1eae06cbb00646cc23 => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:59.683010 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc771b4-d307-499d-afac-eaf9beb739bc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:59.702409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0b1ff-ca4c-4e0d-b5bc-14b10af02a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:59.703358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0b1ff-ca4c-4e0d-b5bc-14b10af02a46 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:59.704152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0b1ff-ca4c-4e0d-b5bc-14b10af02a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:59.705000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0b1ff-ca4c-4e0d-b5bc-14b10af02a46 None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:59.706327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0b1ff-ca4c-4e0d-b5bc-14b10af02a46 None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:59.708551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0b1ff-ca4c-4e0d-b5bc-14b10af02a46 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:59.711489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 69/127] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:55:59 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:59.712551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0b1ff-ca4c-4e0d-b5bc-14b10af02a46 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:59.796862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc771b4-d307-499d-afac-eaf9beb739bc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:59.832836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220de3b5-a088-42dd-a795-46c3e5647a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:59.833576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220de3b5-a088-42dd-a795-46c3e5647a89 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:59.833860 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220de3b5-a088-42dd-a795-46c3e5647a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:59.834135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220de3b5-a088-42dd-a795-46c3e5647a89 None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655/users/4149212a50524852b6dbbdcbbc227d29/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:59.836125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220de3b5-a088-42dd-a795-46c3e5647a89 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa51b8e01e6242dcb98f562872154655, user_id=4149212a50524852b6dbbdcbbc227d29, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:59.837644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220de3b5-a088-42dd-a795-46c3e5647a89 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:59.845941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0b1ff-ca4c-4e0d-b5bc-14b10af02a46 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:59.857562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 59/128] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:55:59 2022] PUT /identity/v3/projects/aa51b8e01e6242dcb98f562872154655/users/4149212a50524852b6dbbdcbbc227d29/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:55:59.859539 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220de3b5-a088-42dd-a795-46c3e5647a89 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:59.889489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dca46c-7027-4e15-bb60-d4f46f1ffc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:59.891135 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca46c-7027-4e15-bb60-d4f46f1ffc7d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:59.891721 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca46c-7027-4e15-bb60-d4f46f1ffc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:59.892236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca46c-7027-4e15-bb60-d4f46f1ffc7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:59.907557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dca46c-7027-4e15-bb60-d4f46f1ffc7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-78dca46c-7027-4e15-bb60-d4f46f1ffc7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:55:59.915159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:55:59.916048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:55:59.916898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:55:59.916898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:55:59.916898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:55:59.916898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:55:59.916898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:55:59.916898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:55:59.916898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:55:59.916898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:55:59.916898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:55:59.916898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:55:59.916898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:55:59.916898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:55:59.917471 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:59.920055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 70/129] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:55:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:55:59.921789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dca46c-7027-4e15-bb60-d4f46f1ffc7d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:59.949239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:59.993843 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220de3b5-a088-42dd-a795-46c3e5647a89 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:00.036623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57299961-f5bd-4db3-bb6a-948ce2b95f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:00.036623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57299961-f5bd-4db3-bb6a-948ce2b95f84 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:00.036623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57299961-f5bd-4db3-bb6a-948ce2b95f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:00.036623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57299961-f5bd-4db3-bb6a-948ce2b95f84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:00.065349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dca46c-7027-4e15-bb60-d4f46f1ffc7d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:00.116213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bee900-d028-4784-8dca-7fa03d10fa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:00.117521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee900-d028-4784-8dca-7fa03d10fa96 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:00.118065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee900-d028-4784-8dca-7fa03d10fa96 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:00.118553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee900-d028-4784-8dca-7fa03d10fa96 None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655/users/3cf964840139481f9a2810f3576d0b10/roles/1201453b538f4257a1dc8723d67c0cdd` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:00.121519 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bee900-d028-4784-8dca-7fa03d10fa96 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa51b8e01e6242dcb98f562872154655, user_id=3cf964840139481f9a2810f3576d0b10, role_id=1201453b538f4257a1dc8723d67c0cdd)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:00.123185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bee900-d028-4784-8dca-7fa03d10fa96 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:00.141919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 71/130] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:55:59 2022] PUT /identity/v3/projects/aa51b8e01e6242dcb98f562872154655/users/3cf964840139481f9a2810f3576d0b10/roles/1201453b538f4257a1dc8723d67c0cdd => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:00.143436 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bee900-d028-4784-8dca-7fa03d10fa96 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:00.159909 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57299961-f5bd-4db3-bb6a-948ce2b95f84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:00.162122 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57299961-f5bd-4db3-bb6a-948ce2b95f84 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:00.219668 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:00.264889 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:00.312794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bee900-d028-4784-8dca-7fa03d10fa96 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:00.336469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 60/131] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:55:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:00.344704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57299961-f5bd-4db3-bb6a-948ce2b95f84 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:00.370905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d959eed-5326-4240-80d0-f6cf8340e9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:00.371522 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d959eed-5326-4240-80d0-f6cf8340e9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:00.371802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d959eed-5326-4240-80d0-f6cf8340e9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:00.372104 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d959eed-5326-4240-80d0-f6cf8340e9d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:00.372775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d959eed-5326-4240-80d0-f6cf8340e9d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:00.373077 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d959eed-5326-4240-80d0-f6cf8340e9d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:00.374494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d959eed-5326-4240-80d0-f6cf8340e9d0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:00.396337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 72/132] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:00.400729 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d959eed-5326-4240-80d0-f6cf8340e9d0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:00.548159 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57299961-f5bd-4db3-bb6a-948ce2b95f84 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:00.590333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d959eed-5326-4240-80d0-f6cf8340e9d0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:00.624435 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d328a6-ef48-45b0-ab3f-1b28d43f91ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:00.625080 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d328a6-ef48-45b0-ab3f-1b28d43f91ea None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:00.625360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d328a6-ef48-45b0-ab3f-1b28d43f91ea None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:00.625629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d328a6-ef48-45b0-ab3f-1b28d43f91ea None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:00.626798 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d328a6-ef48-45b0-ab3f-1b28d43f91ea None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:00.628289 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d328a6-ef48-45b0-ab3f-1b28d43f91ea None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:00.630214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 61/133] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:00 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:00.642914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d328a6-ef48-45b0-ab3f-1b28d43f91ea None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:00.675016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3eaf39-6a8a-4d58-8d06-482b68e7111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:00.675645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3eaf39-6a8a-4d58-8d06-482b68e7111c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:00.675920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3eaf39-6a8a-4d58-8d06-482b68e7111c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:00.676224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3eaf39-6a8a-4d58-8d06-482b68e7111c None admin] PATH_INFO: `/v3/users/3cf964840139481f9a2810f3576d0b10` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:00.677516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3eaf39-6a8a-4d58-8d06-482b68e7111c None admin] RBAC: Authorizing `identity:get_user(user_id=3cf964840139481f9a2810f3576d0b10)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:00.680028 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:00.680599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3eaf39-6a8a-4d58-8d06-482b68e7111c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:00.682300 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 73/134] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:00 2022] GET /identity/v3/users/3cf964840139481f9a2810f3576d0b10 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:00.690401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3eaf39-6a8a-4d58-8d06-482b68e7111c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:00.708341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:00.847165 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d328a6-ef48-45b0-ab3f-1b28d43f91ea None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:00.890376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3eaf39-6a8a-4d58-8d06-482b68e7111c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:00.938127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381b354-3289-41a2-b200-10b7b7efc6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:00.938666 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381b354-3289-41a2-b200-10b7b7efc6fc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:00.938951 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381b354-3289-41a2-b200-10b7b7efc6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:00.939229 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381b354-3289-41a2-b200-10b7b7efc6fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:00.939988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381b354-3289-41a2-b200-10b7b7efc6fc None admin] RBAC: Adding query filter params (role.id=5197d75b3317432da8f4d292f4953baa, scope.project.id=aa51b8e01e6242dcb98f562872154655, user.id=de1f7b258bcd4a1eae06cbb00646cc23) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:00.940301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381b354-3289-41a2-b200-10b7b7efc6fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:00.941836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381b354-3289-41a2-b200-10b7b7efc6fc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:00.943922 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01ac4e-aa16-40f7-8e71-3804936e6fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:00.944596 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01ac4e-aa16-40f7-8e71-3804936e6fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:00.944877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01ac4e-aa16-40f7-8e71-3804936e6fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:00.945146 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01ac4e-aa16-40f7-8e71-3804936e6fd4 None admin] PATH_INFO: `/v3/projects/cbd94ed5353945b08a6042f1cb548930` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:00.948759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01ac4e-aa16-40f7-8e71-3804936e6fd4 None admin] RBAC: Authorizing `identity:get_project(project_id=cbd94ed5353945b08a6042f1cb548930)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:00.950441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01ac4e-aa16-40f7-8e71-3804936e6fd4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:00.952741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 74/135] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:00 2022] GET /identity/v3/projects/cbd94ed5353945b08a6042f1cb548930 => generated 312 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:00.957924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 62/136] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:00 2022] GET /identity/v3/role_assignments?user.id=de1f7b258bcd4a1eae06cbb00646cc23&scope.project.id=aa51b8e01e6242dcb98f562872154655&role.id=5197d75b3317432da8f4d292f4953baa => generated 259 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:00.958432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01ac4e-aa16-40f7-8e71-3804936e6fd4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:01.102425 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:01.135605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01ac4e-aa16-40f7-8e71-3804936e6fd4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:01.188931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a587d2-c93e-4ae2-8ae6-3c83afb16b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:01.189535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a587d2-c93e-4ae2-8ae6-3c83afb16b28 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:01.189814 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a587d2-c93e-4ae2-8ae6-3c83afb16b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:01.190088 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a587d2-c93e-4ae2-8ae6-3c83afb16b28 None admin] PATH_INFO: `/v3/projects/cbd94ed5353945b08a6042f1cb548930/users/3cf964840139481f9a2810f3576d0b10/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:01.192180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a587d2-c93e-4ae2-8ae6-3c83afb16b28 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbd94ed5353945b08a6042f1cb548930, user_id=3cf964840139481f9a2810f3576d0b10, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:01.193645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a587d2-c93e-4ae2-8ae6-3c83afb16b28 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:01.218089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 75/137] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:56:00 2022] PUT /identity/v3/projects/cbd94ed5353945b08a6042f1cb548930/users/3cf964840139481f9a2810f3576d0b10/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:56:01.337463 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd9f0-b1c2-444d-9a58-1979584e6cd7 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:01.338108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd9f0-b1c2-444d-9a58-1979584e6cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:01.338610 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd9f0-b1c2-444d-9a58-1979584e6cd7 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:01.340328 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 63/138] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:01.346977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476015f1-b20c-478a-8e55-6fc2ac562f0d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:01.347602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476015f1-b20c-478a-8e55-6fc2ac562f0d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:01.348111 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476015f1-b20c-478a-8e55-6fc2ac562f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:01.370862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-476015f1-b20c-478a-8e55-6fc2ac562f0d None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:01.372491 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-476015f1-b20c-478a-8e55-6fc2ac562f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:01.463273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 76/139] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:01.555850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a41b83-5455-43ab-ab2a-dec3c816c1a4 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:01.556521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a41b83-5455-43ab-ab2a-dec3c816c1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:01.556991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a41b83-5455-43ab-ab2a-dec3c816c1a4 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:01.558673 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 64/140] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:01.564081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c778bc-bea6-432e-8fa4-f90aa9c05e4f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:01.564362 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c778bc-bea6-432e-8fa4-f90aa9c05e4f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:01.564633 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c778bc-bea6-432e-8fa4-f90aa9c05e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:01.593539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-39c778bc-bea6-432e-8fa4-f90aa9c05e4f None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:01.594740 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-39c778bc-bea6-432e-8fa4-f90aa9c05e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:01.688941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:01.698594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 77/141] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:01.985333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a41b83-5455-43ab-ab2a-dec3c816c1a4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:02.091453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:02.114335 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a41b83-5455-43ab-ab2a-dec3c816c1a4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:02.154106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef809-4929-4f5c-b399-224976502947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:02.154772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef809-4929-4f5c-b399-224976502947 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:02.155133 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef809-4929-4f5c-b399-224976502947 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:02.155426 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef809-4929-4f5c-b399-224976502947 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:02.156577 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aef809-4929-4f5c-b399-224976502947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:02.158029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aef809-4929-4f5c-b399-224976502947 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:02.159600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 65/142] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:02.166168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c778bc-bea6-432e-8fa4-f90aa9c05e4f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:02.207964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef809-4929-4f5c-b399-224976502947 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:02.344090 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c778bc-bea6-432e-8fa4-f90aa9c05e4f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:02.376900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef809-4929-4f5c-b399-224976502947 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:02.407471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3aec41-4479-4464-9d34-d4f51ba5a2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:02.409618 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3aec41-4479-4464-9d34-d4f51ba5a2b0 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:02.410264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3aec41-4479-4464-9d34-d4f51ba5a2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:02.411774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3aec41-4479-4464-9d34-d4f51ba5a2b0 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:02.412605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3aec41-4479-4464-9d34-d4f51ba5a2b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:02.415108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3aec41-4479-4464-9d34-d4f51ba5a2b0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:02.444132 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea2d5d-0aec-4ea9-91c3-e3f4f94eef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:02.445130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea2d5d-0aec-4ea9-91c3-e3f4f94eef16 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:02.445571 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea2d5d-0aec-4ea9-91c3-e3f4f94eef16 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:02.446039 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea2d5d-0aec-4ea9-91c3-e3f4f94eef16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:02.458945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea2d5d-0aec-4ea9-91c3-e3f4f94eef16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-6aea2d5d-0aec-4ea9-91c3-e3f4f94eef16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:02.464934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:02.465976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:02.466895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:02.466895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:02.466895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:02.466895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:02.466895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:02.466895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:02.466895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:02.466895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:02.466895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:02.466895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:02.466895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:02.466895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:02.469399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 66/143] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:56:02.470519 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 78/144] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:56:02 2022] POST /identity/v3/users => generated 283 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:02.477348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea2d5d-0aec-4ea9-91c3-e3f4f94eef16 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:02.488662 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:02.610326 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea2d5d-0aec-4ea9-91c3-e3f4f94eef16 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:02.622112 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6058072-b3aa-44a2-bf05-acc264264483 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:02.622400 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6058072-b3aa-44a2-bf05-acc264264483 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:02.622662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6058072-b3aa-44a2-bf05-acc264264483 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:02.624960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 79/145] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:02.630847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b4c88-1fc1-4db5-b24f-24707e509ce5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:02.630847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b4c88-1fc1-4db5-b24f-24707e509ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:02.631114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b4c88-1fc1-4db5-b24f-24707e509ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:02.648781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb31df-5fe5-4d4c-9e6c-b00fa18451f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:02.649797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb31df-5fe5-4d4c-9e6c-b00fa18451f1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:02.650254 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb31df-5fe5-4d4c-9e6c-b00fa18451f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:02.650700 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb31df-5fe5-4d4c-9e6c-b00fa18451f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:02.651583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb31df-5fe5-4d4c-9e6c-b00fa18451f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:02.652238 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb31df-5fe5-4d4c-9e6c-b00fa18451f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:02.653904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb31df-5fe5-4d4c-9e6c-b00fa18451f1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:02.663349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 67/146] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:02.670743 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb31df-5fe5-4d4c-9e6c-b00fa18451f1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:02.671180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3c8b4c88-1fc1-4db5-b24f-24707e509ce5 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:02.672405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3c8b4c88-1fc1-4db5-b24f-24707e509ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:02.768186 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:02.786556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:02.822433 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb31df-5fe5-4d4c-9e6c-b00fa18451f1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:02.829425 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 80/147] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:02.857629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089552c3-3e7a-4f8c-9a94-34ea154af605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:02.858794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089552c3-3e7a-4f8c-9a94-34ea154af605 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:02.859073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089552c3-3e7a-4f8c-9a94-34ea154af605 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:02.859344 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089552c3-3e7a-4f8c-9a94-34ea154af605 None admin] PATH_INFO: `/v3/users/3cf964840139481f9a2810f3576d0b10` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:02.860589 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089552c3-3e7a-4f8c-9a94-34ea154af605 None admin] RBAC: Authorizing `identity:get_user(user_id=3cf964840139481f9a2810f3576d0b10)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:02.861982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089552c3-3e7a-4f8c-9a94-34ea154af605 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:02.863576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 68/148] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:02 2022] GET /identity/v3/users/3cf964840139481f9a2810f3576d0b10 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:02.869219 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b4c88-1fc1-4db5-b24f-24707e509ce5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:02.996262 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b4c88-1fc1-4db5-b24f-24707e509ce5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:03.044778 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a5327-4df7-4ac6-8b05-7a092190b00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:03.045983 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a5327-4df7-4ac6-8b05-7a092190b00a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:03.046259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a5327-4df7-4ac6-8b05-7a092190b00a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:03.046526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a5327-4df7-4ac6-8b05-7a092190b00a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:03.105076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:03.124265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6568b-a28f-4c73-bbc6-420e8c6f7465 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:03.124727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6568b-a28f-4c73-bbc6-420e8c6f7465 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:03.124727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6568b-a28f-4c73-bbc6-420e8c6f7465 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:03.126079 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 69/149] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:56:03.131476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577894a-ab86-4259-84b2-34cc6d8a835a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:03.131757 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577894a-ab86-4259-84b2-34cc6d8a835a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:03.132102 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577894a-ab86-4259-84b2-34cc6d8a835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:03.157424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a5327-4df7-4ac6-8b05-7a092190b00a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:03.159127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a5327-4df7-4ac6-8b05-7a092190b00a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:03.167232 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3577894a-ab86-4259-84b2-34cc6d8a835a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:03.168507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3577894a-ab86-4259-84b2-34cc6d8a835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:03.290359 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 70/150] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:56:03.291418 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577894a-ab86-4259-84b2-34cc6d8a835a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:03.318453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 81/151] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:03.323868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a5327-4df7-4ac6-8b05-7a092190b00a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:03.380407 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:03.420448 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:03.427478 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577894a-ab86-4259-84b2-34cc6d8a835a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:03.449449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a5327-4df7-4ac6-8b05-7a092190b00a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:03.476669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789fbb3-8882-49ce-ab0b-d9eb2c792afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:03.477325 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789fbb3-8882-49ce-ab0b-d9eb2c792afd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:03.477608 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789fbb3-8882-49ce-ab0b-d9eb2c792afd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:03.478166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789fbb3-8882-49ce-ab0b-d9eb2c792afd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:03.496004 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789fbb3-8882-49ce-ab0b-d9eb2c792afd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-4789fbb3-8882-49ce-ab0b-d9eb2c792afd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:03.500922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:03.501751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:03.502512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:03.502512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:03.502512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:03.502512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:03.502512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:03.502512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:03.502512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:03.502512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:03.502512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:03.502512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:03.502512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:56:03.502512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:03.508651 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 71/152] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:56:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:03.510508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c561f-3406-4541-a376-2b153709fa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:03.511155 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c561f-3406-4541-a376-2b153709fa34 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:03.511430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c561f-3406-4541-a376-2b153709fa34 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:03.511700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c561f-3406-4541-a376-2b153709fa34 None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:03.513030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789fbb3-8882-49ce-ab0b-d9eb2c792afd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:03.515078 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c561f-3406-4541-a376-2b153709fa34 None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:03.516563 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c561f-3406-4541-a376-2b153709fa34 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:03.518207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 82/153] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:03 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:03.523865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c561f-3406-4541-a376-2b153709fa34 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:03.711465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c561f-3406-4541-a376-2b153709fa34 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:03.730077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789fbb3-8882-49ce-ab0b-d9eb2c792afd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:03.758123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:03.765860 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f9bdf-5a04-443b-babf-6928f9db8d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:03.766464 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9bdf-5a04-443b-babf-6928f9db8d83 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:03.766738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9bdf-5a04-443b-babf-6928f9db8d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:03.767003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9bdf-5a04-443b-babf-6928f9db8d83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:03.767727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f9bdf-5a04-443b-babf-6928f9db8d83 None admin] RBAC: Adding query filter params (role.id=b0fa1b252ab74641b309e4a3d6aacc68, scope.project.id=aa51b8e01e6242dcb98f562872154655, user.id=3cf964840139481f9a2810f3576d0b10) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:03.768057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f9bdf-5a04-443b-babf-6928f9db8d83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:03.769489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f9bdf-5a04-443b-babf-6928f9db8d83 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:03.778073 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 83/154] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:03 2022] GET /identity/v3/role_assignments?user.id=3cf964840139481f9a2810f3576d0b10&scope.project.id=aa51b8e01e6242dcb98f562872154655&role.id=b0fa1b252ab74641b309e4a3d6aacc68 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:03.778903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f9bdf-5a04-443b-babf-6928f9db8d83 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:03.779221 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e5c58-5d13-4a41-9294-12068280b57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:03.780410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e5c58-5d13-4a41-9294-12068280b57f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:03.780746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e5c58-5d13-4a41-9294-12068280b57f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:03.781024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e5c58-5d13-4a41-9294-12068280b57f None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:03.781706 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e5c58-5d13-4a41-9294-12068280b57f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:03.782005 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e5c58-5d13-4a41-9294-12068280b57f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:03.783422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e5c58-5d13-4a41-9294-12068280b57f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:03.801782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 72/155] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:03.807458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e5c58-5d13-4a41-9294-12068280b57f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:03.812385 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:03.978410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e5c58-5d13-4a41-9294-12068280b57f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:04.010172 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f9bdf-5a04-443b-babf-6928f9db8d83 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:04.048692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25176b5-92ae-447c-8661-390623568eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:04.049353 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25176b5-92ae-447c-8661-390623568eff None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:04.049635 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25176b5-92ae-447c-8661-390623568eff None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:04.049913 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25176b5-92ae-447c-8661-390623568eff None admin] PATH_INFO: `/v3/users/4149212a50524852b6dbbdcbbc227d29` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:04.051126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25176b5-92ae-447c-8661-390623568eff None admin] RBAC: Authorizing `identity:get_user(user_id=4149212a50524852b6dbbdcbbc227d29)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:04.052627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25176b5-92ae-447c-8661-390623568eff None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:04.054406 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 73/156] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:03 2022] GET /identity/v3/users/4149212a50524852b6dbbdcbbc227d29 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:04.056541 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f9aa7-5564-4fe4-903b-0c7d5452f7ec None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:04.056825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f9aa7-5564-4fe4-903b-0c7d5452f7ec None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:04.057105 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f9aa7-5564-4fe4-903b-0c7d5452f7ec None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:04.058503 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 74/157] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:04.063196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f9aa7-5564-4fe4-903b-0c7d5452f7ec None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:04.077180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151465d9-0d0a-44e3-b0fa-81bea7840f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:04.078148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151465d9-0d0a-44e3-b0fa-81bea7840f2f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:04.078791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151465d9-0d0a-44e3-b0fa-81bea7840f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:04.079261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151465d9-0d0a-44e3-b0fa-81bea7840f2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:04.095754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151465d9-0d0a-44e3-b0fa-81bea7840f2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-151465d9-0d0a-44e3-b0fa-81bea7840f2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:04.102103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:04.103042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:04.103804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:04.103804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:04.103804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:04.103804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:04.103804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:04.103804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:04.103804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:04.103804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:04.103804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:04.103804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:04.103804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:04.103804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:04.106090 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 84/158] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:56:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:04.107502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd4ba5-cf6d-4b49-9df3-cca6052144a9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:04.108094 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd4ba5-cf6d-4b49-9df3-cca6052144a9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:04.108568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd4ba5-cf6d-4b49-9df3-cca6052144a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:04.127520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-67bd4ba5-cf6d-4b49-9df3-cca6052144a9 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:04.129673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-67bd4ba5-cf6d-4b49-9df3-cca6052144a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:04.146227 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:04.204692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f9aa7-5564-4fe4-903b-0c7d5452f7ec None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:04.223328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 85/159] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:04.224600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd4ba5-cf6d-4b49-9df3-cca6052144a9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:04.228092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:04.264291 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ca1b8-a9a1-4548-a665-5358e66b493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:04.265189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ca1b8-a9a1-4548-a665-5358e66b493c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:04.265606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ca1b8-a9a1-4548-a665-5358e66b493c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:04.266013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ca1b8-a9a1-4548-a665-5358e66b493c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:04.332565 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd4ba5-cf6d-4b49-9df3-cca6052144a9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:04.371389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b59c65-1005-4928-be69-c956d1b00080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:04.372184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b59c65-1005-4928-be69-c956d1b00080 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:04.372556 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b59c65-1005-4928-be69-c956d1b00080 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:04.372922 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b59c65-1005-4928-be69-c956d1b00080 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:04.374253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b59c65-1005-4928-be69-c956d1b00080 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:04.374643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b59c65-1005-4928-be69-c956d1b00080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:04.376132 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b59c65-1005-4928-be69-c956d1b00080 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:04.378608 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ca1b8-a9a1-4548-a665-5358e66b493c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:04.380332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ca1b8-a9a1-4548-a665-5358e66b493c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:04.385605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 86/160] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:04.386968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f68335-012e-4ec9-9854-5fcf708ae1b4 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:04.387339 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f68335-012e-4ec9-9854-5fcf708ae1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:04.387697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f68335-012e-4ec9-9854-5fcf708ae1b4 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:04.391971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 87/161] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:04.395074 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae423-7bc6-4c7b-85f8-7217bcc29326 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:04.395439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae423-7bc6-4c7b-85f8-7217bcc29326 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:04.395778 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae423-7bc6-4c7b-85f8-7217bcc29326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:04.414025 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-621ae423-7bc6-4c7b-85f8-7217bcc29326 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:04.415328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-621ae423-7bc6-4c7b-85f8-7217bcc29326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:04.459477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:04.509816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:04.523090 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 88/162] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:56:04.523915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ae423-7bc6-4c7b-85f8-7217bcc29326 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:04.562177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 75/163] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 04:56:04.566568 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ca1b8-a9a1-4548-a665-5358e66b493c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:04.757418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ae423-7bc6-4c7b-85f8-7217bcc29326 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:04.770781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ca1b8-a9a1-4548-a665-5358e66b493c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:04.814426 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3441ed-7b0d-4a8f-9654-d471e3615a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:04.814977 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3441ed-7b0d-4a8f-9654-d471e3615a18 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:04.815249 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3441ed-7b0d-4a8f-9654-d471e3615a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:04.815514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3441ed-7b0d-4a8f-9654-d471e3615a18 None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:04.817287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3441ed-7b0d-4a8f-9654-d471e3615a18 None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:04.818748 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3441ed-7b0d-4a8f-9654-d471e3615a18 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:04.820660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 76/164] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:04 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:04.821442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3441ed-7b0d-4a8f-9654-d471e3615a18 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:04.825173 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b196b-bea6-4a2b-a293-cda1a63ec767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:04.825810 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b196b-bea6-4a2b-a293-cda1a63ec767 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:04.826083 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b196b-bea6-4a2b-a293-cda1a63ec767 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:04.826994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b196b-bea6-4a2b-a293-cda1a63ec767 None admin] PATH_INFO: `/v3/users/3cf964840139481f9a2810f3576d0b10` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:04.828319 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b196b-bea6-4a2b-a293-cda1a63ec767 None admin] RBAC: Authorizing `identity:get_user(user_id=3cf964840139481f9a2810f3576d0b10)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:04.829730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b196b-bea6-4a2b-a293-cda1a63ec767 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:04.831282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 89/165] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:04 2022] GET /identity/v3/users/3cf964840139481f9a2810f3576d0b10 => generated 275 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:04.832038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b196b-bea6-4a2b-a293-cda1a63ec767 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:04.877138 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:04.962880 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:05.008869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3441ed-7b0d-4a8f-9654-d471e3615a18 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:05.038915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b196b-bea6-4a2b-a293-cda1a63ec767 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:05.046900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931a429-e457-420b-adb6-1d690bf8bfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:05.047542 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931a429-e457-420b-adb6-1d690bf8bfe4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.047819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931a429-e457-420b-adb6-1d690bf8bfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.048111 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931a429-e457-420b-adb6-1d690bf8bfe4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.059090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931a429-e457-420b-adb6-1d690bf8bfe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-2931a429-e457-420b-adb6-1d690bf8bfe4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:05.064786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:05.065618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:05.066623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:05.066623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:05.066623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:05.066623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:05.066623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:05.066623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:05.066623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:05.066623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:05.066623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:05.066623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:05.066623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:05.066623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:05.066623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 77/166] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:05.067253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931a429-e457-420b-adb6-1d690bf8bfe4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:05.117405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618628ee-81f2-4448-bf1f-34be2eb54526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:05.118370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618628ee-81f2-4448-bf1f-34be2eb54526 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.118846 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618628ee-81f2-4448-bf1f-34be2eb54526 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.119303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618628ee-81f2-4448-bf1f-34be2eb54526 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.120251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618628ee-81f2-4448-bf1f-34be2eb54526 None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=aa51b8e01e6242dcb98f562872154655, user.id=4149212a50524852b6dbbdcbbc227d29) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:05.120783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618628ee-81f2-4448-bf1f-34be2eb54526 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:05.122399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618628ee-81f2-4448-bf1f-34be2eb54526 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:05.142051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 90/167] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:04 2022] GET /identity/v3/role_assignments?user.id=4149212a50524852b6dbbdcbbc227d29&scope.project.id=aa51b8e01e6242dcb98f562872154655&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 608 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:05.143166 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618628ee-81f2-4448-bf1f-34be2eb54526 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:05.165427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:05.190814 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931a429-e457-420b-adb6-1d690bf8bfe4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:05.231767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b5518-0a5b-4d21-93ff-d5a6b454afd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:05.233468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b5518-0a5b-4d21-93ff-d5a6b454afd7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.233972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b5518-0a5b-4d21-93ff-d5a6b454afd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.234466 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b5518-0a5b-4d21-93ff-d5a6b454afd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.315073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b5518-0a5b-4d21-93ff-d5a6b454afd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:05.317046 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b5518-0a5b-4d21-93ff-d5a6b454afd7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:05.414976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:05.424365 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618628ee-81f2-4448-bf1f-34be2eb54526 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:05.454796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 78/168] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:05.455448 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:05.455635 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b5518-0a5b-4d21-93ff-d5a6b454afd7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:05.467858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430740-d223-442f-be4d-51b0768349ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:05.468485 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430740-d223-442f-be4d-51b0768349ca None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.468757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430740-d223-442f-be4d-51b0768349ca None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.469017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430740-d223-442f-be4d-51b0768349ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.486482 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc430740-d223-442f-be4d-51b0768349ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-fc430740-d223-442f-be4d-51b0768349ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:05.494682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:05.495716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:05.496577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:05.496577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:05.496577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:05.496577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:05.496577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:05.496577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:05.496577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:05.496577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:05.496577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:05.496577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:05.496577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:05.496577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:05.496577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 91/169] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:05.497294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430740-d223-442f-be4d-51b0768349ca None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:05.677919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430740-d223-442f-be4d-51b0768349ca None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:05.682000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b5518-0a5b-4d21-93ff-d5a6b454afd7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:05.739425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca262b2-354d-4ce7-b0a9-32e12c77ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:05.740060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca262b2-354d-4ce7-b0a9-32e12c77ff4e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.740329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca262b2-354d-4ce7-b0a9-32e12c77ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.740599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca262b2-354d-4ce7-b0a9-32e12c77ff4e None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.741417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca262b2-354d-4ce7-b0a9-32e12c77ff4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:05.741721 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca262b2-354d-4ce7-b0a9-32e12c77ff4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:05.743661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca262b2-354d-4ce7-b0a9-32e12c77ff4e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:05.752414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84c301-2041-4d7d-8614-89a9e3e264d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:05.753060 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84c301-2041-4d7d-8614-89a9e3e264d2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.753384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84c301-2041-4d7d-8614-89a9e3e264d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.753657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84c301-2041-4d7d-8614-89a9e3e264d2 None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.755064 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84c301-2041-4d7d-8614-89a9e3e264d2 None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:05.756806 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84c301-2041-4d7d-8614-89a9e3e264d2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:05.758668 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 92/170] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:05 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:05.760830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84c301-2041-4d7d-8614-89a9e3e264d2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:05.763547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 79/171] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:05.769994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca262b2-354d-4ce7-b0a9-32e12c77ff4e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:05.850125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:05.858338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:05.911255 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84c301-2041-4d7d-8614-89a9e3e264d2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:05.969094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca262b2-354d-4ce7-b0a9-32e12c77ff4e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:05.983034 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff571f5-e77c-400a-843a-1cd0cc991fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:05.984115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff571f5-e77c-400a-843a-1cd0cc991fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.984612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff571f5-e77c-400a-843a-1cd0cc991fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.985138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff571f5-e77c-400a-843a-1cd0cc991fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.986014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff571f5-e77c-400a-843a-1cd0cc991fe4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:05.986835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff571f5-e77c-400a-843a-1cd0cc991fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:05.990055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff571f5-e77c-400a-843a-1cd0cc991fe4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:06.010156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 93/172] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:06.015190 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff571f5-e77c-400a-843a-1cd0cc991fe4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:06.050873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a5890-f055-4c88-8b81-b29f33579488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:06.051565 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a5890-f055-4c88-8b81-b29f33579488 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:06.051844 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a5890-f055-4c88-8b81-b29f33579488 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:06.052129 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a5890-f055-4c88-8b81-b29f33579488 None admin] PATH_INFO: `/v3/users/de1f7b258bcd4a1eae06cbb00646cc23` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:06.054266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a5890-f055-4c88-8b81-b29f33579488 None admin] RBAC: Authorizing `identity:get_user(user_id=de1f7b258bcd4a1eae06cbb00646cc23)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:06.055842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a5890-f055-4c88-8b81-b29f33579488 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:06.057722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 80/173] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:05 2022] GET /identity/v3/users/de1f7b258bcd4a1eae06cbb00646cc23 => generated 289 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:06.058858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a5890-f055-4c88-8b81-b29f33579488 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:06.224206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a5890-f055-4c88-8b81-b29f33579488 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:06.229372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff571f5-e77c-400a-843a-1cd0cc991fe4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:06.239889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:06.264629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e60ae-fc42-4f75-b59b-3b73459b6930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:06.265327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e60ae-fc42-4f75-b59b-3b73459b6930 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:06.265600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e60ae-fc42-4f75-b59b-3b73459b6930 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:06.265867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e60ae-fc42-4f75-b59b-3b73459b6930 None admin] PATH_INFO: `/v3/users/3cf964840139481f9a2810f3576d0b10` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:06.267050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e60ae-fc42-4f75-b59b-3b73459b6930 None admin] RBAC: Authorizing `identity:get_user(user_id=3cf964840139481f9a2810f3576d0b10)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:06.268996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e60ae-fc42-4f75-b59b-3b73459b6930 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:06.270926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 81/174] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:06 2022] GET /identity/v3/users/3cf964840139481f9a2810f3576d0b10 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:06.271715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e60ae-fc42-4f75-b59b-3b73459b6930 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:06.272265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:06.320315 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba7b6d-3fa4-4c81-9fb2-96cf690c7da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:06.320932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba7b6d-3fa4-4c81-9fb2-96cf690c7da5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:06.321211 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba7b6d-3fa4-4c81-9fb2-96cf690c7da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:06.321479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba7b6d-3fa4-4c81-9fb2-96cf690c7da5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:06.322208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba7b6d-3fa4-4c81-9fb2-96cf690c7da5 None admin] RBAC: Adding query filter params (role.id=1201453b538f4257a1dc8723d67c0cdd, scope.project.id=aa51b8e01e6242dcb98f562872154655, user.id=3cf964840139481f9a2810f3576d0b10) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:06.322511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba7b6d-3fa4-4c81-9fb2-96cf690c7da5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:06.324071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba7b6d-3fa4-4c81-9fb2-96cf690c7da5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:06.332932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 94/175] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:06 2022] GET /identity/v3/role_assignments?user.id=3cf964840139481f9a2810f3576d0b10&scope.project.id=aa51b8e01e6242dcb98f562872154655&role.id=1201453b538f4257a1dc8723d67c0cdd => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:06.333651 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba7b6d-3fa4-4c81-9fb2-96cf690c7da5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:06.459588 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba7b6d-3fa4-4c81-9fb2-96cf690c7da5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:06.504067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b185f8f-39ee-47f6-a356-f10aba596e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:06.504999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b185f8f-39ee-47f6-a356-f10aba596e9f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:06.505433 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b185f8f-39ee-47f6-a356-f10aba596e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:06.506372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b185f8f-39ee-47f6-a356-f10aba596e9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:06.551991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e60ae-fc42-4f75-b59b-3b73459b6930 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:06.571064 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:06.589328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b185f8f-39ee-47f6-a356-f10aba596e9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:06.591513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b185f8f-39ee-47f6-a356-f10aba596e9f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:06.592926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93565cdd-e9b8-4df7-8b5c-27ca916d0c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:06.592926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93565cdd-e9b8-4df7-8b5c-27ca916d0c74 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:06.593222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93565cdd-e9b8-4df7-8b5c-27ca916d0c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:06.593499 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93565cdd-e9b8-4df7-8b5c-27ca916d0c74 None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:06.594644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93565cdd-e9b8-4df7-8b5c-27ca916d0c74 None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:06.596122 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93565cdd-e9b8-4df7-8b5c-27ca916d0c74 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:06.597778 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 82/176] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:06 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:06.599259 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfe883-482b-4b8d-86f1-04b532a1226e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:06.599549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfe883-482b-4b8d-86f1-04b532a1226e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:06.599820 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfe883-482b-4b8d-86f1-04b532a1226e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:06.601921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 83/177] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:06.603307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12437c-17a6-44a7-8a72-644db0f3d85e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:06.603561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12437c-17a6-44a7-8a72-644db0f3d85e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:06.604049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12437c-17a6-44a7-8a72-644db0f3d85e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:06.605347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 84/178] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:06.611161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f340f-9867-4b56-980b-09e034f91fb9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:06.611779 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f340f-9867-4b56-980b-09e034f91fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:06.611779 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f340f-9867-4b56-980b-09e034f91fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:06.634226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2b4f340f-9867-4b56-980b-09e034f91fb9 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:06.635981 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2b4f340f-9867-4b56-980b-09e034f91fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:06.696235 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:06.719812 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 85/179] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:56:06.723559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46099086-2ef1-4222-b4ad-c860e37c2921 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:06.723559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46099086-2ef1-4222-b4ad-c860e37c2921 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:06.723559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46099086-2ef1-4222-b4ad-c860e37c2921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:06.729906 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 95/180] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:06.730933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b185f8f-39ee-47f6-a356-f10aba596e9f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:06.741334 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-46099086-2ef1-4222-b4ad-c860e37c2921 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:06.742551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-46099086-2ef1-4222-b4ad-c860e37c2921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:06.817377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 86/181] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:06.818800 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd5c22-30ce-4ef1-b69e-36d7348bbd63 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:06.819271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd5c22-30ce-4ef1-b69e-36d7348bbd63 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:06.819539 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd5c22-30ce-4ef1-b69e-36d7348bbd63 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:06.820872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 87/182] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:06.826494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd5c22-30ce-4ef1-b69e-36d7348bbd63 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:06.830625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:06.858767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b185f8f-39ee-47f6-a356-f10aba596e9f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:06.901219 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8bb8a-100e-4304-9bd8-f6d041594924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:06.901888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8bb8a-100e-4304-9bd8-f6d041594924 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:06.902160 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8bb8a-100e-4304-9bd8-f6d041594924 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:06.902421 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8bb8a-100e-4304-9bd8-f6d041594924 None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655/users/de1f7b258bcd4a1eae06cbb00646cc23/roles/5197d75b3317432da8f4d292f4953baa` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:06.905225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8bb8a-100e-4304-9bd8-f6d041594924 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa51b8e01e6242dcb98f562872154655, user_id=de1f7b258bcd4a1eae06cbb00646cc23, role_id=5197d75b3317432da8f4d292f4953baa)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:06.907282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8bb8a-100e-4304-9bd8-f6d041594924 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:06.927873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 96/183] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:56:06 2022] PUT /identity/v3/projects/aa51b8e01e6242dcb98f562872154655/users/de1f7b258bcd4a1eae06cbb00646cc23/roles/5197d75b3317432da8f4d292f4953baa => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:06.929469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134163c6-ac7f-49ec-99a7-08725e18057b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:06.929923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134163c6-ac7f-49ec-99a7-08725e18057b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:06.930363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134163c6-ac7f-49ec-99a7-08725e18057b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:06.955617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-134163c6-ac7f-49ec-99a7-08725e18057b None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:06.956954 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd5c22-30ce-4ef1-b69e-36d7348bbd63 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:06.957281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-134163c6-ac7f-49ec-99a7-08725e18057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:06.974901 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:07.013808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6416fae-185e-4bb6-8dec-68c48da31618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:07.014838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6416fae-185e-4bb6-8dec-68c48da31618 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:07.015326 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6416fae-185e-4bb6-8dec-68c48da31618 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:07.015802 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6416fae-185e-4bb6-8dec-68c48da31618 None admin] PATH_INFO: `/v3/projects/cbd94ed5353945b08a6042f1cb548930` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:07.017381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6416fae-185e-4bb6-8dec-68c48da31618 None admin] RBAC: Authorizing `identity:get_project(project_id=cbd94ed5353945b08a6042f1cb548930)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:07.019181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6416fae-185e-4bb6-8dec-68c48da31618 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:07.021760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 88/184] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:06 2022] GET /identity/v3/projects/cbd94ed5353945b08a6042f1cb548930 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:07.027734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6416fae-185e-4bb6-8dec-68c48da31618 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:07.064052 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 97/185] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:07.064052 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134163c6-ac7f-49ec-99a7-08725e18057b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:07.147063 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:07.197509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134163c6-ac7f-49ec-99a7-08725e18057b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:07.210637 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6416fae-185e-4bb6-8dec-68c48da31618 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:07.248846 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bd667-a918-4c99-80fe-63afe4b252b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:07.250463 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bd667-a918-4c99-80fe-63afe4b252b1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:07.250957 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bd667-a918-4c99-80fe-63afe4b252b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:07.251067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb3ed9-8a9e-43f7-9ad6-8792d2f48d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:07.251553 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bd667-a918-4c99-80fe-63afe4b252b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:07.251662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb3ed9-8a9e-43f7-9ad6-8792d2f48d63 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:07.251870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb3ed9-8a9e-43f7-9ad6-8792d2f48d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:07.252170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb3ed9-8a9e-43f7-9ad6-8792d2f48d63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:07.252901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb3ed9-8a9e-43f7-9ad6-8792d2f48d63 None admin] RBAC: Adding query filter params (role.id=b0fa1b252ab74641b309e4a3d6aacc68, scope.project.id=cbd94ed5353945b08a6042f1cb548930, user.id=3cf964840139481f9a2810f3576d0b10) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:07.253242 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb3ed9-8a9e-43f7-9ad6-8792d2f48d63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:07.254969 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb3ed9-8a9e-43f7-9ad6-8792d2f48d63 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:07.263765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 98/186] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:07 2022] GET /identity/v3/role_assignments?user.id=3cf964840139481f9a2810f3576d0b10&scope.project.id=cbd94ed5353945b08a6042f1cb548930&role.id=b0fa1b252ab74641b309e4a3d6aacc68 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:07.268116 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bd667-a918-4c99-80fe-63afe4b252b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:07.269306 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb3ed9-8a9e-43f7-9ad6-8792d2f48d63 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-eb8bd667-a918-4c99-80fe-63afe4b252b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:07.275989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:07.276945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:07.277736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:07.277736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:07.277736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:07.277736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:07.277736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:07.277736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:07.277736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:07.277736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:07.277736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:07.277736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:07.277736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:07.277736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:07.277736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 89/187] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:56:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:07.279233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bd667-a918-4c99-80fe-63afe4b252b1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:07.333585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:07.421007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bd667-a918-4c99-80fe-63afe4b252b1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:07.445791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb3ed9-8a9e-43f7-9ad6-8792d2f48d63 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:07.463650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314221de-2627-4fe0-a76a-3632d5a1a549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:07.464368 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314221de-2627-4fe0-a76a-3632d5a1a549 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:07.464645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314221de-2627-4fe0-a76a-3632d5a1a549 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:07.464977 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314221de-2627-4fe0-a76a-3632d5a1a549 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:07.465683 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314221de-2627-4fe0-a76a-3632d5a1a549 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:07.466065 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314221de-2627-4fe0-a76a-3632d5a1a549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:07.468235 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314221de-2627-4fe0-a76a-3632d5a1a549 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:07.479106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 90/188] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:07.479726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314221de-2627-4fe0-a76a-3632d5a1a549 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:07.491824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b142a3-5ecb-4297-a6d0-8b8db02a6004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:07.492513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b142a3-5ecb-4297-a6d0-8b8db02a6004 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:07.492789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b142a3-5ecb-4297-a6d0-8b8db02a6004 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:07.493057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b142a3-5ecb-4297-a6d0-8b8db02a6004 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:07.499204 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:07.507217 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b142a3-5ecb-4297-a6d0-8b8db02a6004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-30b142a3-5ecb-4297-a6d0-8b8db02a6004 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:07.514733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:07.515656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:07.516528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:07.516528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:07.516528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:07.516528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:07.516528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:07.516528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:07.516528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:07.516528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:07.516528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:07.516528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:07.516528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:56:07.516528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:07.516528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 99/189] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:56:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:07.517189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b142a3-5ecb-4297-a6d0-8b8db02a6004 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:07.598087 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:07.601878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314221de-2627-4fe0-a76a-3632d5a1a549 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:07.644584 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e96af0-98d8-4c99-a62d-bbbe9ead383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:07.645251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e96af0-98d8-4c99-a62d-bbbe9ead383b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:07.645519 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e96af0-98d8-4c99-a62d-bbbe9ead383b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:07.645893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b142a3-5ecb-4297-a6d0-8b8db02a6004 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:07.646001 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e96af0-98d8-4c99-a62d-bbbe9ead383b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:07.646909 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e96af0-98d8-4c99-a62d-bbbe9ead383b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:07.648408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e96af0-98d8-4c99-a62d-bbbe9ead383b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:07.649987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 91/190] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:07.650746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e96af0-98d8-4c99-a62d-bbbe9ead383b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:07.685444 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe4e88-10d4-4941-b5b3-6732af5d293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:07.686461 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe4e88-10d4-4941-b5b3-6732af5d293a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:07.686929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe4e88-10d4-4941-b5b3-6732af5d293a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:07.687430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe4e88-10d4-4941-b5b3-6732af5d293a None admin] PATH_INFO: `/v3/users/6d4c913c000e4d8692478de0e7001453` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:07.703883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe4e88-10d4-4941-b5b3-6732af5d293a None admin] RBAC: Authorizing `identity:get_user(user_id=6d4c913c000e4d8692478de0e7001453)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:07.705447 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe4e88-10d4-4941-b5b3-6732af5d293a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:07.712115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 100/191] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:07 2022] GET /identity/v3/users/6d4c913c000e4d8692478de0e7001453 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:07.712115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe4e88-10d4-4941-b5b3-6732af5d293a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:07.761269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e96af0-98d8-4c99-a62d-bbbe9ead383b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:07.771164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:07.802541 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b410a59-c635-4e4d-b678-03fd4a39144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:07.803146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b410a59-c635-4e4d-b678-03fd4a39144e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:07.803430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b410a59-c635-4e4d-b678-03fd4a39144e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:07.803698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b410a59-c635-4e4d-b678-03fd4a39144e None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:07.804399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b410a59-c635-4e4d-b678-03fd4a39144e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:07.804707 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b410a59-c635-4e4d-b678-03fd4a39144e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:07.806080 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b410a59-c635-4e4d-b678-03fd4a39144e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:07.818964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 92/192] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:07.818964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b410a59-c635-4e4d-b678-03fd4a39144e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:07.824835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe4e88-10d4-4941-b5b3-6732af5d293a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:07.848430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:07.862783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ab446-8e8e-4229-8372-56389805e5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:07.863400 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ab446-8e8e-4229-8372-56389805e5d1 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:07.863678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ab446-8e8e-4229-8372-56389805e5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:07.863971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ab446-8e8e-4229-8372-56389805e5d1 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:07.864627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ab446-8e8e-4229-8372-56389805e5d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:07.866063 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ab446-8e8e-4229-8372-56389805e5d1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:07.890148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 101/193] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:56:07 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:07.891407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ab446-8e8e-4229-8372-56389805e5d1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:07.939525 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b410a59-c635-4e4d-b678-03fd4a39144e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:07.982486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c1463-48d9-4283-8efd-c4e9223d3700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:07.983240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c1463-48d9-4283-8efd-c4e9223d3700 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:07.983590 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c1463-48d9-4283-8efd-c4e9223d3700 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:07.983928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c1463-48d9-4283-8efd-c4e9223d3700 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:08.044231 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ab446-8e8e-4229-8372-56389805e5d1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:08.057140 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:08.085251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c1463-48d9-4283-8efd-c4e9223d3700 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:08.086727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c1463-48d9-4283-8efd-c4e9223d3700 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:08.094982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9ee3-c008-4688-888f-0a5770b859b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:08.095635 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9ee3-c008-4688-888f-0a5770b859b9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:08.095912 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9ee3-c008-4688-888f-0a5770b859b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:08.096218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9ee3-c008-4688-888f-0a5770b859b9 None admin] PATH_INFO: `/v3/users/6d4c913c000e4d8692478de0e7001453` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:08.097373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b9ee3-c008-4688-888f-0a5770b859b9 None admin] RBAC: Authorizing `identity:get_user(user_id=6d4c913c000e4d8692478de0e7001453)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:08.098835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b9ee3-c008-4688-888f-0a5770b859b9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:08.100570 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 102/194] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:07 2022] GET /identity/v3/users/6d4c913c000e4d8692478de0e7001453 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:08.106151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9ee3-c008-4688-888f-0a5770b859b9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:08.125141 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:08.226308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 93/195] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:08.231780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c1463-48d9-4283-8efd-c4e9223d3700 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:08.243482 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9ee3-c008-4688-888f-0a5770b859b9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:08.289992 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e31c2-9c19-4bcc-a8c5-40b1d2f8b593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:08.290614 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e31c2-9c19-4bcc-a8c5-40b1d2f8b593 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:08.290901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e31c2-9c19-4bcc-a8c5-40b1d2f8b593 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:08.291158 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e31c2-9c19-4bcc-a8c5-40b1d2f8b593 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:08.344237 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:08.350102 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c1463-48d9-4283-8efd-c4e9223d3700 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:08.370899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e31c2-9c19-4bcc-a8c5-40b1d2f8b593 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:08.372419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e31c2-9c19-4bcc-a8c5-40b1d2f8b593 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:08.384040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:08.392585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2fa0f-3eee-46fa-b160-0846d3664e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:08.393418 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2fa0f-3eee-46fa-b160-0846d3664e2a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:08.393858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2fa0f-3eee-46fa-b160-0846d3664e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:08.394281 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2fa0f-3eee-46fa-b160-0846d3664e2a None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:08.395737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2fa0f-3eee-46fa-b160-0846d3664e2a None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:08.397552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2fa0f-3eee-46fa-b160-0846d3664e2a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:08.399862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 94/196] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:08 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:08.406147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2fa0f-3eee-46fa-b160-0846d3664e2a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:08.493548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 103/197] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 04:56:08.500473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e31c2-9c19-4bcc-a8c5-40b1d2f8b593 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:08.518163 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2fa0f-3eee-46fa-b160-0846d3664e2a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:08.555676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b217c-9338-46eb-82b4-295e52e54e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:08.556600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b217c-9338-46eb-82b4-295e52e54e42 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:08.557040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b217c-9338-46eb-82b4-295e52e54e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:08.557562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b217c-9338-46eb-82b4-295e52e54e42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:08.558546 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b217c-9338-46eb-82b4-295e52e54e42 None admin] RBAC: Adding query filter params (role.id=1201453b538f4257a1dc8723d67c0cdd, scope.project.id=01a8779a6dd0442da92e2069510aded8, user.id=6d4c913c000e4d8692478de0e7001453) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:08.558991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b217c-9338-46eb-82b4-295e52e54e42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:08.561273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b217c-9338-46eb-82b4-295e52e54e42 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:08.567867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 95/198] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:08 2022] GET /identity/v3/role_assignments?user.id=6d4c913c000e4d8692478de0e7001453&scope.project.id=01a8779a6dd0442da92e2069510aded8&role.id=1201453b538f4257a1dc8723d67c0cdd => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:08.582841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:08.607015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e31c2-9c19-4bcc-a8c5-40b1d2f8b593 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:08.657003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d90c6f-015d-4030-b532-694af11f3a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:08.658045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d90c6f-015d-4030-b532-694af11f3a9f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:08.658491 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d90c6f-015d-4030-b532-694af11f3a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:08.658808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d90c6f-015d-4030-b532-694af11f3a9f None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:08.665031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d90c6f-015d-4030-b532-694af11f3a9f None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:08.667142 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d90c6f-015d-4030-b532-694af11f3a9f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:08.669387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 104/199] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:08 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:08.679033 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b217c-9338-46eb-82b4-295e52e54e42 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:08.778926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:08.825179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b217c-9338-46eb-82b4-295e52e54e42 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:08.870671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca81d3-b37f-49f7-be91-dff90df444d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:08.871672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca81d3-b37f-49f7-be91-dff90df444d6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:08.872255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca81d3-b37f-49f7-be91-dff90df444d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:08.872741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca81d3-b37f-49f7-be91-dff90df444d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:08.873704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca81d3-b37f-49f7-be91-dff90df444d6 None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=01a8779a6dd0442da92e2069510aded8, user.id=6d4c913c000e4d8692478de0e7001453) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:08.874216 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca81d3-b37f-49f7-be91-dff90df444d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:08.875855 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca81d3-b37f-49f7-be91-dff90df444d6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:08.888959 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 96/200] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:08 2022] GET /identity/v3/role_assignments?user.id=6d4c913c000e4d8692478de0e7001453&scope.project.id=01a8779a6dd0442da92e2069510aded8&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:09.111434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36574e28-984b-403c-aef8-f503dcd65e41 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:09.111987 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36574e28-984b-403c-aef8-f503dcd65e41 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:09.111987 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36574e28-984b-403c-aef8-f503dcd65e41 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:09.113417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 105/201] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:09.118934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f416b0-671c-4082-ad67-f0876f6f8d66 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:09.119460 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f416b0-671c-4082-ad67-f0876f6f8d66 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:09.119921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f416b0-671c-4082-ad67-f0876f6f8d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:09.140291 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-42f416b0-671c-4082-ad67-f0876f6f8d66 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:09.141837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-42f416b0-671c-4082-ad67-f0876f6f8d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:09.238190 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 97/202] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:09.618253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36574e28-984b-403c-aef8-f503dcd65e41 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:09.751841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36574e28-984b-403c-aef8-f503dcd65e41 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:09.798316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1283db-3340-42f9-bf0a-9a3160b38c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:09.799003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1283db-3340-42f9-bf0a-9a3160b38c01 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:09.799272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1283db-3340-42f9-bf0a-9a3160b38c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:09.799545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1283db-3340-42f9-bf0a-9a3160b38c01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:09.813861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1283db-3340-42f9-bf0a-9a3160b38c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-9a1283db-3340-42f9-bf0a-9a3160b38c01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:09.818732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:09.819607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:09.820417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:09.820417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:09.820417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:09.820417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:09.820417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:09.820417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:09.820417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:09.820417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:09.820417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:09.820417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:09.820417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:09.820417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:09.820417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 106/203] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:09.827778 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f416b0-671c-4082-ad67-f0876f6f8d66 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:09.913040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:09.969430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f416b0-671c-4082-ad67-f0876f6f8d66 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:10.005265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0dd15-49fa-48f0-b6eb-4202d5307f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:10.005889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0dd15-49fa-48f0-b6eb-4202d5307f5d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:10.006432 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0dd15-49fa-48f0-b6eb-4202d5307f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:10.006705 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0dd15-49fa-48f0-b6eb-4202d5307f5d None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:10.007383 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0dd15-49fa-48f0-b6eb-4202d5307f5d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:10.007687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0dd15-49fa-48f0-b6eb-4202d5307f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:10.009124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0dd15-49fa-48f0-b6eb-4202d5307f5d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:10.018227 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 98/204] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:10.026957 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1283db-3340-42f9-bf0a-9a3160b38c01 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:10.047419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:10.188862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1283db-3340-42f9-bf0a-9a3160b38c01 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:10.239423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526bc29-fb46-4c0e-922b-89e8b8980a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:10.240092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526bc29-fb46-4c0e-922b-89e8b8980a19 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:10.240371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526bc29-fb46-4c0e-922b-89e8b8980a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:10.240640 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526bc29-fb46-4c0e-922b-89e8b8980a19 None admin] PATH_INFO: `/v3/users/de1f7b258bcd4a1eae06cbb00646cc23` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:10.241814 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526bc29-fb46-4c0e-922b-89e8b8980a19 None admin] RBAC: Authorizing `identity:get_user(user_id=de1f7b258bcd4a1eae06cbb00646cc23)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:10.243276 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526bc29-fb46-4c0e-922b-89e8b8980a19 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:10.245071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 107/205] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:10 2022] GET /identity/v3/users/de1f7b258bcd4a1eae06cbb00646cc23 => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:10.251881 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0dd15-49fa-48f0-b6eb-4202d5307f5d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:10.390357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0dd15-49fa-48f0-b6eb-4202d5307f5d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:10.408465 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:10.434970 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2193ee5-2446-4897-ab14-9613542b84d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:10.435627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2193ee5-2446-4897-ab14-9613542b84d8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:10.435912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2193ee5-2446-4897-ab14-9613542b84d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:10.436222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2193ee5-2446-4897-ab14-9613542b84d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:10.502223 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae64ec7-0d4a-41f8-aa47-c6919b495f3c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:10.502509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae64ec7-0d4a-41f8-aa47-c6919b495f3c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:10.502685 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae64ec7-0d4a-41f8-aa47-c6919b495f3c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:10.504071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 108/206] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:10.508154 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2193ee5-2446-4897-ab14-9613542b84d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:10.509761 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247353b5-0cbc-43ed-b37f-ade5d6cc44f2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:10.509945 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247353b5-0cbc-43ed-b37f-ade5d6cc44f2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:10.510238 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247353b5-0cbc-43ed-b37f-ade5d6cc44f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:10.513695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2193ee5-2446-4897-ab14-9613542b84d8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:10.556963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-247353b5-0cbc-43ed-b37f-ade5d6cc44f2 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:10.558858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-247353b5-0cbc-43ed-b37f-ade5d6cc44f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:10.621088 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 99/207] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:10.626953 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2193ee5-2446-4897-ab14-9613542b84d8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:10.660806 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:10.663829 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 109/208] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:10.780955 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4652120-72de-4e3e-ba18-55b1d4598566 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:10.781131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4652120-72de-4e3e-ba18-55b1d4598566 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:10.781407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4652120-72de-4e3e-ba18-55b1d4598566 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:10.783008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 110/209] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:10.788976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed446c-23ce-4409-82ce-516bdc20b741 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:10.789261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed446c-23ce-4409-82ce-516bdc20b741 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:10.789535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed446c-23ce-4409-82ce-516bdc20b741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:10.796322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2193ee5-2446-4897-ab14-9613542b84d8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:10.800170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:10.817777 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-12ed446c-23ce-4409-82ce-516bdc20b741 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:10.818970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-12ed446c-23ce-4409-82ce-516bdc20b741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:10.832560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89d149-8db2-4f8c-89fc-d8405b4296f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:10.833282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89d149-8db2-4f8c-89fc-d8405b4296f0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:10.833484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89d149-8db2-4f8c-89fc-d8405b4296f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:10.833748 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89d149-8db2-4f8c-89fc-d8405b4296f0 None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:10.834892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89d149-8db2-4f8c-89fc-d8405b4296f0 None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:10.836384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89d149-8db2-4f8c-89fc-d8405b4296f0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:10.838011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 100/210] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:10 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:10.846663 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89d149-8db2-4f8c-89fc-d8405b4296f0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:10.952071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 111/211] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:10.975301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96816e1-3008-4267-9e3e-b35e1f2e5e87 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:10.975631 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96816e1-3008-4267-9e3e-b35e1f2e5e87 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:10.975854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96816e1-3008-4267-9e3e-b35e1f2e5e87 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:10.981312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 112/212] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:56:10.982092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96816e1-3008-4267-9e3e-b35e1f2e5e87 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:10.998733 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:11.017211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89d149-8db2-4f8c-89fc-d8405b4296f0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:11.056664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b741f-02bc-4cee-9e70-7d057e85171a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:11.057518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b741f-02bc-4cee-9e70-7d057e85171a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:11.057933 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b741f-02bc-4cee-9e70-7d057e85171a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:11.058350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b741f-02bc-4cee-9e70-7d057e85171a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:11.059211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b741f-02bc-4cee-9e70-7d057e85171a None admin] RBAC: Adding query filter params (role.id=5197d75b3317432da8f4d292f4953baa, scope.project.id=aa51b8e01e6242dcb98f562872154655, user.id=de1f7b258bcd4a1eae06cbb00646cc23) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:11.059652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b741f-02bc-4cee-9e70-7d057e85171a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:11.061837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b741f-02bc-4cee-9e70-7d057e85171a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:11.068061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 101/213] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:10 2022] GET /identity/v3/role_assignments?user.id=de1f7b258bcd4a1eae06cbb00646cc23&scope.project.id=aa51b8e01e6242dcb98f562872154655&role.id=5197d75b3317432da8f4d292f4953baa => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:11.076468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666a7f3-e5c3-405b-af5a-69833bb1cdb6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:11.077130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666a7f3-e5c3-405b-af5a-69833bb1cdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:11.077543 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666a7f3-e5c3-405b-af5a-69833bb1cdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:11.109172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c666a7f3-e5c3-405b-af5a-69833bb1cdb6 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:11.110643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c666a7f3-e5c3-405b-af5a-69833bb1cdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:11.137902 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96816e1-3008-4267-9e3e-b35e1f2e5e87 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:11.186546 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843bf72-42ed-46ff-b5cf-a5b2ad2b4a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:11.187521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843bf72-42ed-46ff-b5cf-a5b2ad2b4a70 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:11.187964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843bf72-42ed-46ff-b5cf-a5b2ad2b4a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:11.188513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843bf72-42ed-46ff-b5cf-a5b2ad2b4a70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:11.194243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:11.217901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843bf72-42ed-46ff-b5cf-a5b2ad2b4a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1843bf72-42ed-46ff-b5cf-a5b2ad2b4a70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:11.225220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:11.226353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:11.227138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:11.227138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:11.227138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:11.227138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:11.227138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:11.227138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:11.227138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:11.227138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:11.227138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:11.227138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:11.227138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:11.227138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:11.229861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 113/214] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:11.236982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843bf72-42ed-46ff-b5cf-a5b2ad2b4a70 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:11.266746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 102/215] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:11.283570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666a7f3-e5c3-405b-af5a-69833bb1cdb6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:11.370492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843bf72-42ed-46ff-b5cf-a5b2ad2b4a70 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:11.389584 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:11.416409 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666a7f3-e5c3-405b-af5a-69833bb1cdb6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:11.424312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6748a-471f-4e22-a79f-c41812f6ab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:11.425714 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6748a-471f-4e22-a79f-c41812f6ab54 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:11.426227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6748a-471f-4e22-a79f-c41812f6ab54 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:11.426680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6748a-471f-4e22-a79f-c41812f6ab54 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:11.427506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6748a-471f-4e22-a79f-c41812f6ab54 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:11.428441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6748a-471f-4e22-a79f-c41812f6ab54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:11.430557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6748a-471f-4e22-a79f-c41812f6ab54 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:11.443030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 114/216] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:11.449483 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6748a-471f-4e22-a79f-c41812f6ab54 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:11.463957 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1faf4-9f70-4ba6-a160-6278ff2a5ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:11.465360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1faf4-9f70-4ba6-a160-6278ff2a5ffa None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:11.465782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1faf4-9f70-4ba6-a160-6278ff2a5ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:11.466210 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1faf4-9f70-4ba6-a160-6278ff2a5ffa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:11.468050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1faf4-9f70-4ba6-a160-6278ff2a5ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:11.469957 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1faf4-9f70-4ba6-a160-6278ff2a5ffa None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:11.472507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 103/217] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:11.477811 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1faf4-9f70-4ba6-a160-6278ff2a5ffa None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:11.526617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:11.578081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6748a-471f-4e22-a79f-c41812f6ab54 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:11.603788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1faf4-9f70-4ba6-a160-6278ff2a5ffa None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:11.613024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157dc2-a8ed-40a8-9cb0-65583726d3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:11.614015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157dc2-a8ed-40a8-9cb0-65583726d3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:11.614296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157dc2-a8ed-40a8-9cb0-65583726d3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:11.614568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157dc2-a8ed-40a8-9cb0-65583726d3b9 None admin] PATH_INFO: `/v3/users/da74b74d3f644dbdbb59e8c1f3f6b754` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:11.629193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96157dc2-a8ed-40a8-9cb0-65583726d3b9 None admin] RBAC: Authorizing `identity:get_user(user_id=da74b74d3f644dbdbb59e8c1f3f6b754)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:11.630575 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96157dc2-a8ed-40a8-9cb0-65583726d3b9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:11.632457 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 115/218] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:11 2022] GET /identity/v3/users/da74b74d3f644dbdbb59e8c1f3f6b754 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:11.638210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d75389-0871-4376-b18b-a55c76a7194e None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:11.638380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58528a02-0d24-49de-ba50-316a53c7804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:11.638512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d75389-0871-4376-b18b-a55c76a7194e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:11.638779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d75389-0871-4376-b18b-a55c76a7194e None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:11.638894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58528a02-0d24-49de-ba50-316a53c7804f None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:11.639172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58528a02-0d24-49de-ba50-316a53c7804f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:11.639444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58528a02-0d24-49de-ba50-316a53c7804f None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:11.640021 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 116/219] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:11.640151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58528a02-0d24-49de-ba50-316a53c7804f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:11.640706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d75389-0871-4376-b18b-a55c76a7194e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:11.641547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58528a02-0d24-49de-ba50-316a53c7804f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:11.663425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 104/220] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:56:11 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:56:11.664805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58528a02-0d24-49de-ba50-316a53c7804f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:11.677055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:11.760935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d75389-0871-4376-b18b-a55c76a7194e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:11.779390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:11.791159 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58528a02-0d24-49de-ba50-316a53c7804f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:11.803623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5e14d-1262-4c4b-87cb-de85d9f3f1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:11.804348 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5e14d-1262-4c4b-87cb-de85d9f3f1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:11.804629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5e14d-1262-4c4b-87cb-de85d9f3f1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:11.804899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5e14d-1262-4c4b-87cb-de85d9f3f1d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:11.816914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5e14d-1262-4c4b-87cb-de85d9f3f1d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7fe5e14d-1262-4c4b-87cb-de85d9f3f1d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:11.821775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:11.822642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:11.823434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:11.823434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:11.823434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:11.823434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:11.823434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:11.823434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:11.823434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:11.823434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:11.823434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:11.823434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:11.823434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:11.823434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:11.823434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 117/221] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:56:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:11.824131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ada05-2160-42e1-88b6-4ba2729d45cb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:11.824313 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ada05-2160-42e1-88b6-4ba2729d45cb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:11.825123 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ada05-2160-42e1-88b6-4ba2729d45cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:11.838090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d0e9d-cb46-499e-a8ad-730cae01a3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:11.839155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d0e9d-cb46-499e-a8ad-730cae01a3ed None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:11.841199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d0e9d-cb46-499e-a8ad-730cae01a3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:11.841199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d0e9d-cb46-499e-a8ad-730cae01a3ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:11.847936 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-553ada05-2160-42e1-88b6-4ba2729d45cb None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:11.849584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-553ada05-2160-42e1-88b6-4ba2729d45cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:11.931771 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d0e9d-cb46-499e-a8ad-730cae01a3ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:11.931940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 118/222] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:11.932790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ada05-2160-42e1-88b6-4ba2729d45cb None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:11.934443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d0e9d-cb46-499e-a8ad-730cae01a3ed None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:11.938838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:12.059681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ada05-2160-42e1-88b6-4ba2729d45cb None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:12.064102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:12.090420 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 105/223] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:12.096649 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d0e9d-cb46-499e-a8ad-730cae01a3ed None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:12.103226 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69950944-ea1b-4b7b-87cb-793eb16b196f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:12.104082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69950944-ea1b-4b7b-87cb-793eb16b196f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:12.104506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69950944-ea1b-4b7b-87cb-793eb16b196f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:12.104998 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69950944-ea1b-4b7b-87cb-793eb16b196f None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:12.105885 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69950944-ea1b-4b7b-87cb-793eb16b196f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:12.106384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69950944-ea1b-4b7b-87cb-793eb16b196f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:12.110482 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69950944-ea1b-4b7b-87cb-793eb16b196f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:12.119581 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 119/224] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:12.125780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69950944-ea1b-4b7b-87cb-793eb16b196f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:12.242021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d0e9d-cb46-499e-a8ad-730cae01a3ed None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:12.249280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69950944-ea1b-4b7b-87cb-793eb16b196f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:12.272346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:12.285112 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa228f8-2a4a-4557-abac-168ae7e96274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:12.285806 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa228f8-2a4a-4557-abac-168ae7e96274 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:12.286084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa228f8-2a4a-4557-abac-168ae7e96274 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:12.286357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa228f8-2a4a-4557-abac-168ae7e96274 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:12.288089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa228f8-2a4a-4557-abac-168ae7e96274 None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:12.290370 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa228f8-2a4a-4557-abac-168ae7e96274 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:12.292641 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 106/225] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:12 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:12.293488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa228f8-2a4a-4557-abac-168ae7e96274 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:12.295084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c049dd9-329b-459d-9466-8f2b534a2396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:12.296008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049dd9-329b-459d-9466-8f2b534a2396 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:12.296502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049dd9-329b-459d-9466-8f2b534a2396 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:12.296973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049dd9-329b-459d-9466-8f2b534a2396 None admin] PATH_INFO: `/v3/users/6d4c913c000e4d8692478de0e7001453` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:12.298450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c049dd9-329b-459d-9466-8f2b534a2396 None admin] RBAC: Authorizing `identity:get_user(user_id=6d4c913c000e4d8692478de0e7001453)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:12.300156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c049dd9-329b-459d-9466-8f2b534a2396 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:12.302059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 120/226] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:12 2022] GET /identity/v3/users/6d4c913c000e4d8692478de0e7001453 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:12.308305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c049dd9-329b-459d-9466-8f2b534a2396 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:12.343523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:12.421906 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c049dd9-329b-459d-9466-8f2b534a2396 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:12.425064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa228f8-2a4a-4557-abac-168ae7e96274 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:12.458471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f011f-d6ad-49a2-9f6b-5db36fe26822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:12.459075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f011f-d6ad-49a2-9f6b-5db36fe26822 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:12.459612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f011f-d6ad-49a2-9f6b-5db36fe26822 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:12.459909 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f011f-d6ad-49a2-9f6b-5db36fe26822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:12.460828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f011f-d6ad-49a2-9f6b-5db36fe26822 None admin] RBAC: Adding query filter params (role.id=b0fa1b252ab74641b309e4a3d6aacc68, scope.project.id=01a8779a6dd0442da92e2069510aded8, user.id=da74b74d3f644dbdbb59e8c1f3f6b754) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:12.461135 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f011f-d6ad-49a2-9f6b-5db36fe26822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:12.462574 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f011f-d6ad-49a2-9f6b-5db36fe26822 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:12.466411 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8c469-b144-465d-a65a-430fe3c4b21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:12.467836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8c469-b144-465d-a65a-430fe3c4b21d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:12.468144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8c469-b144-465d-a65a-430fe3c4b21d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:12.468419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8c469-b144-465d-a65a-430fe3c4b21d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:12.468959 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 121/227] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:12 2022] GET /identity/v3/role_assignments?user.id=da74b74d3f644dbdbb59e8c1f3f6b754&scope.project.id=01a8779a6dd0442da92e2069510aded8&role.id=b0fa1b252ab74641b309e4a3d6aacc68 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:12.469757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f011f-d6ad-49a2-9f6b-5db36fe26822 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:12.483293 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8c469-b144-465d-a65a-430fe3c4b21d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-17f8c469-b144-465d-a65a-430fe3c4b21d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:12.491512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:12.492377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:12.492377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:12.492377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:12.492377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:12.492377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:12.492377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:12.492377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:12.492377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:12.492377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:12.492377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:12.492377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:56:12.492377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:12.496050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 107/228] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:56:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:12.499136 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8c469-b144-465d-a65a-430fe3c4b21d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:12.541815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:12.628973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8c469-b144-465d-a65a-430fe3c4b21d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:12.659966 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:12.671263 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f4a66-de80-4770-9c37-aadcf8bdc35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:12.671881 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f4a66-de80-4770-9c37-aadcf8bdc35e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:12.672184 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f4a66-de80-4770-9c37-aadcf8bdc35e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:12.672450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f4a66-de80-4770-9c37-aadcf8bdc35e None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:12.673125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f4a66-de80-4770-9c37-aadcf8bdc35e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:12.673422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f4a66-de80-4770-9c37-aadcf8bdc35e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:12.674805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f4a66-de80-4770-9c37-aadcf8bdc35e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:12.678204 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f011f-d6ad-49a2-9f6b-5db36fe26822 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:12.684035 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 108/229] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:12.691022 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f4a66-de80-4770-9c37-aadcf8bdc35e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:12.780976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546ffdb-322f-4282-bb11-c940956c0d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:12.781543 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546ffdb-322f-4282-bb11-c940956c0d41 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:12.781821 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546ffdb-322f-4282-bb11-c940956c0d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:12.782090 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546ffdb-322f-4282-bb11-c940956c0d41 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:12.783251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546ffdb-322f-4282-bb11-c940956c0d41 None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:12.784724 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546ffdb-322f-4282-bb11-c940956c0d41 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:12.786665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 122/230] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:12 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:12.792216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546ffdb-322f-4282-bb11-c940956c0d41 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:12.800320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:12.808253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f4a66-de80-4770-9c37-aadcf8bdc35e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:12.880697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed9a2d-f36b-4521-9a77-cbcc31427b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:12.882419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9a2d-f36b-4521-9a77-cbcc31427b47 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:12.882886 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9a2d-f36b-4521-9a77-cbcc31427b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:12.883346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9a2d-f36b-4521-9a77-cbcc31427b47 None admin] PATH_INFO: `/v3/users/6d4c913c000e4d8692478de0e7001453` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:12.884864 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed9a2d-f36b-4521-9a77-cbcc31427b47 None admin] RBAC: Authorizing `identity:get_user(user_id=6d4c913c000e4d8692478de0e7001453)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:12.886518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed9a2d-f36b-4521-9a77-cbcc31427b47 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:12.889274 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 109/231] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:12 2022] GET /identity/v3/users/6d4c913c000e4d8692478de0e7001453 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:12.896194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed9a2d-f36b-4521-9a77-cbcc31427b47 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:12.946220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546ffdb-322f-4282-bb11-c940956c0d41 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:12.998711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cdfda-edd0-4b6c-b4bc-ac3f09e7bbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:12.999433 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cdfda-edd0-4b6c-b4bc-ac3f09e7bbdd None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:12.999709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cdfda-edd0-4b6c-b4bc-ac3f09e7bbdd None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:12.999990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cdfda-edd0-4b6c-b4bc-ac3f09e7bbdd None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8/users/6d4c913c000e4d8692478de0e7001453/roles/1201453b538f4257a1dc8723d67c0cdd` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:13.002508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cdfda-edd0-4b6c-b4bc-ac3f09e7bbdd None admin] RBAC: Authorizing `identity:create_grant(project_id=01a8779a6dd0442da92e2069510aded8, user_id=6d4c913c000e4d8692478de0e7001453, role_id=1201453b538f4257a1dc8723d67c0cdd)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:13.004034 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cdfda-edd0-4b6c-b4bc-ac3f09e7bbdd None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:13.028480 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 123/232] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:56:12 2022] PUT /identity/v3/projects/01a8779a6dd0442da92e2069510aded8/users/6d4c913c000e4d8692478de0e7001453/roles/1201453b538f4257a1dc8723d67c0cdd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:13.078342 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed9a2d-f36b-4521-9a77-cbcc31427b47 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:13.123771 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2f057-a87f-4908-a961-edf57ef179ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:13.124449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2f057-a87f-4908-a961-edf57ef179ff None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:13.124723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2f057-a87f-4908-a961-edf57ef179ff None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:13.124991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2f057-a87f-4908-a961-edf57ef179ff None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:13.128786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2f057-a87f-4908-a961-edf57ef179ff None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:13.130414 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2f057-a87f-4908-a961-edf57ef179ff None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:13.132757 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 110/233] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:12 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:13.138688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cdfda-edd0-4b6c-b4bc-ac3f09e7bbdd None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:13.170569 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:13.271660 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cdfda-edd0-4b6c-b4bc-ac3f09e7bbdd None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:13.312152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cd761-74e7-45bb-9fde-3849cd8fd512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:13.312829 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd761-74e7-45bb-9fde-3849cd8fd512 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:13.313102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd761-74e7-45bb-9fde-3849cd8fd512 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:13.313431 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd761-74e7-45bb-9fde-3849cd8fd512 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8/users/6d4c913c000e4d8692478de0e7001453/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:13.315352 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cd761-74e7-45bb-9fde-3849cd8fd512 None admin] RBAC: Authorizing `identity:create_grant(project_id=01a8779a6dd0442da92e2069510aded8, user_id=6d4c913c000e4d8692478de0e7001453, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:13.316804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cd761-74e7-45bb-9fde-3849cd8fd512 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:13.334326 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 124/234] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:56:13 2022] PUT /identity/v3/projects/01a8779a6dd0442da92e2069510aded8/users/6d4c913c000e4d8692478de0e7001453/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:14.168424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c21984-ddcc-4b8c-b579-935675c96c00 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:14.169017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c21984-ddcc-4b8c-b579-935675c96c00 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:14.169314 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c21984-ddcc-4b8c-b579-935675c96c00 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:14.171358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 111/235] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:14.176679 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b54ee0-b2f7-4d15-b791-3ce694a8b9ca None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:14.176960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b54ee0-b2f7-4d15-b791-3ce694a8b9ca None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:14.177227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b54ee0-b2f7-4d15-b791-3ce694a8b9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:14.202106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-75b54ee0-b2f7-4d15-b791-3ce694a8b9ca None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:14.203281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-75b54ee0-b2f7-4d15-b791-3ce694a8b9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:14.286251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 125/236] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:14.443820 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f019c-b94d-4098-873c-2eb953c530a6 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:14.444159 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f019c-b94d-4098-873c-2eb953c530a6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:14.444394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f019c-b94d-4098-873c-2eb953c530a6 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:14.446119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 112/237] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:14.452132 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b024801-9d42-4dc0-89c3-8a0cd483550b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:14.452404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b024801-9d42-4dc0-89c3-8a0cd483550b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:14.452676 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b024801-9d42-4dc0-89c3-8a0cd483550b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:14.475743 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2b024801-9d42-4dc0-89c3-8a0cd483550b None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:14.476961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2b024801-9d42-4dc0-89c3-8a0cd483550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:14.488747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:14.566556 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 126/238] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:14.615070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed54bda-1f27-405e-99d4-9fa99a773da8 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:14.615345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed54bda-1f27-405e-99d4-9fa99a773da8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:14.615616 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed54bda-1f27-405e-99d4-9fa99a773da8 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:14.616999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 113/239] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:14.622130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed647e35-e661-4e20-a1d5-3f6c1a656580 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:14.622418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed647e35-e661-4e20-a1d5-3f6c1a656580 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:14.622725 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed647e35-e661-4e20-a1d5-3f6c1a656580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:14.645935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ed647e35-e661-4e20-a1d5-3f6c1a656580 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:14.647115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ed647e35-e661-4e20-a1d5-3f6c1a656580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:14.677253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed54bda-1f27-405e-99d4-9fa99a773da8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:14.734060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:14.774513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 127/240] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:14.837857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed54bda-1f27-405e-99d4-9fa99a773da8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:14.856489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed647e35-e661-4e20-a1d5-3f6c1a656580 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:14.879125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103de1ce-a0d2-49a7-af2e-c5c4e8eab98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:14.879806 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de1ce-a0d2-49a7-af2e-c5c4e8eab98c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:14.880108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de1ce-a0d2-49a7-af2e-c5c4e8eab98c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:14.880381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de1ce-a0d2-49a7-af2e-c5c4e8eab98c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:14.893489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103de1ce-a0d2-49a7-af2e-c5c4e8eab98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-103de1ce-a0d2-49a7-af2e-c5c4e8eab98c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:14.899224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:14.900108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:14.900902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:14.900902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:14.900902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:14.900902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:14.900902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:14.900902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:14.900902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:14.900902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:14.900902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:14.900902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:14.900902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:14.900902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:14.900902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 114/241] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:56:14.906444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103de1ce-a0d2-49a7-af2e-c5c4e8eab98c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:15.011071 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:15.022239 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103de1ce-a0d2-49a7-af2e-c5c4e8eab98c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:15.057410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916e683-7d90-4523-b470-48bdab79543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:15.058017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916e683-7d90-4523-b470-48bdab79543e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:15.058288 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916e683-7d90-4523-b470-48bdab79543e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:15.058553 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916e683-7d90-4523-b470-48bdab79543e None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:15.059222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916e683-7d90-4523-b470-48bdab79543e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:15.059516 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916e683-7d90-4523-b470-48bdab79543e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:15.061007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916e683-7d90-4523-b470-48bdab79543e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:15.069862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 115/242] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:15.075168 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916e683-7d90-4523-b470-48bdab79543e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:15.104301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:15.130205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed647e35-e661-4e20-a1d5-3f6c1a656580 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:15.197347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d6177-098b-41cf-b64f-6ea7dab82309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:15.198036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d6177-098b-41cf-b64f-6ea7dab82309 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:15.198310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d6177-098b-41cf-b64f-6ea7dab82309 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:15.198573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d6177-098b-41cf-b64f-6ea7dab82309 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:15.201151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d6177-098b-41cf-b64f-6ea7dab82309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:15.203432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d6177-098b-41cf-b64f-6ea7dab82309 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:15.204569 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916e683-7d90-4523-b470-48bdab79543e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:15.205300 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 128/243] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:15.206292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d6177-098b-41cf-b64f-6ea7dab82309 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:15.252415 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d312c9-f305-4e8d-a259-811fa50e8437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:15.253048 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d312c9-f305-4e8d-a259-811fa50e8437 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:15.253324 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d312c9-f305-4e8d-a259-811fa50e8437 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:15.253591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d312c9-f305-4e8d-a259-811fa50e8437 None admin] PATH_INFO: `/v3/users/31522de60c324a4cb22915cee70ac47b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:15.272445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d312c9-f305-4e8d-a259-811fa50e8437 None admin] RBAC: Authorizing `identity:get_user(user_id=31522de60c324a4cb22915cee70ac47b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:15.274450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d312c9-f305-4e8d-a259-811fa50e8437 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:15.276727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 116/244] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:15 2022] GET /identity/v3/users/31522de60c324a4cb22915cee70ac47b => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:15.277488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d312c9-f305-4e8d-a259-811fa50e8437 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:15.296193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:15.330332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d6177-098b-41cf-b64f-6ea7dab82309 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:15.369625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33976be1-70da-463b-840c-50138a204abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:15.370260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33976be1-70da-463b-840c-50138a204abc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:15.370540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33976be1-70da-463b-840c-50138a204abc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:15.370804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33976be1-70da-463b-840c-50138a204abc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:15.382558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33976be1-70da-463b-840c-50138a204abc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-33976be1-70da-463b-840c-50138a204abc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:15.387478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:15.389168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:15.390013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:15.390013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:15.390013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:15.390013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:15.390013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:15.390013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:15.390013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:15.390013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:15.390013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:15.390013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:15.390013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:15.390013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:15.390013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 129/245] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:15.390013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33976be1-70da-463b-840c-50138a204abc None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:15.394750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d312c9-f305-4e8d-a259-811fa50e8437 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:15.400263 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:15.432810 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6924f-ef32-4634-9b81-a98b4a3631fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:15.433414 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6924f-ef32-4634-9b81-a98b4a3631fb None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:15.433687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6924f-ef32-4634-9b81-a98b4a3631fb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:15.433955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6924f-ef32-4634-9b81-a98b4a3631fb None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:15.434602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6924f-ef32-4634-9b81-a98b4a3631fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:15.436110 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6924f-ef32-4634-9b81-a98b4a3631fb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:15.466182 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 117/246] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:56:15 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:15.466182 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd151c-46eb-4fb8-822a-54f1392beb1b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:15.466182 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd151c-46eb-4fb8-822a-54f1392beb1b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:15.466182 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd151c-46eb-4fb8-822a-54f1392beb1b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:15.467527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 118/247] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:15.472068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd151c-46eb-4fb8-822a-54f1392beb1b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:15.515934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33976be1-70da-463b-840c-50138a204abc None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:15.545585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:15.556978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a2285-7ae8-4635-9bf3-3cae930c8c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:15.557606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a2285-7ae8-4635-9bf3-3cae930c8c85 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:15.557884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a2285-7ae8-4635-9bf3-3cae930c8c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:15.558153 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a2285-7ae8-4635-9bf3-3cae930c8c85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:15.587300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd151c-46eb-4fb8-822a-54f1392beb1b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:15.623861 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe2c7c-800b-467b-80b6-6600c410d459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:15.624437 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe2c7c-800b-467b-80b6-6600c410d459 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:15.624861 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe2c7c-800b-467b-80b6-6600c410d459 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:15.625174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe2c7c-800b-467b-80b6-6600c410d459 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:15.625861 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe2c7c-800b-467b-80b6-6600c410d459 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:15.626168 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe2c7c-800b-467b-80b6-6600c410d459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:15.627574 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe2c7c-800b-467b-80b6-6600c410d459 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:15.640416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 119/248] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:15.641787 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfca32-93a1-4109-ae31-20d0be18c6eb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:15.641896 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a2285-7ae8-4635-9bf3-3cae930c8c85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:15.642084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfca32-93a1-4109-ae31-20d0be18c6eb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:15.642340 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfca32-93a1-4109-ae31-20d0be18c6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:15.643391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a2285-7ae8-4635-9bf3-3cae930c8c85 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:15.646522 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:15.663934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-79bfca32-93a1-4109-ae31-20d0be18c6eb None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:15.665420 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-79bfca32-93a1-4109-ae31-20d0be18c6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:15.752569 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 120/249] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:15.759978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfca32-93a1-4109-ae31-20d0be18c6eb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:15.773103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 130/250] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:15.779289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a2285-7ae8-4635-9bf3-3cae930c8c85 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:15.852372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:15.896070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfca32-93a1-4109-ae31-20d0be18c6eb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:15.912693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a2285-7ae8-4635-9bf3-3cae930c8c85 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:15.917990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:15.945103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d91420-d1f0-4477-9835-93a1ad2eb86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:15.945758 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d91420-d1f0-4477-9835-93a1ad2eb86c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:15.946037 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d91420-d1f0-4477-9835-93a1ad2eb86c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:15.946700 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d91420-d1f0-4477-9835-93a1ad2eb86c None admin] PATH_INFO: `/v3/users/da74b74d3f644dbdbb59e8c1f3f6b754` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:15.948667 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d91420-d1f0-4477-9835-93a1ad2eb86c None admin] RBAC: Authorizing `identity:get_user(user_id=da74b74d3f644dbdbb59e8c1f3f6b754)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:15.950127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d91420-d1f0-4477-9835-93a1ad2eb86c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:15.952433 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 121/251] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:15 2022] GET /identity/v3/users/da74b74d3f644dbdbb59e8c1f3f6b754 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:15.954124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb09a0-beca-4988-b955-271adbea9d5d None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:15.954461 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb09a0-beca-4988-b955-271adbea9d5d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:15.954740 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb09a0-beca-4988-b955-271adbea9d5d None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:15.956109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 122/252] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:15.963286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb09a0-beca-4988-b955-271adbea9d5d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:15.968318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757d8f3-8869-4c14-9a1e-8c05ccdc9b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:15.969619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757d8f3-8869-4c14-9a1e-8c05ccdc9b08 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:15.969619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757d8f3-8869-4c14-9a1e-8c05ccdc9b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:15.969619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757d8f3-8869-4c14-9a1e-8c05ccdc9b08 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:15.970712 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757d8f3-8869-4c14-9a1e-8c05ccdc9b08 None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:15.972318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757d8f3-8869-4c14-9a1e-8c05ccdc9b08 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:15.974587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 131/253] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:15 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:15.975509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa557ba9-c4d7-4b8b-a679-e145fd4bb001 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:15.975796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa557ba9-c4d7-4b8b-a679-e145fd4bb001 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:15.977061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa557ba9-c4d7-4b8b-a679-e145fd4bb001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:16.007578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fa557ba9-c4d7-4b8b-a679-e145fd4bb001 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:16.008841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fa557ba9-c4d7-4b8b-a679-e145fd4bb001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:16.094916 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 132/254] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:16.097021 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa557ba9-c4d7-4b8b-a679-e145fd4bb001 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:16.115972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb09a0-beca-4988-b955-271adbea9d5d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:16.148181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:16.152206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c1e7c-6718-403a-8b93-aa26e1497752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:16.152842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c1e7c-6718-403a-8b93-aa26e1497752 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:16.153124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c1e7c-6718-403a-8b93-aa26e1497752 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:16.153570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c1e7c-6718-403a-8b93-aa26e1497752 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:16.154517 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c1e7c-6718-403a-8b93-aa26e1497752 None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:16.157892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c1e7c-6718-403a-8b93-aa26e1497752 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:16.157892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 123/255] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:15 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:16.158557 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c1e7c-6718-403a-8b93-aa26e1497752 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:16.282242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c1e7c-6718-403a-8b93-aa26e1497752 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:16.286020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa557ba9-c4d7-4b8b-a679-e145fd4bb001 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:16.295971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:16.319854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8bd17-fa99-43af-8cc4-ac3c5f462c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:16.320538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8bd17-fa99-43af-8cc4-ac3c5f462c9f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:16.320905 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8bd17-fa99-43af-8cc4-ac3c5f462c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:16.321126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8bd17-fa99-43af-8cc4-ac3c5f462c9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:16.331740 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8bd17-fa99-43af-8cc4-ac3c5f462c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a5e8bd17-fa99-43af-8cc4-ac3c5f462c9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:16.336774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:16.337675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:16.343823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:16.343823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:16.343823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:16.343823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:16.343823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:16.343823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:16.343823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:16.343823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:16.343823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:16.343823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:16.343823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:16.343823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:16.343823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 124/256] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:56:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:16.343823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8bd17-fa99-43af-8cc4-ac3c5f462c9f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:16.367093 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df73d6a-2b23-484f-b4d9-6a3855a0b655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:16.368382 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df73d6a-2b23-484f-b4d9-6a3855a0b655 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:16.369454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df73d6a-2b23-484f-b4d9-6a3855a0b655 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:16.369775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df73d6a-2b23-484f-b4d9-6a3855a0b655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:16.370530 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df73d6a-2b23-484f-b4d9-6a3855a0b655 None admin] RBAC: Adding query filter params (role.id=5197d75b3317432da8f4d292f4953baa, scope.project.id=01a8779a6dd0442da92e2069510aded8, user.id=31522de60c324a4cb22915cee70ac47b) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:16.370832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df73d6a-2b23-484f-b4d9-6a3855a0b655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:16.375265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df73d6a-2b23-484f-b4d9-6a3855a0b655 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:16.384534 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 133/257] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:16 2022] GET /identity/v3/role_assignments?user.id=31522de60c324a4cb22915cee70ac47b&scope.project.id=01a8779a6dd0442da92e2069510aded8&role.id=5197d75b3317432da8f4d292f4953baa => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:16.385248 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df73d6a-2b23-484f-b4d9-6a3855a0b655 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:16.422484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:16.526257 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8bd17-fa99-43af-8cc4-ac3c5f462c9f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:16.561754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df73d6a-2b23-484f-b4d9-6a3855a0b655 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:16.580910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3082a-cd41-4d59-93f6-7fba8072a9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:16.581579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3082a-cd41-4d59-93f6-7fba8072a9b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:16.581854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3082a-cd41-4d59-93f6-7fba8072a9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:16.582123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3082a-cd41-4d59-93f6-7fba8072a9b9 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8/users/da74b74d3f644dbdbb59e8c1f3f6b754/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:16.584913 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3082a-cd41-4d59-93f6-7fba8072a9b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=01a8779a6dd0442da92e2069510aded8, user_id=da74b74d3f644dbdbb59e8c1f3f6b754, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:16.586470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3082a-cd41-4d59-93f6-7fba8072a9b9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:16.601028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ff00e-d9f7-41a9-99de-ffe61ffc7add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:16.601643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff00e-d9f7-41a9-99de-ffe61ffc7add None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:16.601973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff00e-d9f7-41a9-99de-ffe61ffc7add None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:16.602247 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff00e-d9f7-41a9-99de-ffe61ffc7add None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:16.602914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ff00e-d9f7-41a9-99de-ffe61ffc7add None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:16.603214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ff00e-d9f7-41a9-99de-ffe61ffc7add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:16.605556 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ff00e-d9f7-41a9-99de-ffe61ffc7add None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:16.609310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 125/258] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:56:16 2022] PUT /identity/v3/projects/01a8779a6dd0442da92e2069510aded8/users/da74b74d3f644dbdbb59e8c1f3f6b754/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:16.610077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3082a-cd41-4d59-93f6-7fba8072a9b9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:16.628039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 134/259] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:16.635821 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ff00e-d9f7-41a9-99de-ffe61ffc7add None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:16.712751 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:16.836571 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3082a-cd41-4d59-93f6-7fba8072a9b9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:16.864463 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:16.866275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ff00e-d9f7-41a9-99de-ffe61ffc7add None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:16.909666 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab141f5-7675-48cf-89eb-8e8e734aff0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:16.910326 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab141f5-7675-48cf-89eb-8e8e734aff0a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:16.910596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab141f5-7675-48cf-89eb-8e8e734aff0a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:16.910870 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab141f5-7675-48cf-89eb-8e8e734aff0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:16.944592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab141f5-7675-48cf-89eb-8e8e734aff0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:16.944976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a9bd1-b538-4551-a6c8-01e52539d889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:16.945855 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a9bd1-b538-4551-a6c8-01e52539d889 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:16.946495 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a9bd1-b538-4551-a6c8-01e52539d889 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:16.946958 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a9bd1-b538-4551-a6c8-01e52539d889 None admin] PATH_INFO: `/v3/users/6d4c913c000e4d8692478de0e7001453` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:16.948415 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a9bd1-b538-4551-a6c8-01e52539d889 None admin] RBAC: Authorizing `identity:get_user(user_id=6d4c913c000e4d8692478de0e7001453)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:16.950113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a9bd1-b538-4551-a6c8-01e52539d889 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-cab141f5-7675-48cf-89eb-8e8e734aff0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:16.950302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:16.951754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:16.952581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:16.952581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:16.952581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:16.952581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:16.952581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:16.952581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:16.952581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:16.952581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:16.952581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:16.952581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:16.952581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:56:16.952581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:16.952581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 126/260] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:56:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:16.960747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 135/261] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:16 2022] GET /identity/v3/users/6d4c913c000e4d8692478de0e7001453 => generated 283 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:16.964055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab141f5-7675-48cf-89eb-8e8e734aff0a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:16.967534 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a9bd1-b538-4551-a6c8-01e52539d889 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:17.102329 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:17.110185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a9bd1-b538-4551-a6c8-01e52539d889 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:17.140003 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab141f5-7675-48cf-89eb-8e8e734aff0a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:17.162199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77cd15-9f9e-491b-b5c1-32d444cff580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:17.163175 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77cd15-9f9e-491b-b5c1-32d444cff580 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:17.163623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77cd15-9f9e-491b-b5c1-32d444cff580 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:17.164090 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77cd15-9f9e-491b-b5c1-32d444cff580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:17.197259 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c139d-8827-4a13-b1a8-cafc3aa08807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:17.197880 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c139d-8827-4a13-b1a8-cafc3aa08807 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:17.198157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c139d-8827-4a13-b1a8-cafc3aa08807 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:17.198427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c139d-8827-4a13-b1a8-cafc3aa08807 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:17.199097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c139d-8827-4a13-b1a8-cafc3aa08807 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:17.199392 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c139d-8827-4a13-b1a8-cafc3aa08807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:17.200850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c139d-8827-4a13-b1a8-cafc3aa08807 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:17.219134 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 127/262] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:17.225559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c139d-8827-4a13-b1a8-cafc3aa08807 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:17.311980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:17.359977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77cd15-9f9e-491b-b5c1-32d444cff580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:17.359977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77cd15-9f9e-491b-b5c1-32d444cff580 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:17.428637 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c139d-8827-4a13-b1a8-cafc3aa08807 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:17.494246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609c96a-30e7-41f9-9045-4f94413a966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:17.494790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609c96a-30e7-41f9-9045-4f94413a966a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:17.495074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609c96a-30e7-41f9-9045-4f94413a966a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:17.495453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609c96a-30e7-41f9-9045-4f94413a966a None admin] PATH_INFO: `/v3/users/6d4c913c000e4d8692478de0e7001453` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:17.498762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609c96a-30e7-41f9-9045-4f94413a966a None admin] RBAC: Authorizing `identity:get_user(user_id=6d4c913c000e4d8692478de0e7001453)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:17.500312 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609c96a-30e7-41f9-9045-4f94413a966a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:17.502150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 128/263] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:17 2022] GET /identity/v3/users/6d4c913c000e4d8692478de0e7001453 => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:17.509654 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609c96a-30e7-41f9-9045-4f94413a966a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:17.566054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:17.579194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 136/264] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 04:56:17.584858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77cd15-9f9e-491b-b5c1-32d444cff580 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:17.739767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77cd15-9f9e-491b-b5c1-32d444cff580 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:17.743058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609c96a-30e7-41f9-9045-4f94413a966a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:17.748036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:17.805588 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50cc08-020d-4c80-aff0-dd06f755e2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:17.806627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50cc08-020d-4c80-aff0-dd06f755e2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:17.807077 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50cc08-020d-4c80-aff0-dd06f755e2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:17.807589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50cc08-020d-4c80-aff0-dd06f755e2d2 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:17.808033 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b16f4d-47d7-4a78-b4ae-1856548f6478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:17.808725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b16f4d-47d7-4a78-b4ae-1856548f6478 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:17.809072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b16f4d-47d7-4a78-b4ae-1856548f6478 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:17.809412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b16f4d-47d7-4a78-b4ae-1856548f6478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:17.809718 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50cc08-020d-4c80-aff0-dd06f755e2d2 None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:17.811858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50cc08-020d-4c80-aff0-dd06f755e2d2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:17.813739 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 137/265] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:17 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:17.820104 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50cc08-020d-4c80-aff0-dd06f755e2d2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:17.896030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b16f4d-47d7-4a78-b4ae-1856548f6478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:17.897567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b16f4d-47d7-4a78-b4ae-1856548f6478 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:17.937225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:18.001409 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 129/266] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:18.009071 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b16f4d-47d7-4a78-b4ae-1856548f6478 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:18.012251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:18.062166 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50cc08-020d-4c80-aff0-dd06f755e2d2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:18.151431 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b16f4d-47d7-4a78-b4ae-1856548f6478 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:18.186740 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cdf58-9f8e-4f34-a4b5-f19fddfc7559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:18.187466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cdf58-9f8e-4f34-a4b5-f19fddfc7559 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:18.187856 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cdf58-9f8e-4f34-a4b5-f19fddfc7559 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:18.188157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cdf58-9f8e-4f34-a4b5-f19fddfc7559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:18.188879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972eeb0-2d97-49e9-94f3-9b624613d450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:18.188999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cdf58-9f8e-4f34-a4b5-f19fddfc7559 None admin] RBAC: Adding query filter params (role.id=1201453b538f4257a1dc8723d67c0cdd, scope.project.id=01a8779a6dd0442da92e2069510aded8, user.id=6d4c913c000e4d8692478de0e7001453) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:18.189180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cdf58-9f8e-4f34-a4b5-f19fddfc7559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:18.189506 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972eeb0-2d97-49e9-94f3-9b624613d450 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:18.189936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972eeb0-2d97-49e9-94f3-9b624613d450 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:18.190430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972eeb0-2d97-49e9-94f3-9b624613d450 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:18.190811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cdf58-9f8e-4f34-a4b5-f19fddfc7559 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:18.191874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972eeb0-2d97-49e9-94f3-9b624613d450 None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:18.193681 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972eeb0-2d97-49e9-94f3-9b624613d450 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:18.195828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 130/267] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:18 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:18.205344 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972eeb0-2d97-49e9-94f3-9b624613d450 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:18.212705 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 138/268] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:17 2022] GET /identity/v3/role_assignments?user.id=6d4c913c000e4d8692478de0e7001453&scope.project.id=01a8779a6dd0442da92e2069510aded8&role.id=1201453b538f4257a1dc8723d67c0cdd => generated 608 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:18.284001 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019d44c-bea2-4ff5-9d91-148ea28f0feb None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:18.284590 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019d44c-bea2-4ff5-9d91-148ea28f0feb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:18.285053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019d44c-bea2-4ff5-9d91-148ea28f0feb None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:18.286653 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 139/269] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:56:18.292420 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa1406-ce34-4d4e-8532-7f181da9aacf None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:18.292983 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa1406-ce34-4d4e-8532-7f181da9aacf None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:18.293546 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa1406-ce34-4d4e-8532-7f181da9aacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:18.311910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:18.315238 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a3fa1406-ce34-4d4e-8532-7f181da9aacf None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:18.316792 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a3fa1406-ce34-4d4e-8532-7f181da9aacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:18.382018 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972eeb0-2d97-49e9-94f3-9b624613d450 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:18.427598 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 140/270] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:56:18.448650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66381ff7-4634-4259-9f72-e7f26bb7d2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:18.449703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381ff7-4634-4259-9f72-e7f26bb7d2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:18.450188 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381ff7-4634-4259-9f72-e7f26bb7d2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:18.451201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381ff7-4634-4259-9f72-e7f26bb7d2c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:18.452197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66381ff7-4634-4259-9f72-e7f26bb7d2c2 None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=01a8779a6dd0442da92e2069510aded8, user.id=6d4c913c000e4d8692478de0e7001453) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:18.452754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66381ff7-4634-4259-9f72-e7f26bb7d2c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:18.454371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66381ff7-4634-4259-9f72-e7f26bb7d2c2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:18.461183 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 131/271] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:18 2022] GET /identity/v3/role_assignments?user.id=6d4c913c000e4d8692478de0e7001453&scope.project.id=01a8779a6dd0442da92e2069510aded8&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:18.681096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0fa10-9bfa-43c7-8bb8-4d9758ba7d45 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:18.682380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0fa10-9bfa-43c7-8bb8-4d9758ba7d45 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:18.682874 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0fa10-9bfa-43c7-8bb8-4d9758ba7d45 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:18.685342 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 141/272] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:18.690537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb5d35-f2d2-4872-84b9-9926d054acd7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:18.691092 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb5d35-f2d2-4872-84b9-9926d054acd7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:18.691678 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb5d35-f2d2-4872-84b9-9926d054acd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:18.713070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-42cb5d35-f2d2-4872-84b9-9926d054acd7 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:18.714542 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-42cb5d35-f2d2-4872-84b9-9926d054acd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:18.794992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 132/273] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:18.836316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0fa10-9bfa-43c7-8bb8-4d9758ba7d45 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:18.908257 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:18.956094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35b8b8-e156-4a69-b764-318b4e113498 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:18.956386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35b8b8-e156-4a69-b764-318b4e113498 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:18.956573 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35b8b8-e156-4a69-b764-318b4e113498 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:18.957995 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0fa10-9bfa-43c7-8bb8-4d9758ba7d45 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:18.958858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 133/274] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:18.964096 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceea0a1-4c5c-47c8-9058-e95b0cd37fc1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:18.964632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceea0a1-4c5c-47c8-9058-e95b0cd37fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:18.965099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceea0a1-4c5c-47c8-9058-e95b0cd37fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:18.997287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8ceea0a1-4c5c-47c8-9058-e95b0cd37fc1 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:18.999278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8ceea0a1-4c5c-47c8-9058-e95b0cd37fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:19.003751 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52630-302b-4253-b881-af3ff1bfc472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:19.004909 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52630-302b-4253-b881-af3ff1bfc472 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:19.005282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52630-302b-4253-b881-af3ff1bfc472 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:19.005558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52630-302b-4253-b881-af3ff1bfc472 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:19.007853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b52630-302b-4253-b881-af3ff1bfc472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:19.011622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b52630-302b-4253-b881-af3ff1bfc472 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:19.011622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 142/275] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:19.017233 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52630-302b-4253-b881-af3ff1bfc472 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:19.077776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:19.087914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 134/276] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:19.100989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceea0a1-4c5c-47c8-9058-e95b0cd37fc1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:19.150038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52630-302b-4253-b881-af3ff1bfc472 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:19.178193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:19.188139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea44286-f5fe-463b-8f48-fa8f26c4905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:19.188990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea44286-f5fe-463b-8f48-fa8f26c4905a None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:19.189414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea44286-f5fe-463b-8f48-fa8f26c4905a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:19.189827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea44286-f5fe-463b-8f48-fa8f26c4905a None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:19.190626 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea44286-f5fe-463b-8f48-fa8f26c4905a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:19.192313 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea44286-f5fe-463b-8f48-fa8f26c4905a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:19.208377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceea0a1-4c5c-47c8-9058-e95b0cd37fc1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:19.220277 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 143/277] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:56:19 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:19.253290 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a37b5e-86a8-4192-a26a-902d0392af2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:19.254185 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a37b5e-86a8-4192-a26a-902d0392af2c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:19.254751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a37b5e-86a8-4192-a26a-902d0392af2c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:19.255170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a37b5e-86a8-4192-a26a-902d0392af2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:19.268524 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a37b5e-86a8-4192-a26a-902d0392af2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-d1a37b5e-86a8-4192-a26a-902d0392af2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:19.273847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:19.275082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:19.276072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:19.276072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:19.276072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:19.276072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:19.276072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:19.276072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:19.276072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:19.276072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:19.276072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:19.276072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:19.276072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:19.276072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:19.279107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 135/278] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:19.285260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea44286-f5fe-463b-8f48-fa8f26c4905a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:19.390201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a37b5e-86a8-4192-a26a-902d0392af2c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:19.413304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea44286-f5fe-463b-8f48-fa8f26c4905a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:19.451564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e1579-8b62-445d-a46d-423df8763f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:19.452500 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e1579-8b62-445d-a46d-423df8763f28 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:19.452944 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e1579-8b62-445d-a46d-423df8763f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:19.453355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e1579-8b62-445d-a46d-423df8763f28 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:19.454341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e1579-8b62-445d-a46d-423df8763f28 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:19.454768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e1579-8b62-445d-a46d-423df8763f28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:19.457307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e1579-8b62-445d-a46d-423df8763f28 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:19.465519 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:19.465661 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 144/279] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:19.471811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e1579-8b62-445d-a46d-423df8763f28 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:19.511836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a37b5e-86a8-4192-a26a-902d0392af2c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:19.523467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:19.569601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a0b28-2637-4aa7-8227-9d5a012a5fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:19.570608 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a0b28-2637-4aa7-8227-9d5a012a5fbf None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:19.571050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a0b28-2637-4aa7-8227-9d5a012a5fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:19.571485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a0b28-2637-4aa7-8227-9d5a012a5fbf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:19.589025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a0b28-2637-4aa7-8227-9d5a012a5fbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-557a0b28-2637-4aa7-8227-9d5a012a5fbf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:19.594475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:19.595379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:19.596486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:19.596486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:19.596486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:19.596486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:19.596486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:19.596486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:19.596486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:19.596486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:19.596486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:19.596486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:19.596486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:19.596486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:19.596486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 136/280] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:19.599087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e1579-8b62-445d-a46d-423df8763f28 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:19.600978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e488602-3aa3-409c-b671-e86620e47c89 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:19.601253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e488602-3aa3-409c-b671-e86620e47c89 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:19.601525 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e488602-3aa3-409c-b671-e86620e47c89 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:19.602873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 137/281] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:19.604803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e488602-3aa3-409c-b671-e86620e47c89 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:19.649932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a43351-f342-413f-be19-86b62b8c14f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:19.650598 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a43351-f342-413f-be19-86b62b8c14f4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:19.650871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a43351-f342-413f-be19-86b62b8c14f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:19.651166 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a43351-f342-413f-be19-86b62b8c14f4 None admin] PATH_INFO: `/v3/users/6159596d938d4b03a31fa529479ed276` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:19.666575 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a43351-f342-413f-be19-86b62b8c14f4 None admin] RBAC: Authorizing `identity:get_user(user_id=6159596d938d4b03a31fa529479ed276)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:19.668100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a43351-f342-413f-be19-86b62b8c14f4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:19.669819 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 145/282] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:19 2022] GET /identity/v3/users/6159596d938d4b03a31fa529479ed276 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:19.670970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146c953-1f8f-413c-bdcb-6c56c9d922d5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:19.671256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146c953-1f8f-413c-bdcb-6c56c9d922d5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:19.671514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146c953-1f8f-413c-bdcb-6c56c9d922d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:19.691528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1146c953-1f8f-413c-bdcb-6c56c9d922d5 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:19.693501 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1146c953-1f8f-413c-bdcb-6c56c9d922d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:19.745419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e488602-3aa3-409c-b671-e86620e47c89 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:19.768347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:19.771751 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 146/283] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:19.773092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146c953-1f8f-413c-bdcb-6c56c9d922d5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:19.808567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad85482-baea-400e-a495-51549d4f52ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:19.809578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85482-baea-400e-a495-51549d4f52ca None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:19.810719 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85482-baea-400e-a495-51549d4f52ca None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:19.811187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85482-baea-400e-a495-51549d4f52ca None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:19.812993 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad85482-baea-400e-a495-51549d4f52ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:19.813537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad85482-baea-400e-a495-51549d4f52ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:19.815387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad85482-baea-400e-a495-51549d4f52ca None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:19.831276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 138/284] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:19.836676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad85482-baea-400e-a495-51549d4f52ca None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:19.838827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:19.955643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146c953-1f8f-413c-bdcb-6c56c9d922d5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:19.996968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0825b9-0212-4e4e-b449-12f9a83eb5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:19.997647 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0825b9-0212-4e4e-b449-12f9a83eb5db None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:19.997916 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0825b9-0212-4e4e-b449-12f9a83eb5db None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:19.998183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0825b9-0212-4e4e-b449-12f9a83eb5db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:19.998905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0825b9-0212-4e4e-b449-12f9a83eb5db None admin] RBAC: Adding query filter params (role.id=b0fa1b252ab74641b309e4a3d6aacc68, user.id=6159596d938d4b03a31fa529479ed276, scope.system=all) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:19.999205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0825b9-0212-4e4e-b449-12f9a83eb5db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:20.000727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0825b9-0212-4e4e-b449-12f9a83eb5db None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:20.006392 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 147/285] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Aug 30 04:56:19 2022] GET /identity/v3/role_assignments?user.id=6159596d938d4b03a31fa529479ed276&scope.system=all&role.id=b0fa1b252ab74641b309e4a3d6aacc68 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:20.058657 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad85482-baea-400e-a495-51549d4f52ca None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:20.086446 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0825b9-0212-4e4e-b449-12f9a83eb5db None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:20.107482 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c5452-8daf-4495-ab6a-2a5569ec0b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:20.108591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c5452-8daf-4495-ab6a-2a5569ec0b78 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:20.109097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c5452-8daf-4495-ab6a-2a5569ec0b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:20.109560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c5452-8daf-4495-ab6a-2a5569ec0b78 None admin] PATH_INFO: `/v3/users/31522de60c324a4cb22915cee70ac47b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:20.110983 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c5452-8daf-4495-ab6a-2a5569ec0b78 None admin] RBAC: Authorizing `identity:get_user(user_id=31522de60c324a4cb22915cee70ac47b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:20.112752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c5452-8daf-4495-ab6a-2a5569ec0b78 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:20.115058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 139/286] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:19 2022] GET /identity/v3/users/31522de60c324a4cb22915cee70ac47b => generated 297 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:20.120950 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c5452-8daf-4495-ab6a-2a5569ec0b78 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:20.210200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:20.270433 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:20.285096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0825b9-0212-4e4e-b449-12f9a83eb5db None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:20.309244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c5452-8daf-4495-ab6a-2a5569ec0b78 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:20.347427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cddcbf-df9e-4f14-b700-b652315c26a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:20.348488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cddcbf-df9e-4f14-b700-b652315c26a1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:20.349107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cddcbf-df9e-4f14-b700-b652315c26a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:20.349572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cddcbf-df9e-4f14-b700-b652315c26a1 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:20.350961 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cddcbf-df9e-4f14-b700-b652315c26a1 None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:20.352661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cddcbf-df9e-4f14-b700-b652315c26a1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:20.354526 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 140/287] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:20 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:20.364846 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cddcbf-df9e-4f14-b700-b652315c26a1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:20.376659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06682a4e-ffa5-412c-b681-44d23e627237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:20.377520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06682a4e-ffa5-412c-b681-44d23e627237 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:20.377629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06682a4e-ffa5-412c-b681-44d23e627237 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:20.377830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06682a4e-ffa5-412c-b681-44d23e627237 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:20.412939 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06682a4e-ffa5-412c-b681-44d23e627237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-06682a4e-ffa5-412c-b681-44d23e627237 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:20.417809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:20.418687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:20.420116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:20.420116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:20.420116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:20.420116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:20.420116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:20.420116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:20.420116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:20.420116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:20.420116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:20.420116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:20.420116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:20.420116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:20.420116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 148/288] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:56:20.428934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06682a4e-ffa5-412c-b681-44d23e627237 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:20.487246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cddcbf-df9e-4f14-b700-b652315c26a1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:20.504754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:20.527260 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4aca04-8d7f-41c7-b057-9784eac67869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:20.528317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aca04-8d7f-41c7-b057-9784eac67869 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:20.529322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aca04-8d7f-41c7-b057-9784eac67869 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:20.529785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aca04-8d7f-41c7-b057-9784eac67869 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8/users/31522de60c324a4cb22915cee70ac47b/roles/5197d75b3317432da8f4d292f4953baa` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:20.531936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4aca04-8d7f-41c7-b057-9784eac67869 None admin] RBAC: Authorizing `identity:create_grant(project_id=01a8779a6dd0442da92e2069510aded8, user_id=31522de60c324a4cb22915cee70ac47b, role_id=5197d75b3317432da8f4d292f4953baa)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:20.533768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4aca04-8d7f-41c7-b057-9784eac67869 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:20.548619 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 141/289] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:56:20 2022] PUT /identity/v3/projects/01a8779a6dd0442da92e2069510aded8/users/31522de60c324a4cb22915cee70ac47b/roles/5197d75b3317432da8f4d292f4953baa => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:20.626420 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06682a4e-ffa5-412c-b681-44d23e627237 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:20.667125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09a86b-1183-46dd-bffe-fbf45ab5442f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:20.667737 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09a86b-1183-46dd-bffe-fbf45ab5442f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:20.668045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09a86b-1183-46dd-bffe-fbf45ab5442f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:20.668316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09a86b-1183-46dd-bffe-fbf45ab5442f None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:20.669016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09a86b-1183-46dd-bffe-fbf45ab5442f None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:20.669314 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09a86b-1183-46dd-bffe-fbf45ab5442f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:20.670771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09a86b-1183-46dd-bffe-fbf45ab5442f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:20.680397 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 149/290] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:20.686097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4aca04-8d7f-41c7-b057-9784eac67869 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:20.821597 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4aca04-8d7f-41c7-b057-9784eac67869 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:20.860932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4eac4f-e304-465a-86fe-9235a97c4084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:20.861901 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4eac4f-e304-465a-86fe-9235a97c4084 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:20.862397 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4eac4f-e304-465a-86fe-9235a97c4084 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:20.862882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4eac4f-e304-465a-86fe-9235a97c4084 None admin] PATH_INFO: `/v3/users/da74b74d3f644dbdbb59e8c1f3f6b754` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:20.864258 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4eac4f-e304-465a-86fe-9235a97c4084 None admin] RBAC: Authorizing `identity:get_user(user_id=da74b74d3f644dbdbb59e8c1f3f6b754)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:20.865899 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4eac4f-e304-465a-86fe-9235a97c4084 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:20.868019 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 142/291] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:20 2022] GET /identity/v3/users/da74b74d3f644dbdbb59e8c1f3f6b754 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:20.874067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09a86b-1183-46dd-bffe-fbf45ab5442f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:20.921395 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:21.044509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09a86b-1183-46dd-bffe-fbf45ab5442f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:21.097604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66241cf3-3619-4a3e-837d-6754113a89c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:21.098135 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66241cf3-3619-4a3e-837d-6754113a89c7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:21.098407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66241cf3-3619-4a3e-837d-6754113a89c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:21.098672 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66241cf3-3619-4a3e-837d-6754113a89c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:21.170929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66241cf3-3619-4a3e-837d-6754113a89c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:21.172466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66241cf3-3619-4a3e-837d-6754113a89c7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:21.191049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:21.288361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 150/292] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:21.295018 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4eac4f-e304-465a-86fe-9235a97c4084 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:21.354606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:21.430012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4eac4f-e304-465a-86fe-9235a97c4084 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:21.478085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b0423-d8c3-434c-8175-80da4c474472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:21.478751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b0423-d8c3-434c-8175-80da4c474472 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:21.479026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b0423-d8c3-434c-8175-80da4c474472 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:21.479298 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b0423-d8c3-434c-8175-80da4c474472 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:21.480480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b0423-d8c3-434c-8175-80da4c474472 None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:21.482473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b0423-d8c3-434c-8175-80da4c474472 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:21.484704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 143/293] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:21 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:21.491961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66241cf3-3619-4a3e-837d-6754113a89c7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:21.551978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5686778-05f0-4ffa-8a1c-87ab975de3ff None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:21.552485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5686778-05f0-4ffa-8a1c-87ab975de3ff None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:21.552558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5686778-05f0-4ffa-8a1c-87ab975de3ff None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:21.554109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 144/294] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:21.559122 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c1cb5-decb-4025-ad2a-39b581f5c99a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:21.559408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c1cb5-decb-4025-ad2a-39b581f5c99a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:21.560292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c1cb5-decb-4025-ad2a-39b581f5c99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:21.578317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e47c1cb5-decb-4025-ad2a-39b581f5c99a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:21.579513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e47c1cb5-decb-4025-ad2a-39b581f5c99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:21.669530 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66241cf3-3619-4a3e-837d-6754113a89c7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:21.672762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 145/295] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:56:21.707515 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:21.722189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532130d7-0efe-4dc1-915c-6f5dbac603d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:21.723085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532130d7-0efe-4dc1-915c-6f5dbac603d8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:21.723556 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532130d7-0efe-4dc1-915c-6f5dbac603d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:21.724015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532130d7-0efe-4dc1-915c-6f5dbac603d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:21.725063 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532130d7-0efe-4dc1-915c-6f5dbac603d8 None admin] RBAC: Adding query filter params (role.id=b0fa1b252ab74641b309e4a3d6aacc68, scope.project.id=01a8779a6dd0442da92e2069510aded8, user.id=da74b74d3f644dbdbb59e8c1f3f6b754) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:21.725611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532130d7-0efe-4dc1-915c-6f5dbac603d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:21.727243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532130d7-0efe-4dc1-915c-6f5dbac603d8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:21.734133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 151/296] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:21 2022] GET /identity/v3/role_assignments?user.id=da74b74d3f644dbdbb59e8c1f3f6b754&scope.project.id=01a8779a6dd0442da92e2069510aded8&role.id=b0fa1b252ab74641b309e4a3d6aacc68 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:21.969765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b63d0b-1945-46ef-9a31-d23e9347b7bc None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:21.970101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b63d0b-1945-46ef-9a31-d23e9347b7bc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:21.970274 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b63d0b-1945-46ef-9a31-d23e9347b7bc None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:21.971844 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 146/297] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:21.977077 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ea474-2086-48d1-bdbc-f829bc3999db None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:21.977521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ea474-2086-48d1-bdbc-f829bc3999db None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:21.977698 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ea474-2086-48d1-bdbc-f829bc3999db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:22.002291 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3d9ea474-2086-48d1-bdbc-f829bc3999db None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:22.003510 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3d9ea474-2086-48d1-bdbc-f829bc3999db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:22.074414 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b63d0b-1945-46ef-9a31-d23e9347b7bc None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:22.087770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 152/298] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:22.126627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:22.203496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b63d0b-1945-46ef-9a31-d23e9347b7bc None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:22.246655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b908f5b-8954-4941-9aa2-08bb9511c869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:22.247779 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b908f5b-8954-4941-9aa2-08bb9511c869 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:22.248094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b908f5b-8954-4941-9aa2-08bb9511c869 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:22.248356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b908f5b-8954-4941-9aa2-08bb9511c869 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:22.264563 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b908f5b-8954-4941-9aa2-08bb9511c869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-7b908f5b-8954-4941-9aa2-08bb9511c869 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:22.269581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:22.270467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:22.271252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:22.271252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:22.271252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:22.271252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:22.271252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:22.271252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:22.271252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:22.271252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:22.271252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:22.271252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:22.271252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:22.271252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:22.271252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 147/299] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:22.276698 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ea474-2086-48d1-bdbc-f829bc3999db None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:22.369277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b908f5b-8954-4941-9aa2-08bb9511c869 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:22.389319 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ea474-2086-48d1-bdbc-f829bc3999db None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:22.407237 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:22.439286 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e83218-0f31-4c47-b855-22f4d04052e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:22.440068 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e83218-0f31-4c47-b855-22f4d04052e6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:22.440373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e83218-0f31-4c47-b855-22f4d04052e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:22.440665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e83218-0f31-4c47-b855-22f4d04052e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:22.441345 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e83218-0f31-4c47-b855-22f4d04052e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:22.441646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e83218-0f31-4c47-b855-22f4d04052e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:22.443912 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e83218-0f31-4c47-b855-22f4d04052e6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:22.456200 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 153/300] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:22.466196 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e83218-0f31-4c47-b855-22f4d04052e6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:22.490984 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:22.494483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b908f5b-8954-4941-9aa2-08bb9511c869 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:22.529858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ad58e-b00c-407c-afee-9c1686f0355e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:22.530402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ad58e-b00c-407c-afee-9c1686f0355e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:22.530673 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ad58e-b00c-407c-afee-9c1686f0355e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:22.530940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ad58e-b00c-407c-afee-9c1686f0355e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:22.532061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ad58e-b00c-407c-afee-9c1686f0355e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:22.533489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ad58e-b00c-407c-afee-9c1686f0355e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:22.535202 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 148/301] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:22.536226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04158295-9323-461c-8342-ae262b5dbef1 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:22.536505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04158295-9323-461c-8342-ae262b5dbef1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:22.536768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04158295-9323-461c-8342-ae262b5dbef1 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:22.538084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 149/302] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:22.541230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04158295-9323-461c-8342-ae262b5dbef1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:22.585478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e83218-0f31-4c47-b855-22f4d04052e6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:22.621747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a72342-b950-424d-8a47-8d23e3dc611c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:22.622404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a72342-b950-424d-8a47-8d23e3dc611c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:22.622677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a72342-b950-424d-8a47-8d23e3dc611c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:22.622944 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a72342-b950-424d-8a47-8d23e3dc611c None admin] PATH_INFO: `/v3/users/74d977c36ca848628ea1cf3b98e7f9f1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:22.636581 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a72342-b950-424d-8a47-8d23e3dc611c None admin] RBAC: Authorizing `identity:get_user(user_id=74d977c36ca848628ea1cf3b98e7f9f1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:22.638059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a72342-b950-424d-8a47-8d23e3dc611c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:22.639691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 154/303] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:22 2022] GET /identity/v3/users/74d977c36ca848628ea1cf3b98e7f9f1 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:22.639691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058efaa-9e00-487a-9be4-205198d989df None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:22.639691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058efaa-9e00-487a-9be4-205198d989df None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:22.639691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058efaa-9e00-487a-9be4-205198d989df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:22.661774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6058efaa-9e00-487a-9be4-205198d989df None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:22.662302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04158295-9323-461c-8342-ae262b5dbef1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:22.663025 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6058efaa-9e00-487a-9be4-205198d989df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:22.689724 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:22.701732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7227e-a666-407c-8863-7160d0518db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:22.702332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7227e-a666-407c-8863-7160d0518db2 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:22.702602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7227e-a666-407c-8863-7160d0518db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:22.702865 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7227e-a666-407c-8863-7160d0518db2 None admin] PATH_INFO: `/v3/groups` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:22.703486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7227e-a666-407c-8863-7160d0518db2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:22.704948 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7227e-a666-407c-8863-7160d0518db2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:22.731985 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 150/304] 10.222.0.48 () {60 vars in 1134 bytes} [Tue Aug 30 04:56:22 2022] POST /identity/v3/groups => generated 229 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:56:22.731985 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7227e-a666-407c-8863-7160d0518db2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:22.746844 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 155/305] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:22.772243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:22.855636 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7227e-a666-407c-8863-7160d0518db2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:22.893500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcbd24-4c23-4d52-8af9-b481bb192c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:22.894173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcbd24-4c23-4d52-8af9-b481bb192c02 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:22.894512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcbd24-4c23-4d52-8af9-b481bb192c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:22.894785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcbd24-4c23-4d52-8af9-b481bb192c02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:22.895659 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcbd24-4c23-4d52-8af9-b481bb192c02 None admin] RBAC: Adding query filter params (role.id=5197d75b3317432da8f4d292f4953baa, user.id=74d977c36ca848628ea1cf3b98e7f9f1, scope.system=all) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:22.896026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcbd24-4c23-4d52-8af9-b481bb192c02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:22.897472 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcbd24-4c23-4d52-8af9-b481bb192c02 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:22.903868 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 151/306] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Aug 30 04:56:22 2022] GET /identity/v3/role_assignments?user.id=74d977c36ca848628ea1cf3b98e7f9f1&scope.system=all&role.id=5197d75b3317432da8f4d292f4953baa => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:22.913215 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da8640-2e7d-495c-8c75-1a9e927fa3a0 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:22.913502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da8640-2e7d-495c-8c75-1a9e927fa3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:22.913775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da8640-2e7d-495c-8c75-1a9e927fa3a0 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:22.915204 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 156/307] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:22.921149 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a94372-1e38-45ae-95a7-5705e36d34ff None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:22.921446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a94372-1e38-45ae-95a7-5705e36d34ff None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:22.921866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a94372-1e38-45ae-95a7-5705e36d34ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:22.942512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c2a94372-1e38-45ae-95a7-5705e36d34ff None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:22.944133 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c2a94372-1e38-45ae-95a7-5705e36d34ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:23.017548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da8640-2e7d-495c-8c75-1a9e927fa3a0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:23.029382 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 152/308] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:23.127057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da8640-2e7d-495c-8c75-1a9e927fa3a0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:23.163695 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699ebd1-4a69-4dab-b04e-acfb103c0ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:23.164399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699ebd1-4a69-4dab-b04e-acfb103c0ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:23.164726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699ebd1-4a69-4dab-b04e-acfb103c0ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:23.165045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699ebd1-4a69-4dab-b04e-acfb103c0ac5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:23.177445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699ebd1-4a69-4dab-b04e-acfb103c0ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-8699ebd1-4a69-4dab-b04e-acfb103c0ac5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:23.183557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:23.184864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:23.185662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:23.185662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:23.185662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:23.185662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:23.185662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:23.185662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:23.185662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:23.185662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:23.185662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:23.185662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:23.185662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:23.185662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:23.185662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 157/309] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:56:23.190994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a94372-1e38-45ae-95a7-5705e36d34ff None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:23.219485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:23.303941 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a94372-1e38-45ae-95a7-5705e36d34ff None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:23.323143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699ebd1-4a69-4dab-b04e-acfb103c0ac5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:23.346181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdf9d9-c2dd-48d7-8346-8ce230680d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:23.346790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdf9d9-c2dd-48d7-8346-8ce230680d49 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:23.347065 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdf9d9-c2dd-48d7-8346-8ce230680d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:23.347547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdf9d9-c2dd-48d7-8346-8ce230680d49 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:23.348243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdf9d9-c2dd-48d7-8346-8ce230680d49 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:23.348544 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdf9d9-c2dd-48d7-8346-8ce230680d49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:23.349930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdf9d9-c2dd-48d7-8346-8ce230680d49 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:23.351134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:23.364556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 153/310] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:23.365654 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdf9d9-c2dd-48d7-8346-8ce230680d49 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:23.442993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699ebd1-4a69-4dab-b04e-acfb103c0ac5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:23.462781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:23.478527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df21f1-118e-4525-bf28-0ce0b86269b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:23.479302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df21f1-118e-4525-bf28-0ce0b86269b8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:23.479799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df21f1-118e-4525-bf28-0ce0b86269b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:23.480288 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df21f1-118e-4525-bf28-0ce0b86269b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:23.487322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdf9d9-c2dd-48d7-8346-8ce230680d49 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:23.493787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df21f1-118e-4525-bf28-0ce0b86269b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-18df21f1-118e-4525-bf28-0ce0b86269b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:23.499289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:23.500227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:23.506465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:23.506465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:23.506465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:23.506465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:23.506465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:23.506465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:23.506465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:23.506465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:23.506465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:23.506465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:23.506465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:23.506465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:23.506465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 158/311] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:56:23.506465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df21f1-118e-4525-bf28-0ce0b86269b8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:23.537961 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497d6b9-d535-4bef-ac42-e911f47992e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:23.538941 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497d6b9-d535-4bef-ac42-e911f47992e7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:23.539229 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497d6b9-d535-4bef-ac42-e911f47992e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:23.539499 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497d6b9-d535-4bef-ac42-e911f47992e7 None admin] PATH_INFO: `/v3/users/6159596d938d4b03a31fa529479ed276` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:23.540668 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497d6b9-d535-4bef-ac42-e911f47992e7 None admin] RBAC: Authorizing `identity:get_user(user_id=6159596d938d4b03a31fa529479ed276)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:23.542940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497d6b9-d535-4bef-ac42-e911f47992e7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:23.545339 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 154/312] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:23 2022] GET /identity/v3/users/6159596d938d4b03a31fa529479ed276 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:23.551433 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497d6b9-d535-4bef-ac42-e911f47992e7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:23.620413 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:23.650119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df21f1-118e-4525-bf28-0ce0b86269b8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:23.660875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497d6b9-d535-4bef-ac42-e911f47992e7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:23.702938 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0433fac-3ac7-44c7-a99e-0fa481fe8c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:23.703530 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0433fac-3ac7-44c7-a99e-0fa481fe8c04 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:23.703788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0433fac-3ac7-44c7-a99e-0fa481fe8c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:23.704069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0433fac-3ac7-44c7-a99e-0fa481fe8c04 None admin] PATH_INFO: `/v3/system/users/6159596d938d4b03a31fa529479ed276/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:23.705390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850043c-8764-4161-ac84-948881d948c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:23.705985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850043c-8764-4161-ac84-948881d948c4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:23.706257 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850043c-8764-4161-ac84-948881d948c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:23.706521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850043c-8764-4161-ac84-948881d948c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:23.707178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850043c-8764-4161-ac84-948881d948c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:23.707475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850043c-8764-4161-ac84-948881d948c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:23.708672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0433fac-3ac7-44c7-a99e-0fa481fe8c04 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6159596d938d4b03a31fa529479ed276, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:23.708868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850043c-8764-4161-ac84-948881d948c4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:23.710784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0433fac-3ac7-44c7-a99e-0fa481fe8c04 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:23.717686 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 159/313] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:23.720961 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 155/314] 10.222.0.48 () {58 vars in 1334 bytes} [Tue Aug 30 04:56:23 2022] PUT /identity/v3/system/users/6159596d938d4b03a31fa529479ed276/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:56:23.726556 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850043c-8764-4161-ac84-948881d948c4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:23.847384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850043c-8764-4161-ac84-948881d948c4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:23.885154 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757534ec-c85c-463f-9c14-5db4775936d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:23.885791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757534ec-c85c-463f-9c14-5db4775936d7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:23.886069 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757534ec-c85c-463f-9c14-5db4775936d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:23.886338 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757534ec-c85c-463f-9c14-5db4775936d7 None admin] PATH_INFO: `/v3/users/31522de60c324a4cb22915cee70ac47b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:23.887508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757534ec-c85c-463f-9c14-5db4775936d7 None admin] RBAC: Authorizing `identity:get_user(user_id=31522de60c324a4cb22915cee70ac47b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:23.889052 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757534ec-c85c-463f-9c14-5db4775936d7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:23.890709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 160/315] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:23 2022] GET /identity/v3/users/31522de60c324a4cb22915cee70ac47b => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:23.896752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0433fac-3ac7-44c7-a99e-0fa481fe8c04 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:23.922333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:24.015892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0433fac-3ac7-44c7-a99e-0fa481fe8c04 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:24.054119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caaa6e-78c0-4b4c-9357-6bf52174ba1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:24.054732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caaa6e-78c0-4b4c-9357-6bf52174ba1b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:24.055010 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caaa6e-78c0-4b4c-9357-6bf52174ba1b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:24.055282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caaa6e-78c0-4b4c-9357-6bf52174ba1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:24.126997 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caaa6e-78c0-4b4c-9357-6bf52174ba1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:24.128580 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caaa6e-78c0-4b4c-9357-6bf52174ba1b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:24.146308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:24.232317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 156/316] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:24.237769 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757534ec-c85c-463f-9c14-5db4775936d7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:24.253354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:24.344849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757534ec-c85c-463f-9c14-5db4775936d7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:24.380884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508d6e4-acbf-455e-a11d-ff0596cf17c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:24.381521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d6e4-acbf-455e-a11d-ff0596cf17c0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:24.381798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d6e4-acbf-455e-a11d-ff0596cf17c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:24.382066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d6e4-acbf-455e-a11d-ff0596cf17c0 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:24.383189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508d6e4-acbf-455e-a11d-ff0596cf17c0 None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:24.384670 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508d6e4-acbf-455e-a11d-ff0596cf17c0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:24.386299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 161/317] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:24 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:24.392774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caaa6e-78c0-4b4c-9357-6bf52174ba1b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:24.500614 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caaa6e-78c0-4b4c-9357-6bf52174ba1b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:24.518648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:24.537867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cd128-7cdd-415e-a13f-8cd7d36445da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:24.538532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cd128-7cdd-415e-a13f-8cd7d36445da None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:24.538814 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cd128-7cdd-415e-a13f-8cd7d36445da None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:24.539088 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cd128-7cdd-415e-a13f-8cd7d36445da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:24.539822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cd128-7cdd-415e-a13f-8cd7d36445da None admin] RBAC: Adding query filter params (role.id=5197d75b3317432da8f4d292f4953baa, scope.project.id=01a8779a6dd0442da92e2069510aded8, user.id=31522de60c324a4cb22915cee70ac47b) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:24.540158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cd128-7cdd-415e-a13f-8cd7d36445da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:24.541604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cd128-7cdd-415e-a13f-8cd7d36445da None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:24.548358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 157/318] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:24 2022] GET /identity/v3/role_assignments?user.id=31522de60c324a4cb22915cee70ac47b&scope.project.id=01a8779a6dd0442da92e2069510aded8&role.id=5197d75b3317432da8f4d292f4953baa => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:24.881717 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe60d-de07-419c-9ca7-e81d0d87f28d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:24.882436 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe60d-de07-419c-9ca7-e81d0d87f28d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:24.882912 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe60d-de07-419c-9ca7-e81d0d87f28d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:24.884998 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 162/319] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:24.890737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923356c-1e8a-4dae-a283-eabaf54fdd4a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:24.891188 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923356c-1e8a-4dae-a283-eabaf54fdd4a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:24.891260 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923356c-1e8a-4dae-a283-eabaf54fdd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:24.893136 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b0735-50b0-446b-a19b-647aedf69ca6 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:24.893419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b0735-50b0-446b-a19b-647aedf69ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:24.893748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b0735-50b0-446b-a19b-647aedf69ca6 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:24.895205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 163/320] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:56:24.900018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce91c41-a592-4ea3-b3da-3f305f0b8158 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:24.900306 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce91c41-a592-4ea3-b3da-3f305f0b8158 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:24.900576 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce91c41-a592-4ea3-b3da-3f305f0b8158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:24.910094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e923356c-1e8a-4dae-a283-eabaf54fdd4a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:24.911333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e923356c-1e8a-4dae-a283-eabaf54fdd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:24.918526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2ce91c41-a592-4ea3-b3da-3f305f0b8158 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:24.919706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2ce91c41-a592-4ea3-b3da-3f305f0b8158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:24.982147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 158/321] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:56:24.999987 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 164/322] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:56:25.262702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923356c-1e8a-4dae-a283-eabaf54fdd4a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:25.263606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce91c41-a592-4ea3-b3da-3f305f0b8158 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:25.275297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:25.371082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce91c41-a592-4ea3-b3da-3f305f0b8158 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:25.375348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923356c-1e8a-4dae-a283-eabaf54fdd4a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:25.388514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:25.407882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fbe57-053f-4902-b879-1cb91a619655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:25.408778 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fbe57-053f-4902-b879-1cb91a619655 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:25.409199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fbe57-053f-4902-b879-1cb91a619655 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:25.409623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fbe57-053f-4902-b879-1cb91a619655 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:25.414757 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df24b9d-91ae-492b-af66-d50efb79b44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:25.415390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24b9d-91ae-492b-af66-d50efb79b44d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:25.415667 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24b9d-91ae-492b-af66-d50efb79b44d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:25.415989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24b9d-91ae-492b-af66-d50efb79b44d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:25.417083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df24b9d-91ae-492b-af66-d50efb79b44d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:25.418527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df24b9d-91ae-492b-af66-d50efb79b44d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:25.420712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 159/323] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:25.421446 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fbe57-053f-4902-b879-1cb91a619655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:25.426219 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df24b9d-91ae-492b-af66-d50efb79b44d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-a49fbe57-053f-4902-b879-1cb91a619655 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:25.426741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:25.427612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:25.428430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:25.428430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:25.428430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:25.428430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:25.428430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:25.428430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:25.428430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:25.428430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:25.428430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:25.428430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:25.428430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:25.428430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:25.429719 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 165/324] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:56:25.435086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fbe57-053f-4902-b879-1cb91a619655 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:25.511877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:25.537878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df24b9d-91ae-492b-af66-d50efb79b44d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:25.547859 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fbe57-053f-4902-b879-1cb91a619655 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:25.573944 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2371c-c13c-42e2-9d04-511b4daab890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:25.574554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2371c-c13c-42e2-9d04-511b4daab890 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:25.574827 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2371c-c13c-42e2-9d04-511b4daab890 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:25.575137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2371c-c13c-42e2-9d04-511b4daab890 None admin] PATH_INFO: `/v3/groups` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:25.575771 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2371c-c13c-42e2-9d04-511b4daab890 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:25.577238 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2371c-c13c-42e2-9d04-511b4daab890 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:25.586809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c881b89-ce86-41cf-9403-2cbd1685106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:25.587440 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c881b89-ce86-41cf-9403-2cbd1685106c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:25.587720 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c881b89-ce86-41cf-9403-2cbd1685106c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:25.588017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c881b89-ce86-41cf-9403-2cbd1685106c None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:25.588685 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c881b89-ce86-41cf-9403-2cbd1685106c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:25.588984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c881b89-ce86-41cf-9403-2cbd1685106c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:25.591316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c881b89-ce86-41cf-9403-2cbd1685106c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:25.595244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 160/325] 10.222.0.48 () {60 vars in 1134 bytes} [Tue Aug 30 04:56:25 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:56:25.604978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 166/326] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:25.607226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2371c-c13c-42e2-9d04-511b4daab890 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:25.654317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:25.709210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d799bc9-e1c1-4028-96e3-72c98807d0da None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:25.709539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d799bc9-e1c1-4028-96e3-72c98807d0da None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:25.709763 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d799bc9-e1c1-4028-96e3-72c98807d0da None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:25.711302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 167/327] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:56:25.716694 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a5610-21c5-469a-bfe7-f12e8bed33e5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:25.716986 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a5610-21c5-469a-bfe7-f12e8bed33e5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:25.717264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a5610-21c5-469a-bfe7-f12e8bed33e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:25.724373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2371c-c13c-42e2-9d04-511b4daab890 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:25.740968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2b3a5610-21c5-469a-bfe7-f12e8bed33e5 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:25.743430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2b3a5610-21c5-469a-bfe7-f12e8bed33e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:25.772024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e843b-835b-480e-8341-0603b195ee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:25.772803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e843b-835b-480e-8341-0603b195ee9d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:25.773405 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e843b-835b-480e-8341-0603b195ee9d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:25.773686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e843b-835b-480e-8341-0603b195ee9d None admin] PATH_INFO: `/v3/users/74d977c36ca848628ea1cf3b98e7f9f1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:25.775099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e843b-835b-480e-8341-0603b195ee9d None admin] RBAC: Authorizing `identity:get_user(user_id=74d977c36ca848628ea1cf3b98e7f9f1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:25.776604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e843b-835b-480e-8341-0603b195ee9d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:25.782964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 161/328] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:25 2022] GET /identity/v3/users/74d977c36ca848628ea1cf3b98e7f9f1 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:25.784976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e843b-835b-480e-8341-0603b195ee9d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:25.820675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 168/329] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:56:25.898271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e843b-835b-480e-8341-0603b195ee9d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:25.906207 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:25.938323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3efdc-42a2-4dab-8c03-4fef32ac1e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:25.939049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3efdc-42a2-4dab-8c03-4fef32ac1e96 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:25.939324 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3efdc-42a2-4dab-8c03-4fef32ac1e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:25.939595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3efdc-42a2-4dab-8c03-4fef32ac1e96 None admin] PATH_INFO: `/v3/system/users/74d977c36ca848628ea1cf3b98e7f9f1/roles/5197d75b3317432da8f4d292f4953baa` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:25.941059 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3efdc-42a2-4dab-8c03-4fef32ac1e96 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=74d977c36ca848628ea1cf3b98e7f9f1, role_id=5197d75b3317432da8f4d292f4953baa)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:25.942439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3efdc-42a2-4dab-8c03-4fef32ac1e96 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:25.952041 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 162/330] 10.222.0.48 () {58 vars in 1334 bytes} [Tue Aug 30 04:56:25 2022] PUT /identity/v3/system/users/74d977c36ca848628ea1cf3b98e7f9f1/roles/5197d75b3317432da8f4d292f4953baa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:56:26.105660 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a5610-21c5-469a-bfe7-f12e8bed33e5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:26.173596 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:26.218180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a5610-21c5-469a-bfe7-f12e8bed33e5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:26.257200 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781c9f5-91fc-4726-bde6-8d1992fca7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:26.257857 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781c9f5-91fc-4726-bde6-8d1992fca7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:26.258116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781c9f5-91fc-4726-bde6-8d1992fca7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:26.258382 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781c9f5-91fc-4726-bde6-8d1992fca7a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:26.269776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781c9f5-91fc-4726-bde6-8d1992fca7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b781c9f5-91fc-4726-bde6-8d1992fca7a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:26.274788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:26.275678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:26.276754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:26.276754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:26.276754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:26.276754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:26.276754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:26.276754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:26.276754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:26.276754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:26.276754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:26.276754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:26.276754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:26.276754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:26.276754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 169/331] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:26.285034 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3efdc-42a2-4dab-8c03-4fef32ac1e96 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:26.408650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3efdc-42a2-4dab-8c03-4fef32ac1e96 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:26.449374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99929276-ae88-47c1-ae59-c3b8e03da3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:26.450554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99929276-ae88-47c1-ae59-c3b8e03da3aa None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:26.450834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99929276-ae88-47c1-ae59-c3b8e03da3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:26.451106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99929276-ae88-47c1-ae59-c3b8e03da3aa None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:26.451784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99929276-ae88-47c1-ae59-c3b8e03da3aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:26.452109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99929276-ae88-47c1-ae59-c3b8e03da3aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:26.453508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99929276-ae88-47c1-ae59-c3b8e03da3aa None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:26.467013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 163/332] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:26.472722 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781c9f5-91fc-4726-bde6-8d1992fca7a7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:26.601888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781c9f5-91fc-4726-bde6-8d1992fca7a7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:26.635254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:26.648026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26686f-ffd4-4ec3-aeff-40b17ac4e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:26.648662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26686f-ffd4-4ec3-aeff-40b17ac4e318 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:26.648939 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26686f-ffd4-4ec3-aeff-40b17ac4e318 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:26.649212 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26686f-ffd4-4ec3-aeff-40b17ac4e318 None admin] PATH_INFO: `/v3/users/6159596d938d4b03a31fa529479ed276` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:26.656624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26686f-ffd4-4ec3-aeff-40b17ac4e318 None admin] RBAC: Authorizing `identity:get_user(user_id=6159596d938d4b03a31fa529479ed276)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:26.658090 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26686f-ffd4-4ec3-aeff-40b17ac4e318 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:26.660167 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 170/333] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:26 2022] GET /identity/v3/users/6159596d938d4b03a31fa529479ed276 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:26.666191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99929276-ae88-47c1-ae59-c3b8e03da3aa None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:26.717049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:26.798124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99929276-ae88-47c1-ae59-c3b8e03da3aa None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:26.843016 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa82f0a-21c7-45b9-8a5f-63abe84ae3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:26.843631 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa82f0a-21c7-45b9-8a5f-63abe84ae3ba None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:26.843906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa82f0a-21c7-45b9-8a5f-63abe84ae3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:26.844200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa82f0a-21c7-45b9-8a5f-63abe84ae3ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:26.844930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa82f0a-21c7-45b9-8a5f-63abe84ae3ba None admin] RBAC: Adding query filter params (role.id=b0fa1b252ab74641b309e4a3d6aacc68, user.id=6159596d938d4b03a31fa529479ed276, scope.system=all) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:26.845233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa82f0a-21c7-45b9-8a5f-63abe84ae3ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:26.846672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa82f0a-21c7-45b9-8a5f-63abe84ae3ba None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:26.860081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 164/334] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Aug 30 04:56:26 2022] GET /identity/v3/role_assignments?user.id=6159596d938d4b03a31fa529479ed276&scope.system=all&role.id=b0fa1b252ab74641b309e4a3d6aacc68 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:28.085050 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa438a-d787-41c6-9140-54f36b7e8235 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:28.085579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa438a-d787-41c6-9140-54f36b7e8235 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:28.085657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa438a-d787-41c6-9140-54f36b7e8235 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:28.087144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 171/335] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:28.101738 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39daaee-14bc-4268-b8ee-18c3c52f0406 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:28.102213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39daaee-14bc-4268-b8ee-18c3c52f0406 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:28.102288 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39daaee-14bc-4268-b8ee-18c3c52f0406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:28.125390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c39daaee-14bc-4268-b8ee-18c3c52f0406 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:28.126654 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c39daaee-14bc-4268-b8ee-18c3c52f0406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:28.225095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 165/336] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:28.294016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06f62-8092-484b-bfc5-e411cf8ed669 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:28.294313 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06f62-8092-484b-bfc5-e411cf8ed669 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:28.294496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06f62-8092-484b-bfc5-e411cf8ed669 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:28.296000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 172/337] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:28.301281 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280b5e4-3030-4898-8071-69a76faace41 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:28.301721 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280b5e4-3030-4898-8071-69a76faace41 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:28.302113 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280b5e4-3030-4898-8071-69a76faace41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:28.326892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9280b5e4-3030-4898-8071-69a76faace41 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:28.328242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9280b5e4-3030-4898-8071-69a76faace41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:28.344891 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:28.419545 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 166/338] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:28.626292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985986b9-31df-4230-9aff-37c880672c96 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:28.626665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985986b9-31df-4230-9aff-37c880672c96 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:28.626846 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985986b9-31df-4230-9aff-37c880672c96 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:28.628290 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 173/339] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:28.642765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3484112-10ab-4417-ae75-1dbdc08e3137 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:28.643055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3484112-10ab-4417-ae75-1dbdc08e3137 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:28.643333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3484112-10ab-4417-ae75-1dbdc08e3137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:28.652451 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985986b9-31df-4230-9aff-37c880672c96 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:28.686476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f3484112-10ab-4417-ae75-1dbdc08e3137 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:28.687903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f3484112-10ab-4417-ae75-1dbdc08e3137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:28.833585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 167/340] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:28.849349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985986b9-31df-4230-9aff-37c880672c96 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:28.857485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3484112-10ab-4417-ae75-1dbdc08e3137 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:28.900837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe693c3-32fb-4782-a3ab-6873f86d03f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:28.901413 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe693c3-32fb-4782-a3ab-6873f86d03f9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:28.901689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe693c3-32fb-4782-a3ab-6873f86d03f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:28.901962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe693c3-32fb-4782-a3ab-6873f86d03f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:28.917873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe693c3-32fb-4782-a3ab-6873f86d03f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-2fe693c3-32fb-4782-a3ab-6873f86d03f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:28.927401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:28.928324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:28.929110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:28.929110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:28.929110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:28.929110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:28.929110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:28.929110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:28.929110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:28.929110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:28.929110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:28.929110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:28.929110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:28.929110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:28.929110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 174/341] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:28.936905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe693c3-32fb-4782-a3ab-6873f86d03f9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:28.971351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:29.000281 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3484112-10ab-4417-ae75-1dbdc08e3137 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:29.013378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:29.072069 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe693c3-32fb-4782-a3ab-6873f86d03f9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:29.086486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674184c3-f0f9-4a8b-b6dd-d15c96882029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:29.087353 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674184c3-f0f9-4a8b-b6dd-d15c96882029 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.087765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674184c3-f0f9-4a8b-b6dd-d15c96882029 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.088218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674184c3-f0f9-4a8b-b6dd-d15c96882029 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.103875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674184c3-f0f9-4a8b-b6dd-d15c96882029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-674184c3-f0f9-4a8b-b6dd-d15c96882029 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:29.109538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:29.110402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:29.111181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:29.111181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:29.111181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:29.111181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:29.111181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:29.111181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:29.111181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:29.111181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:29.111181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:29.111181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:29.111181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:56:29.111181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:29.113778 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 168/342] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:29.119567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674184c3-f0f9-4a8b-b6dd-d15c96882029 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:29.126779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305da33-911d-4cc5-ae53-6a660c048813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:29.127929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305da33-911d-4cc5-ae53-6a660c048813 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.128498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305da33-911d-4cc5-ae53-6a660c048813 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.128977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305da33-911d-4cc5-ae53-6a660c048813 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.129807 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305da33-911d-4cc5-ae53-6a660c048813 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:29.130240 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305da33-911d-4cc5-ae53-6a660c048813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:29.132041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305da33-911d-4cc5-ae53-6a660c048813 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:29.146877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 175/343] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:29.152454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305da33-911d-4cc5-ae53-6a660c048813 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:29.269970 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674184c3-f0f9-4a8b-b6dd-d15c96882029 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:29.322912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafc677-38c4-4b22-b633-e250823a0353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:29.323525 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafc677-38c4-4b22-b633-e250823a0353 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.323797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafc677-38c4-4b22-b633-e250823a0353 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.324109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafc677-38c4-4b22-b633-e250823a0353 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.324809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafc677-38c4-4b22-b633-e250823a0353 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:29.325108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafc677-38c4-4b22-b633-e250823a0353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:29.326477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafc677-38c4-4b22-b633-e250823a0353 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:29.339513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 169/344] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:29.345686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafc677-38c4-4b22-b633-e250823a0353 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:29.349685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:29.357236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305da33-911d-4cc5-ae53-6a660c048813 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:29.379908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:29.430791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf4c1d-c688-4029-9d51-8a11bb86b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:29.431332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf4c1d-c688-4029-9d51-8a11bb86b58d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.431612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf4c1d-c688-4029-9d51-8a11bb86b58d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.431941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf4c1d-c688-4029-9d51-8a11bb86b58d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.465940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafc677-38c4-4b22-b633-e250823a0353 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:29.502288 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72f3b3-3e68-4faf-9239-5d6bc8cb582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:29.502933 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72f3b3-3e68-4faf-9239-5d6bc8cb582a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.503211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72f3b3-3e68-4faf-9239-5d6bc8cb582a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.503594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72f3b3-3e68-4faf-9239-5d6bc8cb582a None admin] PATH_INFO: `/v3/users/74d977c36ca848628ea1cf3b98e7f9f1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.504981 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72f3b3-3e68-4faf-9239-5d6bc8cb582a None admin] RBAC: Authorizing `identity:get_user(user_id=74d977c36ca848628ea1cf3b98e7f9f1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:29.507240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72f3b3-3e68-4faf-9239-5d6bc8cb582a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:29.511151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 170/345] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:56:29 2022] GET /identity/v3/users/74d977c36ca848628ea1cf3b98e7f9f1 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:29.511938 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72f3b3-3e68-4faf-9239-5d6bc8cb582a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:29.578464 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf4c1d-c688-4029-9d51-8a11bb86b58d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:29.579941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf4c1d-c688-4029-9d51-8a11bb86b58d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:29.597659 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:29.648971 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72f3b3-3e68-4faf-9239-5d6bc8cb582a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:29.688504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c438fb2-b12a-47ba-9dc4-9edec05437e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:29.689172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c438fb2-b12a-47ba-9dc4-9edec05437e9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.689451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c438fb2-b12a-47ba-9dc4-9edec05437e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.689776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c438fb2-b12a-47ba-9dc4-9edec05437e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.700948 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c438fb2-b12a-47ba-9dc4-9edec05437e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-3c438fb2-b12a-47ba-9dc4-9edec05437e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:29.707848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:29.708879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:29.709714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:29.709714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:29.709714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:29.709714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:29.709714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:29.709714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:29.709714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:29.709714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:29.709714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:29.709714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:29.709714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:29.709714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:29.709714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 171/346] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:56:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:29.714361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 176/347] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:29.714361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d9ca1-d025-44dd-88fc-4ce96fb779a8 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.714361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d9ca1-d025-44dd-88fc-4ce96fb779a8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.714361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d9ca1-d025-44dd-88fc-4ce96fb779a8 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.714361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 177/348] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:29.714661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c438fb2-b12a-47ba-9dc4-9edec05437e9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:29.714727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dbf6c-69f2-4396-93fd-41f92e250e21 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.714727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dbf6c-69f2-4396-93fd-41f92e250e21 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.714727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dbf6c-69f2-4396-93fd-41f92e250e21 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.716515 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 178/349] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:29.718791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dbf6c-69f2-4396-93fd-41f92e250e21 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:29.739131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:29.857395 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dbf6c-69f2-4396-93fd-41f92e250e21 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:29.858330 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c438fb2-b12a-47ba-9dc4-9edec05437e9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:29.896805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:29.898469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bdbc8-3623-477a-b234-e54afc6387fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:29.899333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bdbc8-3623-477a-b234-e54afc6387fc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.899749 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bdbc8-3623-477a-b234-e54afc6387fc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.900343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bdbc8-3623-477a-b234-e54afc6387fc None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.901409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bdbc8-3623-477a-b234-e54afc6387fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:29.902534 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bdbc8-3623-477a-b234-e54afc6387fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:29.904551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcb737-5aa3-45e1-b544-764c1242f781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:29.904858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bdbc8-3623-477a-b234-e54afc6387fc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:29.905159 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcb737-5aa3-45e1-b544-764c1242f781 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.905438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcb737-5aa3-45e1-b544-764c1242f781 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.905708 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcb737-5aa3-45e1-b544-764c1242f781 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.906444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcb737-5aa3-45e1-b544-764c1242f781 None admin] RBAC: Adding query filter params (role.id=5197d75b3317432da8f4d292f4953baa, user.id=74d977c36ca848628ea1cf3b98e7f9f1, scope.system=all) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:29.906749 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcb737-5aa3-45e1-b544-764c1242f781 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:29.908220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcb737-5aa3-45e1-b544-764c1242f781 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:29.915860 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 179/350] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:29.917383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112607f-cd3d-44bc-8fa5-c356ca9293bb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.917669 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112607f-cd3d-44bc-8fa5-c356ca9293bb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.917942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112607f-cd3d-44bc-8fa5-c356ca9293bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.923389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 172/351] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Aug 30 04:56:29 2022] GET /identity/v3/role_assignments?user.id=74d977c36ca848628ea1cf3b98e7f9f1&scope.system=all&role.id=5197d75b3317432da8f4d292f4953baa => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:29.925009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcb737-5aa3-45e1-b544-764c1242f781 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:29.941641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5112607f-cd3d-44bc-8fa5-c356ca9293bb None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:29.943623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5112607f-cd3d-44bc-8fa5-c356ca9293bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:30.054923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 180/352] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:30.057226 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e340c-58c5-4cc6-a830-4e6bcba74b42 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:30.057226 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e340c-58c5-4cc6-a830-4e6bcba74b42 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:30.057566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e340c-58c5-4cc6-a830-4e6bcba74b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:30.068616 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:30.091975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b87e340c-58c5-4cc6-a830-4e6bcba74b42 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:30.091975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b87e340c-58c5-4cc6-a830-4e6bcba74b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:30.092256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcb737-5aa3-45e1-b544-764c1242f781 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:30.161394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa9056-aeac-4e9b-801c-1d8bab15e89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:30.162192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa9056-aeac-4e9b-801c-1d8bab15e89f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:30.162754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa9056-aeac-4e9b-801c-1d8bab15e89f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:30.163037 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa9056-aeac-4e9b-801c-1d8bab15e89f None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:30.164978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa9056-aeac-4e9b-801c-1d8bab15e89f None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:30.166741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa9056-aeac-4e9b-801c-1d8bab15e89f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:30.171167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 173/353] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:29 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:30.172373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa9056-aeac-4e9b-801c-1d8bab15e89f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:30.207549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 181/354] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:30.208355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e340c-58c5-4cc6-a830-4e6bcba74b42 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:30.253494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:30.316476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa9056-aeac-4e9b-801c-1d8bab15e89f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:30.341065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e340c-58c5-4cc6-a830-4e6bcba74b42 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:30.365237 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca261b-1e10-4211-804a-31f4b58794fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:30.366346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca261b-1e10-4211-804a-31f4b58794fc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:30.367549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca261b-1e10-4211-804a-31f4b58794fc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:30.369257 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca261b-1e10-4211-804a-31f4b58794fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:30.403963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b1ef-42d1-4a3d-8f1e-28577863a252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:30.404878 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b1ef-42d1-4a3d-8f1e-28577863a252 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:30.405509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b1ef-42d1-4a3d-8f1e-28577863a252 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:30.406123 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b1ef-42d1-4a3d-8f1e-28577863a252 None admin] PATH_INFO: `/v3/groups/dadefdc03fe848e09048bc5d111ee09b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:30.412289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:30.420555 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8b1ef-42d1-4a3d-8f1e-28577863a252 None admin] RBAC: Authorizing `identity:get_group(group_id=dadefdc03fe848e09048bc5d111ee09b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:30.422780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8b1ef-42d1-4a3d-8f1e-28577863a252 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:30.426627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 182/355] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Aug 30 04:56:30 2022] GET /identity/v3/groups/dadefdc03fe848e09048bc5d111ee09b => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:30.432703 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b1ef-42d1-4a3d-8f1e-28577863a252 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:30.506397 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca261b-1e10-4211-804a-31f4b58794fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:30.507610 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca261b-1e10-4211-804a-31f4b58794fc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:30.587868 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:30.590070 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b1ef-42d1-4a3d-8f1e-28577863a252 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:30.633190 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350622d-ab0a-4bdb-b375-5b28eb6fd224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:30.634041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350622d-ab0a-4bdb-b375-5b28eb6fd224 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:30.634455 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350622d-ab0a-4bdb-b375-5b28eb6fd224 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:30.634889 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350622d-ab0a-4bdb-b375-5b28eb6fd224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:30.635753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350622d-ab0a-4bdb-b375-5b28eb6fd224 None admin] RBAC: Adding query filter params (group.id=dadefdc03fe848e09048bc5d111ee09b, role.id=b0fa1b252ab74641b309e4a3d6aacc68, scope.project.id=aa51b8e01e6242dcb98f562872154655) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:30.636221 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350622d-ab0a-4bdb-b375-5b28eb6fd224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:30.638354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350622d-ab0a-4bdb-b375-5b28eb6fd224 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:30.644509 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 174/356] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:30.646004 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca261b-1e10-4211-804a-31f4b58794fc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:30.646968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 183/357] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Aug 30 04:56:30 2022] GET /identity/v3/role_assignments?group.id=dadefdc03fe848e09048bc5d111ee09b&scope.project.id=aa51b8e01e6242dcb98f562872154655&role.id=b0fa1b252ab74641b309e4a3d6aacc68 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:30.647774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350622d-ab0a-4bdb-b375-5b28eb6fd224 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:30.733554 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:30.793175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca261b-1e10-4211-804a-31f4b58794fc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:30.796264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350622d-ab0a-4bdb-b375-5b28eb6fd224 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:30.837739 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59673d74-c686-4bf9-a06b-8c6ba18b3b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:30.838375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673d74-c686-4bf9-a06b-8c6ba18b3b70 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:30.838647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673d74-c686-4bf9-a06b-8c6ba18b3b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:30.838911 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673d74-c686-4bf9-a06b-8c6ba18b3b70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:30.839129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4eda9-e7e1-4fa0-a0e4-fda347c8c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:30.839758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4eda9-e7e1-4fa0-a0e4-fda347c8c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:30.840081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4eda9-e7e1-4fa0-a0e4-fda347c8c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:30.840904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4eda9-e7e1-4fa0-a0e4-fda347c8c0f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:30.853633 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59673d74-c686-4bf9-a06b-8c6ba18b3b70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:30.857000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4eda9-e7e1-4fa0-a0e4-fda347c8c0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-59673d74-c686-4bf9-a06b-8c6ba18b3b70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:30.859423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:30.860310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:30.861125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:30.861125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:30.861125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:30.861125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:30.861125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:30.861125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:30.861125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:30.861125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:30.861125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:30.861125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:30.861125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:30.861125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-9ed4eda9-e7e1-4fa0-a0e4-fda347c8c0f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:30.862410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:30.863229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:30.864151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:30.864151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:30.864151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:30.864151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:30.864151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:30.864151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:30.864151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:30.864151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:30.864151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:30.864151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:30.864151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:30.864151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:30.864151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 184/359] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:56:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:30.864788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 175/359] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:30.864788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59673d74-c686-4bf9-a06b-8c6ba18b3b70 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:30.870020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25e2fe-2874-4921-8e60-b6c088eef91d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:30.870020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25e2fe-2874-4921-8e60-b6c088eef91d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:30.870020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25e2fe-2874-4921-8e60-b6c088eef91d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:30.870020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 185/360] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:30.875207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25e2fe-2874-4921-8e60-b6c088eef91d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:30.889029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:31.009307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59673d74-c686-4bf9-a06b-8c6ba18b3b70 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:31.016775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25e2fe-2874-4921-8e60-b6c088eef91d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:31.049341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:31.055379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e0822-8b49-4c3c-8993-b9f9e7ef2bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:31.056129 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e0822-8b49-4c3c-8993-b9f9e7ef2bce None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:31.056407 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e0822-8b49-4c3c-8993-b9f9e7ef2bce None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:31.056678 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e0822-8b49-4c3c-8993-b9f9e7ef2bce None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:31.058015 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e0822-8b49-4c3c-8993-b9f9e7ef2bce None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:31.059548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e0822-8b49-4c3c-8993-b9f9e7ef2bce None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:31.061247 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 176/361] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:30 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:31.065975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e0822-8b49-4c3c-8993-b9f9e7ef2bce None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:31.072668 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024edff-6a02-4d72-896b-48e9eb590eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:31.073560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024edff-6a02-4d72-896b-48e9eb590eaa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:31.074055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024edff-6a02-4d72-896b-48e9eb590eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:31.075039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024edff-6a02-4d72-896b-48e9eb590eaa None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:31.075962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024edff-6a02-4d72-896b-48e9eb590eaa None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:31.076431 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024edff-6a02-4d72-896b-48e9eb590eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:31.078039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024edff-6a02-4d72-896b-48e9eb590eaa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:31.089879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 186/362] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:31.090811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62abce-424b-43aa-91f8-ec8628529067 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:31.091102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62abce-424b-43aa-91f8-ec8628529067 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:31.091372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62abce-424b-43aa-91f8-ec8628529067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:31.112383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3c62abce-424b-43aa-91f8-ec8628529067 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:31.113709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3c62abce-424b-43aa-91f8-ec8628529067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:31.170455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:31.192596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e0822-8b49-4c3c-8993-b9f9e7ef2bce None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:31.195302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 187/363] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:31.196035 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62abce-424b-43aa-91f8-ec8628529067 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:31.231246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772a4ad-ad19-410b-9372-867fd65892ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:31.232135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772a4ad-ad19-410b-9372-867fd65892ab None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:31.232547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772a4ad-ad19-410b-9372-867fd65892ab None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:31.233036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772a4ad-ad19-410b-9372-867fd65892ab None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:31.233888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772a4ad-ad19-410b-9372-867fd65892ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:31.234378 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772a4ad-ad19-410b-9372-867fd65892ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:31.235937 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772a4ad-ad19-410b-9372-867fd65892ab None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:31.245046 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 177/364] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:31.246162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772a4ad-ad19-410b-9372-867fd65892ab None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:31.330751 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62abce-424b-43aa-91f8-ec8628529067 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:31.351618 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:31.378751 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb91af2-a10e-466e-a36d-f5fe6efa81f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:31.380564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb91af2-a10e-466e-a36d-f5fe6efa81f8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:31.381183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb91af2-a10e-466e-a36d-f5fe6efa81f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:31.381620 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb91af2-a10e-466e-a36d-f5fe6efa81f8 None admin] PATH_INFO: `/v3/groups/dadefdc03fe848e09048bc5d111ee09b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:31.383086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb91af2-a10e-466e-a36d-f5fe6efa81f8 None admin] RBAC: Authorizing `identity:get_group(group_id=dadefdc03fe848e09048bc5d111ee09b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:31.384315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772a4ad-ad19-410b-9372-867fd65892ab None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:31.384975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb91af2-a10e-466e-a36d-f5fe6efa81f8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:31.390118 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 188/365] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Aug 30 04:56:31 2022] GET /identity/v3/groups/dadefdc03fe848e09048bc5d111ee09b => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:31.390808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb91af2-a10e-466e-a36d-f5fe6efa81f8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:31.437072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9140e-8d93-44c9-9d49-7db2646c26bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:31.438190 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9140e-8d93-44c9-9d49-7db2646c26bc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:31.439078 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9140e-8d93-44c9-9d49-7db2646c26bc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:31.439832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9140e-8d93-44c9-9d49-7db2646c26bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:31.461565 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:31.528442 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb91af2-a10e-466e-a36d-f5fe6efa81f8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:31.539372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9140e-8d93-44c9-9d49-7db2646c26bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:31.541537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9140e-8d93-44c9-9d49-7db2646c26bc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:31.586960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627dc22-5475-4762-9e76-fb7d123e7ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:31.587493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627dc22-5475-4762-9e76-fb7d123e7ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:31.588199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627dc22-5475-4762-9e76-fb7d123e7ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:31.588199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627dc22-5475-4762-9e76-fb7d123e7ab4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:31.657312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:31.674112 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 178/366] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:31.675044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9140e-8d93-44c9-9d49-7db2646c26bc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:31.687873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627dc22-5475-4762-9e76-fb7d123e7ab4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:31.689388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627dc22-5475-4762-9e76-fb7d123e7ab4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:31.735596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:31.810100 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9140e-8d93-44c9-9d49-7db2646c26bc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:31.832082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 189/367] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:31.832082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627dc22-5475-4762-9e76-fb7d123e7ab4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:31.855995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32406c-6e2e-48c4-982a-192b15108847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:31.856946 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32406c-6e2e-48c4-982a-192b15108847 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:31.857450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32406c-6e2e-48c4-982a-192b15108847 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:31.857936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32406c-6e2e-48c4-982a-192b15108847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:31.858869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32406c-6e2e-48c4-982a-192b15108847 None admin] RBAC: Adding query filter params (group.id=dadefdc03fe848e09048bc5d111ee09b, role.id=1201453b538f4257a1dc8723d67c0cdd, scope.project.id=aa51b8e01e6242dcb98f562872154655) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:31.859244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32406c-6e2e-48c4-982a-192b15108847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:31.860797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32406c-6e2e-48c4-982a-192b15108847 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:31.872152 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 179/368] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Aug 30 04:56:31 2022] GET /identity/v3/role_assignments?group.id=dadefdc03fe848e09048bc5d111ee09b&scope.project.id=aa51b8e01e6242dcb98f562872154655&role.id=1201453b538f4257a1dc8723d67c0cdd => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:31.873633 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32406c-6e2e-48c4-982a-192b15108847 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:31.946502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:31.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627dc22-5475-4762-9e76-fb7d123e7ab4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:32.010011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32406c-6e2e-48c4-982a-192b15108847 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:32.025483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:32.029413 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8d08e-536f-456a-be04-5a6730b54ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:32.031473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8d08e-536f-456a-be04-5a6730b54ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:32.031839 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8d08e-536f-456a-be04-5a6730b54ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:32.032209 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8d08e-536f-456a-be04-5a6730b54ec7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:32.052729 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8d08e-536f-456a-be04-5a6730b54ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c2d8d08e-536f-456a-be04-5a6730b54ec7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:32.058054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:32.059549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:32.060384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:32.060384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:32.060384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:32.060384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:32.060384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:32.060384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:32.060384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:32.060384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:32.060384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:32.060384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:32.060384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:56:32.060384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:32.061716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45292c9a-1600-4a82-a5f4-721a025e8531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:32.062360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45292c9a-1600-4a82-a5f4-721a025e8531 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:32.062636 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45292c9a-1600-4a82-a5f4-721a025e8531 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:32.062907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45292c9a-1600-4a82-a5f4-721a025e8531 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:32.065546 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45292c9a-1600-4a82-a5f4-721a025e8531 None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:32.066050 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 190/369] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:56:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:32.067175 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8d08e-536f-456a-be04-5a6730b54ec7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:32.068455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45292c9a-1600-4a82-a5f4-721a025e8531 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:32.070341 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 180/370] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:31 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:32.071677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45292c9a-1600-4a82-a5f4-721a025e8531 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:32.200995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45292c9a-1600-4a82-a5f4-721a025e8531 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:32.204159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8d08e-536f-456a-be04-5a6730b54ec7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:32.248602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97893e-6e52-410f-b25d-d6bc66912756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:32.249531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439e3a1-a5ea-4b46-b50c-ca9631d5de8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:32.249895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97893e-6e52-410f-b25d-d6bc66912756 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:32.250164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439e3a1-a5ea-4b46-b50c-ca9631d5de8a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:32.250438 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439e3a1-a5ea-4b46-b50c-ca9631d5de8a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:32.250708 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439e3a1-a5ea-4b46-b50c-ca9631d5de8a None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:32.251013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97893e-6e52-410f-b25d-d6bc66912756 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:32.251549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97893e-6e52-410f-b25d-d6bc66912756 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:32.251848 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439e3a1-a5ea-4b46-b50c-ca9631d5de8a None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:32.252635 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97893e-6e52-410f-b25d-d6bc66912756 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:32.253133 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97893e-6e52-410f-b25d-d6bc66912756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:32.253338 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439e3a1-a5ea-4b46-b50c-ca9631d5de8a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:32.254984 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97893e-6e52-410f-b25d-d6bc66912756 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:32.255096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 191/371] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:32 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:32.256192 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439e3a1-a5ea-4b46-b50c-ca9631d5de8a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:32.266967 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 181/372] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:32.272910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97893e-6e52-410f-b25d-d6bc66912756 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:32.277493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:32.326984 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:32.395461 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439e3a1-a5ea-4b46-b50c-ca9631d5de8a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:32.412236 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97893e-6e52-410f-b25d-d6bc66912756 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:32.443619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16165e-0b87-4ab5-86ab-abce778bf042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:32.444793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16165e-0b87-4ab5-86ab-abce778bf042 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:32.444793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16165e-0b87-4ab5-86ab-abce778bf042 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:32.444793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16165e-0b87-4ab5-86ab-abce778bf042 None admin] PATH_INFO: `/v3/groups/dadefdc03fe848e09048bc5d111ee09b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:32.445948 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16165e-0b87-4ab5-86ab-abce778bf042 None admin] RBAC: Authorizing `identity:get_group(group_id=dadefdc03fe848e09048bc5d111ee09b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:32.447388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16165e-0b87-4ab5-86ab-abce778bf042 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:32.449173 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 192/373] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Aug 30 04:56:32 2022] GET /identity/v3/groups/dadefdc03fe848e09048bc5d111ee09b => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:32.450328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16165e-0b87-4ab5-86ab-abce778bf042 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:32.464266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb36e2-2eb3-4f53-89bd-e61324468098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:32.465267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb36e2-2eb3-4f53-89bd-e61324468098 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:32.465760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb36e2-2eb3-4f53-89bd-e61324468098 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:32.466250 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb36e2-2eb3-4f53-89bd-e61324468098 None admin] PATH_INFO: `/v3/groups/dadefdc03fe848e09048bc5d111ee09b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:32.468501 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb36e2-2eb3-4f53-89bd-e61324468098 None admin] RBAC: Authorizing `identity:get_group(group_id=dadefdc03fe848e09048bc5d111ee09b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:32.470466 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb36e2-2eb3-4f53-89bd-e61324468098 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:32.473443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 182/374] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Aug 30 04:56:32 2022] GET /identity/v3/groups/dadefdc03fe848e09048bc5d111ee09b => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:32.474785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb36e2-2eb3-4f53-89bd-e61324468098 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:32.556999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:32.584739 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16165e-0b87-4ab5-86ab-abce778bf042 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:32.616428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb36e2-2eb3-4f53-89bd-e61324468098 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:32.628517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a360a0c-ddcc-47ad-a517-a880821bf1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:32.629476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a360a0c-ddcc-47ad-a517-a880821bf1ce None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:32.629973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a360a0c-ddcc-47ad-a517-a880821bf1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:32.630702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a360a0c-ddcc-47ad-a517-a880821bf1ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:32.631149 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:32.673546 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1ca3e-7dfa-4f1f-be2e-3e88795ee8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:32.674157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1ca3e-7dfa-4f1f-be2e-3e88795ee8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:32.674429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1ca3e-7dfa-4f1f-be2e-3e88795ee8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:32.674754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1ca3e-7dfa-4f1f-be2e-3e88795ee8b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:32.675547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1ca3e-7dfa-4f1f-be2e-3e88795ee8b8 None admin] RBAC: Adding query filter params (group.id=dadefdc03fe848e09048bc5d111ee09b, role.id=b0fa1b252ab74641b309e4a3d6aacc68, scope.project.id=01a8779a6dd0442da92e2069510aded8) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:32.675855 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1ca3e-7dfa-4f1f-be2e-3e88795ee8b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:32.677310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1ca3e-7dfa-4f1f-be2e-3e88795ee8b8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:32.683973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 183/375] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Aug 30 04:56:32 2022] GET /identity/v3/role_assignments?group.id=dadefdc03fe848e09048bc5d111ee09b&scope.project.id=01a8779a6dd0442da92e2069510aded8&role.id=b0fa1b252ab74641b309e4a3d6aacc68 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:32.688763 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1ca3e-7dfa-4f1f-be2e-3e88795ee8b8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:32.722964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a360a0c-ddcc-47ad-a517-a880821bf1ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:32.724905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a360a0c-ddcc-47ad-a517-a880821bf1ce None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:32.830854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:32.852681 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1ca3e-7dfa-4f1f-be2e-3e88795ee8b8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:32.864893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 193/376] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:32.867494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a6470-e4f5-401c-895a-5768659ac060 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:32.868049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a6470-e4f5-401c-895a-5768659ac060 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:32.868788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a6470-e4f5-401c-895a-5768659ac060 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:32.871680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 194/377] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:32.873149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a6470-e4f5-401c-895a-5768659ac060 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:32.903928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb15ccb-2407-4067-b15a-ff730df9849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:32.904569 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb15ccb-2407-4067-b15a-ff730df9849c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:32.904841 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb15ccb-2407-4067-b15a-ff730df9849c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:32.905106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb15ccb-2407-4067-b15a-ff730df9849c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:32.905839 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb15ccb-2407-4067-b15a-ff730df9849c None admin] RBAC: Adding query filter params (group.id=dadefdc03fe848e09048bc5d111ee09b, role.id=1201453b538f4257a1dc8723d67c0cdd, scope.project.id=01a8779a6dd0442da92e2069510aded8) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:32.906139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb15ccb-2407-4067-b15a-ff730df9849c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:32.907584 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb15ccb-2407-4067-b15a-ff730df9849c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:32.914633 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 184/378] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Aug 30 04:56:32 2022] GET /identity/v3/role_assignments?group.id=dadefdc03fe848e09048bc5d111ee09b&scope.project.id=01a8779a6dd0442da92e2069510aded8&role.id=1201453b538f4257a1dc8723d67c0cdd => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:32.915685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8864e7-ea8a-43e6-ac44-aaab77c1fb07 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:32.915995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8864e7-ea8a-43e6-ac44-aaab77c1fb07 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:32.916312 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8864e7-ea8a-43e6-ac44-aaab77c1fb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:32.937418 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5b8864e7-ea8a-43e6-ac44-aaab77c1fb07 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:32.939174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5b8864e7-ea8a-43e6-ac44-aaab77c1fb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:32.982550 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:33.053615 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 185/379] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:33.080686 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a6470-e4f5-401c-895a-5768659ac060 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:33.133265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5b907-fdb7-4a7a-a891-9b26824a8f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:33.133913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5b907-fdb7-4a7a-a891-9b26824a8f20 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:33.134188 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5b907-fdb7-4a7a-a891-9b26824a8f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:33.134457 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5b907-fdb7-4a7a-a891-9b26824a8f20 None admin] PATH_INFO: `/v3/projects/30fb7a46e3a647738501ffab48bae602` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:33.135591 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5b907-fdb7-4a7a-a891-9b26824a8f20 None admin] RBAC: Authorizing `identity:get_project(project_id=30fb7a46e3a647738501ffab48bae602)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:33.137199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5b907-fdb7-4a7a-a891-9b26824a8f20 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:33.139266 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 195/380] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:32 2022] GET /identity/v3/projects/30fb7a46e3a647738501ffab48bae602 => generated 344 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:33.144850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8864e7-ea8a-43e6-ac44-aaab77c1fb07 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:33.254717 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8864e7-ea8a-43e6-ac44-aaab77c1fb07 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:33.290167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23368eff-d78a-4127-bbee-194deed2a52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:33.290808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23368eff-d78a-4127-bbee-194deed2a52c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:33.291081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23368eff-d78a-4127-bbee-194deed2a52c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:33.291351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23368eff-d78a-4127-bbee-194deed2a52c None admin] PATH_INFO: `/v3/groups/2cfe4ae853804d08b6e3a761adcc824b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:33.298314 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23368eff-d78a-4127-bbee-194deed2a52c None admin] RBAC: Authorizing `identity:get_group(group_id=2cfe4ae853804d08b6e3a761adcc824b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:33.299886 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23368eff-d78a-4127-bbee-194deed2a52c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:33.301929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 186/381] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Aug 30 04:56:33 2022] GET /identity/v3/groups/2cfe4ae853804d08b6e3a761adcc824b => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:33.307787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5b907-fdb7-4a7a-a891-9b26824a8f20 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:33.387963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:33.454139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5b907-fdb7-4a7a-a891-9b26824a8f20 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:33.501577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8942af-7e45-4116-b5f3-62ae05e0e0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:33.502189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8942af-7e45-4116-b5f3-62ae05e0e0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:33.502467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8942af-7e45-4116-b5f3-62ae05e0e0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:33.502740 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8942af-7e45-4116-b5f3-62ae05e0e0a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:33.503464 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8942af-7e45-4116-b5f3-62ae05e0e0a4 None admin] RBAC: Adding query filter params (group.id=2cfe4ae853804d08b6e3a761adcc824b, role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=30fb7a46e3a647738501ffab48bae602) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:33.503766 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8942af-7e45-4116-b5f3-62ae05e0e0a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:33.505577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8942af-7e45-4116-b5f3-62ae05e0e0a4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:33.513844 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23368eff-d78a-4127-bbee-194deed2a52c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:33.521000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 196/382] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Aug 30 04:56:33 2022] GET /identity/v3/role_assignments?group.id=2cfe4ae853804d08b6e3a761adcc824b&scope.project.id=30fb7a46e3a647738501ffab48bae602&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:33.566654 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:33.670847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23368eff-d78a-4127-bbee-194deed2a52c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:33.726114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94ba12-f3b6-40af-9dec-cf5cbaf4a765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:33.727132 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94ba12-f3b6-40af-9dec-cf5cbaf4a765 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:33.727687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94ba12-f3b6-40af-9dec-cf5cbaf4a765 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:33.728183 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94ba12-f3b6-40af-9dec-cf5cbaf4a765 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:33.740308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94ba12-f3b6-40af-9dec-cf5cbaf4a765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-6a94ba12-f3b6-40af-9dec-cf5cbaf4a765 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:33.746074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:33.747508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:33.748371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:33.748371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:33.748371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:33.748371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:33.748371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:33.748371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:33.748371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:33.748371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:33.748371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:33.748371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:33.748371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:33.748371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:33.750947 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 187/383] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:33.761092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8942af-7e45-4116-b5f3-62ae05e0e0a4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:33.910294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8942af-7e45-4116-b5f3-62ae05e0e0a4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:33.922932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:33.955470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef66fef-7c82-4534-a82a-ec043615e24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:33.956120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef66fef-7c82-4534-a82a-ec043615e24a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:33.956399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef66fef-7c82-4534-a82a-ec043615e24a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:33.956673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef66fef-7c82-4534-a82a-ec043615e24a None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:33.957344 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef66fef-7c82-4534-a82a-ec043615e24a None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:33.957645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef66fef-7c82-4534-a82a-ec043615e24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:33.959021 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef66fef-7c82-4534-a82a-ec043615e24a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:33.973642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 197/384] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:33.979333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94ba12-f3b6-40af-9dec-cf5cbaf4a765 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:34.174154 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:34.199003 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94ba12-f3b6-40af-9dec-cf5cbaf4a765 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:34.243482 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f0d44-1588-4e01-af80-ae5bbcc0141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:34.244157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f0d44-1588-4e01-af80-ae5bbcc0141f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:34.244441 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f0d44-1588-4e01-af80-ae5bbcc0141f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:34.244716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f0d44-1588-4e01-af80-ae5bbcc0141f None admin] PATH_INFO: `/v3/groups/dadefdc03fe848e09048bc5d111ee09b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:34.245856 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f0d44-1588-4e01-af80-ae5bbcc0141f None admin] RBAC: Authorizing `identity:get_group(group_id=dadefdc03fe848e09048bc5d111ee09b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:34.247365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f0d44-1588-4e01-af80-ae5bbcc0141f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:34.249283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 188/385] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Aug 30 04:56:33 2022] GET /identity/v3/groups/dadefdc03fe848e09048bc5d111ee09b => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:34.254605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef66fef-7c82-4534-a82a-ec043615e24a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:34.386924 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef66fef-7c82-4534-a82a-ec043615e24a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:34.426675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8ebfb-ea41-4b98-bc25-d01cda5e04a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:34.427224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8ebfb-ea41-4b98-bc25-d01cda5e04a7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:34.427500 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8ebfb-ea41-4b98-bc25-d01cda5e04a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:34.427760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8ebfb-ea41-4b98-bc25-d01cda5e04a7 None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:34.432637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8ebfb-ea41-4b98-bc25-d01cda5e04a7 None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:34.434378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8ebfb-ea41-4b98-bc25-d01cda5e04a7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:34.436365 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 198/386] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:34 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:34.441859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f0d44-1588-4e01-af80-ae5bbcc0141f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:34.466341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed715c3-4a4e-4435-8555-743d09d29a0d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:34.466841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed715c3-4a4e-4435-8555-743d09d29a0d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:34.466841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed715c3-4a4e-4435-8555-743d09d29a0d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:34.468482 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 199/387] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:56:34.473539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac61799-21ac-428a-9ae5-a4f3b7b449ae None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:34.473816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac61799-21ac-428a-9ae5-a4f3b7b449ae None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:34.474084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac61799-21ac-428a-9ae5-a4f3b7b449ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:34.507812 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fac61799-21ac-428a-9ae5-a4f3b7b449ae None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:34.509037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fac61799-21ac-428a-9ae5-a4f3b7b449ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:34.579196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f0d44-1588-4e01-af80-ae5bbcc0141f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:34.609535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:34.618895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad53ec3-799e-4741-9c84-b91ecefad7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:34.619648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad53ec3-799e-4741-9c84-b91ecefad7e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:34.620043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad53ec3-799e-4741-9c84-b91ecefad7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:34.620820 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad53ec3-799e-4741-9c84-b91ecefad7e2 None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655/groups/dadefdc03fe848e09048bc5d111ee09b/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:34.623215 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad53ec3-799e-4741-9c84-b91ecefad7e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa51b8e01e6242dcb98f562872154655, group_id=dadefdc03fe848e09048bc5d111ee09b, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:34.624710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad53ec3-799e-4741-9c84-b91ecefad7e2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:34.649047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 189/388] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Aug 30 04:56:34 2022] PUT /identity/v3/projects/aa51b8e01e6242dcb98f562872154655/groups/dadefdc03fe848e09048bc5d111ee09b/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:34.676837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 200/389] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:56:35.000599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad53ec3-799e-4741-9c84-b91ecefad7e2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:35.026735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:35.139391 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad53ec3-799e-4741-9c84-b91ecefad7e2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:35.177408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ac011-30d2-4d6b-bec3-fc89dfe6d499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:35.178043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ac011-30d2-4d6b-bec3-fc89dfe6d499 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:35.178317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ac011-30d2-4d6b-bec3-fc89dfe6d499 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:35.178584 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ac011-30d2-4d6b-bec3-fc89dfe6d499 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:35.189285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ac011-30d2-4d6b-bec3-fc89dfe6d499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-856ac011-30d2-4d6b-bec3-fc89dfe6d499 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:35.194658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:35.195761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:35.196882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:35.196882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:35.196882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:35.196882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:35.196882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:35.196882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:35.196882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:35.196882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:35.196882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:35.196882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:35.196882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:35.196882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:35.199081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 190/390] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:56:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:35.204637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac61799-21ac-428a-9ae5-a4f3b7b449ae None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:35.276350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2e2be-7ec2-4acb-a008-1ede24f8e4f4 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:35.276959 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2e2be-7ec2-4acb-a008-1ede24f8e4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:35.277970 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2e2be-7ec2-4acb-a008-1ede24f8e4f4 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:35.279837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 191/391] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:35.289334 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c947d7e-8607-4cb5-984b-6e9a8a2cf6bd None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:35.289982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c947d7e-8607-4cb5-984b-6e9a8a2cf6bd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:35.290451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c947d7e-8607-4cb5-984b-6e9a8a2cf6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:35.322932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3c947d7e-8607-4cb5-984b-6e9a8a2cf6bd None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:35.328244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3c947d7e-8607-4cb5-984b-6e9a8a2cf6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:35.343802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac61799-21ac-428a-9ae5-a4f3b7b449ae None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:35.384298 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79cbc0-4f9c-45b9-bbda-1dbb761f511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:35.384915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79cbc0-4f9c-45b9-bbda-1dbb761f511c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:35.385191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79cbc0-4f9c-45b9-bbda-1dbb761f511c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:35.385465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79cbc0-4f9c-45b9-bbda-1dbb761f511c None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:35.386132 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79cbc0-4f9c-45b9-bbda-1dbb761f511c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:35.386428 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79cbc0-4f9c-45b9-bbda-1dbb761f511c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:35.388387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79cbc0-4f9c-45b9-bbda-1dbb761f511c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:35.406692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 201/392] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:35.414271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79cbc0-4f9c-45b9-bbda-1dbb761f511c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:35.452727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 192/393] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:35.461979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:35.548428 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79cbc0-4f9c-45b9-bbda-1dbb761f511c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:35.583554 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f5f0d-5aa6-4b45-85e4-896d4eace1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:35.584213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f5f0d-5aa6-4b45-85e4-896d4eace1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:35.584491 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f5f0d-5aa6-4b45-85e4-896d4eace1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:35.584771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f5f0d-5aa6-4b45-85e4-896d4eace1c0 None admin] PATH_INFO: `/v3/groups/dadefdc03fe848e09048bc5d111ee09b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:35.585898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f5f0d-5aa6-4b45-85e4-896d4eace1c0 None admin] RBAC: Authorizing `identity:get_group(group_id=dadefdc03fe848e09048bc5d111ee09b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:35.587330 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f5f0d-5aa6-4b45-85e4-896d4eace1c0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:35.589255 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 202/394] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Aug 30 04:56:35 2022] GET /identity/v3/groups/dadefdc03fe848e09048bc5d111ee09b => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:35.595268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c947d7e-8607-4cb5-984b-6e9a8a2cf6bd None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:35.610331 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874dbdd-57b2-4a7b-8e75-b77c8335d495 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:35.610617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874dbdd-57b2-4a7b-8e75-b77c8335d495 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:35.610893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874dbdd-57b2-4a7b-8e75-b77c8335d495 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:35.612312 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:35.612580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 203/395] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:56:35.618776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c75da-4036-4aba-8f1e-de2d7055f3a4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:35.619056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c75da-4036-4aba-8f1e-de2d7055f3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:35.619328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c75da-4036-4aba-8f1e-de2d7055f3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:35.644818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e39c75da-4036-4aba-8f1e-de2d7055f3a4 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:35.646093 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e39c75da-4036-4aba-8f1e-de2d7055f3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:35.727602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 204/396] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:56:35.762460 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c947d7e-8607-4cb5-984b-6e9a8a2cf6bd None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:35.785560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c75da-4036-4aba-8f1e-de2d7055f3a4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:35.802500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa22ac3-726c-4bae-821c-8c85de13d2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:35.803061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa22ac3-726c-4bae-821c-8c85de13d2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:35.803342 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa22ac3-726c-4bae-821c-8c85de13d2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:35.803612 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa22ac3-726c-4bae-821c-8c85de13d2a2 None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:35.805563 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa22ac3-726c-4bae-821c-8c85de13d2a2 None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:35.807336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa22ac3-726c-4bae-821c-8c85de13d2a2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:35.809203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 193/397] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:35 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:35.814584 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa22ac3-726c-4bae-821c-8c85de13d2a2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:35.833585 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:35.952969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:35.969952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c75da-4036-4aba-8f1e-de2d7055f3a4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:35.997732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa22ac3-726c-4bae-821c-8c85de13d2a2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:36.021189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2d608-6585-41a2-b3d1-414bf5b62dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:36.022621 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2d608-6585-41a2-b3d1-414bf5b62dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:36.023106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2d608-6585-41a2-b3d1-414bf5b62dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:36.023886 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2d608-6585-41a2-b3d1-414bf5b62dc6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:36.041444 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2d608-6585-41a2-b3d1-414bf5b62dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:36.046055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59266dad-86ee-45a5-8f27-e61fedd5e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:36.046739 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59266dad-86ee-45a5-8f27-e61fedd5e0db None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:36.047021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59266dad-86ee-45a5-8f27-e61fedd5e0db None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:36.047289 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59266dad-86ee-45a5-8f27-e61fedd5e0db None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655/groups/dadefdc03fe848e09048bc5d111ee09b/roles/1201453b538f4257a1dc8723d67c0cdd` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-04e2d608-6585-41a2-b3d1-414bf5b62dc6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:36.047540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:36.049108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:36.050524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:36.050524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:36.050524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:36.050524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:36.050524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:36.050524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:36.050524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:36.050524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:36.050524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:36.050524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:36.050524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:36.050524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:36.050524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 205/398] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:36.050524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ffc9b-a21b-46a2-a3f3-7eeab472dd1c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:36.051307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ffc9b-a21b-46a2-a3f3-7eeab472dd1c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:36.051307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ffc9b-a21b-46a2-a3f3-7eeab472dd1c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:36.056237 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 206/399] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:36.056237 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ffc9b-a21b-46a2-a3f3-7eeab472dd1c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:36.056865 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59266dad-86ee-45a5-8f27-e61fedd5e0db None admin] RBAC: Authorizing `identity:create_grant(project_id=aa51b8e01e6242dcb98f562872154655, group_id=dadefdc03fe848e09048bc5d111ee09b, role_id=1201453b538f4257a1dc8723d67c0cdd)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:36.056865 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59266dad-86ee-45a5-8f27-e61fedd5e0db None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:36.071938 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 194/400] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Aug 30 04:56:35 2022] PUT /identity/v3/projects/aa51b8e01e6242dcb98f562872154655/groups/dadefdc03fe848e09048bc5d111ee09b/roles/1201453b538f4257a1dc8723d67c0cdd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:56:36.074044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5535ff-8c3f-48b7-950b-6fe8e0a03911 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:36.074700 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5535ff-8c3f-48b7-950b-6fe8e0a03911 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:36.075110 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5535ff-8c3f-48b7-950b-6fe8e0a03911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:36.109659 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-df5535ff-8c3f-48b7-950b-6fe8e0a03911 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:36.111718 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-df5535ff-8c3f-48b7-950b-6fe8e0a03911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:36.173785 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:36.187223 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ffc9b-a21b-46a2-a3f3-7eeab472dd1c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:36.228711 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 195/401] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:36.229798 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5535ff-8c3f-48b7-950b-6fe8e0a03911 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:36.234219 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37448827-a05c-4ef0-ae4d-c0b3f5ed4c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:36.234858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448827-a05c-4ef0-ae4d-c0b3f5ed4c57 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:36.235127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448827-a05c-4ef0-ae4d-c0b3f5ed4c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:36.235392 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448827-a05c-4ef0-ae4d-c0b3f5ed4c57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:36.254673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37448827-a05c-4ef0-ae4d-c0b3f5ed4c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-37448827-a05c-4ef0-ae4d-c0b3f5ed4c57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:36.262113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:36.263059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:36.263915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:36.263915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:36.263915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:36.263915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:36.263915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:36.263915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:36.263915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:36.263915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:36.263915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:36.263915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:36.263915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:36.263915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:36.264581 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 207/402] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:56:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:36.277150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37448827-a05c-4ef0-ae4d-c0b3f5ed4c57 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:36.381114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:36.436538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37448827-a05c-4ef0-ae4d-c0b3f5ed4c57 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:36.468989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5535ff-8c3f-48b7-950b-6fe8e0a03911 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:36.488654 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cb5b4-101a-4030-90bd-ed20680a129e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:36.489262 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cb5b4-101a-4030-90bd-ed20680a129e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:36.489593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cb5b4-101a-4030-90bd-ed20680a129e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:36.489789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cb5b4-101a-4030-90bd-ed20680a129e None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:36.490528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cb5b4-101a-4030-90bd-ed20680a129e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:36.490828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cb5b4-101a-4030-90bd-ed20680a129e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:36.492227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cb5b4-101a-4030-90bd-ed20680a129e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:36.510920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 208/403] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:36.517618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a29d2a-9335-4cf6-a8d4-3c4d0236e238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:36.519578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cb5b4-101a-4030-90bd-ed20680a129e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:36.520607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a29d2a-9335-4cf6-a8d4-3c4d0236e238 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:36.521330 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a29d2a-9335-4cf6-a8d4-3c4d0236e238 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:36.522020 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a29d2a-9335-4cf6-a8d4-3c4d0236e238 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:36.523338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a29d2a-9335-4cf6-a8d4-3c4d0236e238 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:36.524125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a29d2a-9335-4cf6-a8d4-3c4d0236e238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:36.527058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a29d2a-9335-4cf6-a8d4-3c4d0236e238 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:36.542465 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 196/404] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:36.544334 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a29d2a-9335-4cf6-a8d4-3c4d0236e238 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:36.545946 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:36.682015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cb5b4-101a-4030-90bd-ed20680a129e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:36.706154 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a29d2a-9335-4cf6-a8d4-3c4d0236e238 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:36.735180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863635a-c6fe-45f6-b5db-5941498f918d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:36.736188 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863635a-c6fe-45f6-b5db-5941498f918d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:36.736654 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863635a-c6fe-45f6-b5db-5941498f918d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:36.737230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863635a-c6fe-45f6-b5db-5941498f918d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:36.754015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863635a-c6fe-45f6-b5db-5941498f918d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b863635a-c6fe-45f6-b5db-5941498f918d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:36.764558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:36.766261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:36.767842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:36.767842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:36.767842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:36.767842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:36.767842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:36.767842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:36.767842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:36.767842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:36.767842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:36.767842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:36.767842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:56:36.767842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:36.767842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 209/405] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:56:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:56:36.767842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863635a-c6fe-45f6-b5db-5941498f918d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:36.771442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6516cdf-24ea-49d1-b383-f38c0c3bf722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:36.771442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6516cdf-24ea-49d1-b383-f38c0c3bf722 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:36.771442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6516cdf-24ea-49d1-b383-f38c0c3bf722 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:36.771442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6516cdf-24ea-49d1-b383-f38c0c3bf722 None admin] PATH_INFO: `/v3/groups/dadefdc03fe848e09048bc5d111ee09b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:36.776799 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6516cdf-24ea-49d1-b383-f38c0c3bf722 None admin] RBAC: Authorizing `identity:get_group(group_id=dadefdc03fe848e09048bc5d111ee09b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:36.779671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6516cdf-24ea-49d1-b383-f38c0c3bf722 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:36.787978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:36.790001 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 197/406] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Aug 30 04:56:36 2022] GET /identity/v3/groups/dadefdc03fe848e09048bc5d111ee09b => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:36.790428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6516cdf-24ea-49d1-b383-f38c0c3bf722 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:36.882165 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:36.931464 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863635a-c6fe-45f6-b5db-5941498f918d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:36.962538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6516cdf-24ea-49d1-b383-f38c0c3bf722 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:36.987471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ae2ba-de03-400e-9b28-6cf6e04c3f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:36.988178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ae2ba-de03-400e-9b28-6cf6e04c3f94 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:36.988450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ae2ba-de03-400e-9b28-6cf6e04c3f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:36.988721 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ae2ba-de03-400e-9b28-6cf6e04c3f94 None admin] PATH_INFO: `/v3/groups/dadefdc03fe848e09048bc5d111ee09b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:36.989950 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ae2ba-de03-400e-9b28-6cf6e04c3f94 None admin] RBAC: Authorizing `identity:get_group(group_id=dadefdc03fe848e09048bc5d111ee09b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:36.991396 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ae2ba-de03-400e-9b28-6cf6e04c3f94 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:36.993289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 210/407] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Aug 30 04:56:36 2022] GET /identity/v3/groups/dadefdc03fe848e09048bc5d111ee09b => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:36.994122 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ae2ba-de03-400e-9b28-6cf6e04c3f94 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:37.013253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62652f59-dbb2-452c-b8f1-5caeb46e3d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:37.014334 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62652f59-dbb2-452c-b8f1-5caeb46e3d5a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:37.014910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62652f59-dbb2-452c-b8f1-5caeb46e3d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:37.015375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62652f59-dbb2-452c-b8f1-5caeb46e3d5a None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:37.016342 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62652f59-dbb2-452c-b8f1-5caeb46e3d5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:37.016846 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62652f59-dbb2-452c-b8f1-5caeb46e3d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:37.018575 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62652f59-dbb2-452c-b8f1-5caeb46e3d5a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:37.027991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 198/408] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:37.029106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62652f59-dbb2-452c-b8f1-5caeb46e3d5a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:37.100702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ae2ba-de03-400e-9b28-6cf6e04c3f94 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:37.101876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:37.137284 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b17f43-e4b2-4661-9857-09726e512379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:37.137918 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b17f43-e4b2-4661-9857-09726e512379 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:37.138194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b17f43-e4b2-4661-9857-09726e512379 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:37.138465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b17f43-e4b2-4661-9857-09726e512379 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:37.139594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b17f43-e4b2-4661-9857-09726e512379 None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:37.141059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b17f43-e4b2-4661-9857-09726e512379 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:37.142668 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 211/409] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:36 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:37.143415 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b17f43-e4b2-4661-9857-09726e512379 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:37.154873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:37.158417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62652f59-dbb2-452c-b8f1-5caeb46e3d5a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:37.205399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acbdd1-6b63-4416-8de4-00ac47454bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:37.206942 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acbdd1-6b63-4416-8de4-00ac47454bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:37.207389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acbdd1-6b63-4416-8de4-00ac47454bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:37.207813 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acbdd1-6b63-4416-8de4-00ac47454bb0 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:37.209315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acbdd1-6b63-4416-8de4-00ac47454bb0 None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:37.210969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acbdd1-6b63-4416-8de4-00ac47454bb0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:37.212969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 199/410] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:37 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:37.214318 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47510a-9ad8-43b6-bdb3-af254d177e0e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:37.214595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47510a-9ad8-43b6-bdb3-af254d177e0e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:37.214901 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47510a-9ad8-43b6-bdb3-af254d177e0e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:37.220069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 200/411] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:37.220069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47510a-9ad8-43b6-bdb3-af254d177e0e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:37.256863 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b17f43-e4b2-4661-9857-09726e512379 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:37.294899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70e3da-7aac-41fb-9934-bc09a432811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:37.295529 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70e3da-7aac-41fb-9934-bc09a432811a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:37.295805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70e3da-7aac-41fb-9934-bc09a432811a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:37.296090 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70e3da-7aac-41fb-9934-bc09a432811a None admin] PATH_INFO: `/v3/groups/2cfe4ae853804d08b6e3a761adcc824b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:37.297292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70e3da-7aac-41fb-9934-bc09a432811a None admin] RBAC: Authorizing `identity:get_group(group_id=2cfe4ae853804d08b6e3a761adcc824b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:37.298631 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70e3da-7aac-41fb-9934-bc09a432811a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:37.300241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 212/412] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Aug 30 04:56:37 2022] GET /identity/v3/groups/2cfe4ae853804d08b6e3a761adcc824b => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:37.300973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70e3da-7aac-41fb-9934-bc09a432811a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:37.332436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47510a-9ad8-43b6-bdb3-af254d177e0e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:37.363879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:37.374505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cef80d-757e-423d-b449-68c709b86cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:37.375156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cef80d-757e-423d-b449-68c709b86cfa None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:37.375429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cef80d-757e-423d-b449-68c709b86cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:37.375981 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cef80d-757e-423d-b449-68c709b86cfa None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8/groups/dadefdc03fe848e09048bc5d111ee09b/roles/1201453b538f4257a1dc8723d67c0cdd` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:37.377879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cef80d-757e-423d-b449-68c709b86cfa None admin] RBAC: Authorizing `identity:create_grant(project_id=01a8779a6dd0442da92e2069510aded8, group_id=dadefdc03fe848e09048bc5d111ee09b, role_id=1201453b538f4257a1dc8723d67c0cdd)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:37.379300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cef80d-757e-423d-b449-68c709b86cfa None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:37.388267 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:37.406422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 201/413] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Aug 30 04:56:37 2022] PUT /identity/v3/projects/01a8779a6dd0442da92e2069510aded8/groups/dadefdc03fe848e09048bc5d111ee09b/roles/1201453b538f4257a1dc8723d67c0cdd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:37.406422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d1c43-94b8-4bcb-91e4-edf26df729e3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:37.406422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d1c43-94b8-4bcb-91e4-edf26df729e3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:37.406422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d1c43-94b8-4bcb-91e4-edf26df729e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:37.427141 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9a9d1c43-94b8-4bcb-91e4-edf26df729e3 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:37.428672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9a9d1c43-94b8-4bcb-91e4-edf26df729e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:37.431185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70e3da-7aac-41fb-9934-bc09a432811a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:37.469545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a12aa-eedb-4893-8d22-891bb072ced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:37.470129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a12aa-eedb-4893-8d22-891bb072ced0 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:37.470402 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a12aa-eedb-4893-8d22-891bb072ced0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:37.470671 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a12aa-eedb-4893-8d22-891bb072ced0 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8/groups/dadefdc03fe848e09048bc5d111ee09b/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:37.472647 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a12aa-eedb-4893-8d22-891bb072ced0 None admin] RBAC: Authorizing `identity:create_grant(project_id=01a8779a6dd0442da92e2069510aded8, group_id=dadefdc03fe848e09048bc5d111ee09b, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:37.474319 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a12aa-eedb-4893-8d22-891bb072ced0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:37.495690 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 213/414] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Aug 30 04:56:37 2022] PUT /identity/v3/projects/01a8779a6dd0442da92e2069510aded8/groups/dadefdc03fe848e09048bc5d111ee09b/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:37.497197 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a12aa-eedb-4893-8d22-891bb072ced0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:37.547224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 202/415] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:37.643900 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a12aa-eedb-4893-8d22-891bb072ced0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:37.681890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcab63-4b99-44dc-81b6-22a4b283eb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:37.682535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcab63-4b99-44dc-81b6-22a4b283eb8d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:37.683057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcab63-4b99-44dc-81b6-22a4b283eb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:37.683057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcab63-4b99-44dc-81b6-22a4b283eb8d None admin] PATH_INFO: `/v3/projects/30fb7a46e3a647738501ffab48bae602` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:37.684822 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcab63-4b99-44dc-81b6-22a4b283eb8d None admin] RBAC: Authorizing `identity:get_project(project_id=30fb7a46e3a647738501ffab48bae602)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:37.686243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcab63-4b99-44dc-81b6-22a4b283eb8d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:37.688230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 214/416] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:37 2022] GET /identity/v3/projects/30fb7a46e3a647738501ffab48bae602 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:37.694017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d1c43-94b8-4bcb-91e4-edf26df729e3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:37.815843 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d1c43-94b8-4bcb-91e4-edf26df729e3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:37.837974 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:37.860639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0015724-bb23-48d5-beb5-a83d316902bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:37.861300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0015724-bb23-48d5-beb5-a83d316902bc None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:37.861571 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0015724-bb23-48d5-beb5-a83d316902bc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:37.861836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0015724-bb23-48d5-beb5-a83d316902bc None admin] PATH_INFO: `/v3/projects/30fb7a46e3a647738501ffab48bae602/groups/2cfe4ae853804d08b6e3a761adcc824b/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:37.863795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0015724-bb23-48d5-beb5-a83d316902bc None admin] RBAC: Authorizing `identity:create_grant(project_id=30fb7a46e3a647738501ffab48bae602, group_id=2cfe4ae853804d08b6e3a761adcc824b, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:37.865268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0015724-bb23-48d5-beb5-a83d316902bc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:37.892644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 203/417] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Aug 30 04:56:37 2022] PUT /identity/v3/projects/30fb7a46e3a647738501ffab48bae602/groups/2cfe4ae853804d08b6e3a761adcc824b/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:37.939902 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcab63-4b99-44dc-81b6-22a4b283eb8d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:37.944296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:38.084553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcab63-4b99-44dc-81b6-22a4b283eb8d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:38.100767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84872e2c-caf8-48c1-a118-6212b8a438a7 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:38.101047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84872e2c-caf8-48c1-a118-6212b8a438a7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:38.101307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84872e2c-caf8-48c1-a118-6212b8a438a7 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:38.102644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 204/418] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:38.109983 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842c80c-9868-4668-aba9-cb1f78f81a93 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:38.110263 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842c80c-9868-4668-aba9-cb1f78f81a93 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:38.110533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842c80c-9868-4668-aba9-cb1f78f81a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:38.133101 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c07c8e-ede7-4950-ad38-2ec7c5044012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:38.133752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c07c8e-ede7-4950-ad38-2ec7c5044012 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:38.134029 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c07c8e-ede7-4950-ad38-2ec7c5044012 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:38.134303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c07c8e-ede7-4950-ad38-2ec7c5044012 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:38.139969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e842c80c-9868-4668-aba9-cb1f78f81a93 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:38.141190 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e842c80c-9868-4668-aba9-cb1f78f81a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:38.153486 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c07c8e-ede7-4950-ad38-2ec7c5044012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-75c07c8e-ede7-4950-ad38-2ec7c5044012 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:38.158913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:38.159871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:38.160929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:38.160929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:38.160929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:38.160929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:38.160929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:38.160929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:38.160929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:38.160929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:38.160929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:38.160929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:38.160929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:38.160929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:38.160929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 215/419] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:38.166184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c07c8e-ede7-4950-ad38-2ec7c5044012 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:38.223492 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 205/420] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:38.278254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:38.331205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c07c8e-ede7-4950-ad38-2ec7c5044012 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:38.377831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bdf08-4f27-41d2-ad6b-8daa872a88bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:38.378437 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bdf08-4f27-41d2-ad6b-8daa872a88bc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:38.378710 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bdf08-4f27-41d2-ad6b-8daa872a88bc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:38.378977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bdf08-4f27-41d2-ad6b-8daa872a88bc None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:38.379637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bdf08-4f27-41d2-ad6b-8daa872a88bc None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:38.379933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bdf08-4f27-41d2-ad6b-8daa872a88bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:38.381648 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bdf08-4f27-41d2-ad6b-8daa872a88bc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:38.390962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 216/421] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:38.396204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842c80c-9868-4668-aba9-cb1f78f81a93 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:38.531452 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bdf08-4f27-41d2-ad6b-8daa872a88bc None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:38.534013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842c80c-9868-4668-aba9-cb1f78f81a93 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:38.541628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:38.595067 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379803d-8a3b-493d-8348-d3b81e0286ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:38.595692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379803d-8a3b-493d-8348-d3b81e0286ab None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:38.595978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379803d-8a3b-493d-8348-d3b81e0286ab None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:38.596229 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379803d-8a3b-493d-8348-d3b81e0286ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:38.709605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bdf08-4f27-41d2-ad6b-8daa872a88bc None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:38.721726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379803d-8a3b-493d-8348-d3b81e0286ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:38.723195 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379803d-8a3b-493d-8348-d3b81e0286ab None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:38.760798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:38.776625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43347f66-5a61-4ff2-97eb-c0660222f66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:38.777566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43347f66-5a61-4ff2-97eb-c0660222f66c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:38.778451 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43347f66-5a61-4ff2-97eb-c0660222f66c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:38.778723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43347f66-5a61-4ff2-97eb-c0660222f66c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:38.800737 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43347f66-5a61-4ff2-97eb-c0660222f66c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-43347f66-5a61-4ff2-97eb-c0660222f66c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:38.806141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:38.807003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:38.807815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:38.807815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:38.807815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:38.807815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:38.807815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:38.807815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:38.807815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:38.807815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:38.807815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:38.807815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:38.807815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:38.807815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:38.809706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 217/422] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:56:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:38.813850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43347f66-5a61-4ff2-97eb-c0660222f66c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:38.924187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 206/423] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:38.930208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379803d-8a3b-493d-8348-d3b81e0286ab None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:38.943989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:39.029295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43347f66-5a61-4ff2-97eb-c0660222f66c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:39.083787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a76c2-5b04-4f37-8dbb-14d95b4a6ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:39.084818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a76c2-5b04-4f37-8dbb-14d95b4a6ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:39.085239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a76c2-5b04-4f37-8dbb-14d95b4a6ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:39.085637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a76c2-5b04-4f37-8dbb-14d95b4a6ea2 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:39.086430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a76c2-5b04-4f37-8dbb-14d95b4a6ea2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:39.086856 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a76c2-5b04-4f37-8dbb-14d95b4a6ea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:39.088399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a76c2-5b04-4f37-8dbb-14d95b4a6ea2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:39.098483 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 218/424] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:39.105571 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a76c2-5b04-4f37-8dbb-14d95b4a6ea2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:39.154241 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379803d-8a3b-493d-8348-d3b81e0286ab None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:39.199991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:39.220252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f87ada-7bee-41af-b942-2a2c0e98405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:39.221960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f87ada-7bee-41af-b942-2a2c0e98405a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:39.222233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f87ada-7bee-41af-b942-2a2c0e98405a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:39.222499 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f87ada-7bee-41af-b942-2a2c0e98405a None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:39.224959 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f87ada-7bee-41af-b942-2a2c0e98405a None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:39.226387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f87ada-7bee-41af-b942-2a2c0e98405a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:39.233162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 207/425] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:38 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:39.240922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f87ada-7bee-41af-b942-2a2c0e98405a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:39.288128 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a76c2-5b04-4f37-8dbb-14d95b4a6ea2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:39.358046 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25025568-4727-4fef-af26-c70032dccc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:39.358843 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025568-4727-4fef-af26-c70032dccc4d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:39.359120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025568-4727-4fef-af26-c70032dccc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:39.359414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025568-4727-4fef-af26-c70032dccc4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:39.403975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:39.455309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f87ada-7bee-41af-b942-2a2c0e98405a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:39.460311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25025568-4727-4fef-af26-c70032dccc4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:39.461753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25025568-4727-4fef-af26-c70032dccc4d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:39.523307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0a0af-7c2c-48db-b965-b4754146db34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:39.523865 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0a0af-7c2c-48db-b965-b4754146db34 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:39.524170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0a0af-7c2c-48db-b965-b4754146db34 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:39.524444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0a0af-7c2c-48db-b965-b4754146db34 None admin] PATH_INFO: `/v3/groups/dadefdc03fe848e09048bc5d111ee09b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:39.528525 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0a0af-7c2c-48db-b965-b4754146db34 None admin] RBAC: Authorizing `identity:get_group(group_id=dadefdc03fe848e09048bc5d111ee09b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:39.530024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0a0af-7c2c-48db-b965-b4754146db34 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:39.531710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 208/426] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Aug 30 04:56:39 2022] GET /identity/v3/groups/dadefdc03fe848e09048bc5d111ee09b => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:39.538585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0a0af-7c2c-48db-b965-b4754146db34 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:39.565312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:39.643753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 219/427] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:39.649037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25025568-4727-4fef-af26-c70032dccc4d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:39.732474 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0a0af-7c2c-48db-b965-b4754146db34 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:39.799273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e338c6-2fa2-4cc6-a694-626b6e5dbecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:39.800250 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e338c6-2fa2-4cc6-a694-626b6e5dbecf None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:39.800832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e338c6-2fa2-4cc6-a694-626b6e5dbecf None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:39.801295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e338c6-2fa2-4cc6-a694-626b6e5dbecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:39.802222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e338c6-2fa2-4cc6-a694-626b6e5dbecf None admin] RBAC: Adding query filter params (group.id=dadefdc03fe848e09048bc5d111ee09b, role.id=b0fa1b252ab74641b309e4a3d6aacc68, scope.project.id=aa51b8e01e6242dcb98f562872154655) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:39.802795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e338c6-2fa2-4cc6-a694-626b6e5dbecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:39.804456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e338c6-2fa2-4cc6-a694-626b6e5dbecf None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:39.814607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 209/428] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Aug 30 04:56:39 2022] GET /identity/v3/role_assignments?group.id=dadefdc03fe848e09048bc5d111ee09b&scope.project.id=aa51b8e01e6242dcb98f562872154655&role.id=b0fa1b252ab74641b309e4a3d6aacc68 => generated 611 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:39.823755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25025568-4727-4fef-af26-c70032dccc4d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:39.880608 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59120c9-4ca4-4210-8b02-af7060ddcd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:39.881631 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59120c9-4ca4-4210-8b02-af7060ddcd7e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:39.882107 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59120c9-4ca4-4210-8b02-af7060ddcd7e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:39.882605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59120c9-4ca4-4210-8b02-af7060ddcd7e None admin] PATH_INFO: `/v3/projects/aa51b8e01e6242dcb98f562872154655` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:39.888858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59120c9-4ca4-4210-8b02-af7060ddcd7e None admin] RBAC: Authorizing `identity:get_project(project_id=aa51b8e01e6242dcb98f562872154655)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:39.890686 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59120c9-4ca4-4210-8b02-af7060ddcd7e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:39.892715 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 220/429] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:39 2022] GET /identity/v3/projects/aa51b8e01e6242dcb98f562872154655 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:39.898500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e338c6-2fa2-4cc6-a694-626b6e5dbecf None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:39.909523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:39.927818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f218e4e-5a47-4fba-9aae-975052d55374 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:39.928144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f218e4e-5a47-4fba-9aae-975052d55374 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:39.928403 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f218e4e-5a47-4fba-9aae-975052d55374 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:39.930003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 221/430] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:56:39.937833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906476df-e165-48c0-9a39-3ef31557ae8a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:39.938137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906476df-e165-48c0-9a39-3ef31557ae8a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:39.938890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906476df-e165-48c0-9a39-3ef31557ae8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:39.960545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-906476df-e165-48c0-9a39-3ef31557ae8a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:39.962865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-906476df-e165-48c0-9a39-3ef31557ae8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:39.976334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:40.051053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 222/431] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:56:40.052648 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd13c4-68b2-4d52-9b00-ab2f5f463dc3 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:40.053123 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd13c4-68b2-4d52-9b00-ab2f5f463dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:40.053582 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd13c4-68b2-4d52-9b00-ab2f5f463dc3 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:40.055012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 223/432] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:40.060406 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629bf4d-9114-47a2-90d2-0d0a741dfa5b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:40.060948 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629bf4d-9114-47a2-90d2-0d0a741dfa5b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:40.063539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629bf4d-9114-47a2-90d2-0d0a741dfa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:40.068313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e338c6-2fa2-4cc6-a694-626b6e5dbecf None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:40.083022 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e629bf4d-9114-47a2-90d2-0d0a741dfa5b None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:40.084591 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e629bf4d-9114-47a2-90d2-0d0a741dfa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:40.107718 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413503c-ad9f-43b4-b974-1365cac7b956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:40.108386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413503c-ad9f-43b4-b974-1365cac7b956 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:40.108714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413503c-ad9f-43b4-b974-1365cac7b956 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:40.108971 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413503c-ad9f-43b4-b974-1365cac7b956 None admin] PATH_INFO: `/v3/groups/dadefdc03fe848e09048bc5d111ee09b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:40.110072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413503c-ad9f-43b4-b974-1365cac7b956 None admin] RBAC: Authorizing `identity:get_group(group_id=dadefdc03fe848e09048bc5d111ee09b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:40.111710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413503c-ad9f-43b4-b974-1365cac7b956 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:40.113615 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 210/433] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Aug 30 04:56:39 2022] GET /identity/v3/groups/dadefdc03fe848e09048bc5d111ee09b => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:40.119093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413503c-ad9f-43b4-b974-1365cac7b956 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:40.177196 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 224/434] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:56:40.213477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:40.241295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413503c-ad9f-43b4-b974-1365cac7b956 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:40.278684 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7e8a7-8043-43ea-baaa-b5f47083d798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:40.279681 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7e8a7-8043-43ea-baaa-b5f47083d798 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:40.280176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7e8a7-8043-43ea-baaa-b5f47083d798 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:40.280670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7e8a7-8043-43ea-baaa-b5f47083d798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:40.281584 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7e8a7-8043-43ea-baaa-b5f47083d798 None admin] RBAC: Adding query filter params (group.id=dadefdc03fe848e09048bc5d111ee09b, role.id=1201453b538f4257a1dc8723d67c0cdd, scope.project.id=aa51b8e01e6242dcb98f562872154655) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:40.282096 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7e8a7-8043-43ea-baaa-b5f47083d798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:40.284315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7e8a7-8043-43ea-baaa-b5f47083d798 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:40.285459 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770ec6b-7d59-40d7-98b4-52beccdff71d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:40.285957 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770ec6b-7d59-40d7-98b4-52beccdff71d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:40.286468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770ec6b-7d59-40d7-98b4-52beccdff71d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:40.290572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 225/435] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:40.295154 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 211/436] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Aug 30 04:56:40 2022] GET /identity/v3/role_assignments?group.id=dadefdc03fe848e09048bc5d111ee09b&scope.project.id=aa51b8e01e6242dcb98f562872154655&role.id=1201453b538f4257a1dc8723d67c0cdd => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:40.296949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cc787-56ae-400f-b1bb-a0dacaddcf53 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:40.297467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cc787-56ae-400f-b1bb-a0dacaddcf53 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:40.297931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cc787-56ae-400f-b1bb-a0dacaddcf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:40.319616 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5a2cc787-56ae-400f-b1bb-a0dacaddcf53 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:40.321207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5a2cc787-56ae-400f-b1bb-a0dacaddcf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:40.399357 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 226/437] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:40.410811 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7e8a7-8043-43ea-baaa-b5f47083d798 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:40.492082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cc787-56ae-400f-b1bb-a0dacaddcf53 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:40.503762 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:40.527471 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7e8a7-8043-43ea-baaa-b5f47083d798 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:40.578057 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff961b6-25be-42ef-af58-282cfb9edb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:40.578882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff961b6-25be-42ef-af58-282cfb9edb88 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:40.579163 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff961b6-25be-42ef-af58-282cfb9edb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:40.579427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff961b6-25be-42ef-af58-282cfb9edb88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:40.589252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:40.594848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff961b6-25be-42ef-af58-282cfb9edb88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-4ff961b6-25be-42ef-af58-282cfb9edb88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:40.600076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:40.601006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:40.601816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:40.601816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:40.601816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:40.601816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:40.601816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:40.601816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:40.601816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:40.601816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:40.601816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:40.601816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:40.601816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:40.601816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:40.604598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 212/438] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:56:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:40.611306 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff961b6-25be-42ef-af58-282cfb9edb88 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:40.634820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cc787-56ae-400f-b1bb-a0dacaddcf53 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:40.675657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d7e19-a1e9-41e1-9ffa-f0fd59468bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:40.676430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d7e19-a1e9-41e1-9ffa-f0fd59468bbb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:40.676839 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d7e19-a1e9-41e1-9ffa-f0fd59468bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:40.677177 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d7e19-a1e9-41e1-9ffa-f0fd59468bbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:40.693133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d7e19-a1e9-41e1-9ffa-f0fd59468bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-058d7e19-a1e9-41e1-9ffa-f0fd59468bbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:40.697970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:40.698997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:40.699813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:40.699813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:40.699813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:40.699813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:40.699813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:40.699813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:40.699813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:40.699813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:40.699813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:40.699813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:40.699813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:56:40.699813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:40.703849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 227/439] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:40.704755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d7e19-a1e9-41e1-9ffa-f0fd59468bbb None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:40.739254 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff961b6-25be-42ef-af58-282cfb9edb88 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:40.785664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3eb6ec-e2e9-4cf9-9496-e3cec100390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:40.785905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:40.786515 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3eb6ec-e2e9-4cf9-9496-e3cec100390b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:40.786515 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3eb6ec-e2e9-4cf9-9496-e3cec100390b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:40.786797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3eb6ec-e2e9-4cf9-9496-e3cec100390b None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:40.787499 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3eb6ec-e2e9-4cf9-9496-e3cec100390b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:40.787795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3eb6ec-e2e9-4cf9-9496-e3cec100390b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:40.789631 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3eb6ec-e2e9-4cf9-9496-e3cec100390b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:40.802759 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 213/440] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:40.803640 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3eb6ec-e2e9-4cf9-9496-e3cec100390b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:40.826439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d7e19-a1e9-41e1-9ffa-f0fd59468bbb None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:40.860777 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d675d-9c87-4c8e-b594-2117b98314f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:40.861403 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d675d-9c87-4c8e-b594-2117b98314f4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:40.861703 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d675d-9c87-4c8e-b594-2117b98314f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:40.862021 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d675d-9c87-4c8e-b594-2117b98314f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:40.868577 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:40.872979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d675d-9c87-4c8e-b594-2117b98314f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-480d675d-9c87-4c8e-b594-2117b98314f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:40.877730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:40.878678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:40.879696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:40.879696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:40.879696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:40.879696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:40.879696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:40.879696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:40.879696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:40.879696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:40.879696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:40.879696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:40.879696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:56:40.879696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:40.880697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 228/441] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:56:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:40.882647 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d675d-9c87-4c8e-b594-2117b98314f4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:40.913240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3eb6ec-e2e9-4cf9-9496-e3cec100390b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:40.946035 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80455c-e4af-4f83-b7f4-cd078d14b296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:40.946632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80455c-e4af-4f83-b7f4-cd078d14b296 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:40.946906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80455c-e4af-4f83-b7f4-cd078d14b296 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:40.947173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80455c-e4af-4f83-b7f4-cd078d14b296 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:40.947830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80455c-e4af-4f83-b7f4-cd078d14b296 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:40.948153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80455c-e4af-4f83-b7f4-cd078d14b296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:40.950044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80455c-e4af-4f83-b7f4-cd078d14b296 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:40.957899 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 214/442] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:56:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:40.958670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80455c-e4af-4f83-b7f4-cd078d14b296 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:40.985953 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d675d-9c87-4c8e-b594-2117b98314f4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:41.011929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:41.021546 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f9111-00d9-4b25-902f-1f3c73cc0ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:41.022145 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f9111-00d9-4b25-902f-1f3c73cc0ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:41.022417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f9111-00d9-4b25-902f-1f3c73cc0ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:41.022683 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f9111-00d9-4b25-902f-1f3c73cc0ca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:41.058940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80455c-e4af-4f83-b7f4-cd078d14b296 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:41.081080 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:41.093039 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f682-0de0-47e4-9de3-8387535bd86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:41.093644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f682-0de0-47e4-9de3-8387535bd86b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:41.093921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f682-0de0-47e4-9de3-8387535bd86b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:41.094150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f9111-00d9-4b25-902f-1f3c73cc0ca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:41.094249 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f682-0de0-47e4-9de3-8387535bd86b None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:41.094836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896f682-0de0-47e4-9de3-8387535bd86b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:41.095137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896f682-0de0-47e4-9de3-8387535bd86b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:41.095590 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f9111-00d9-4b25-902f-1f3c73cc0ca6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:41.096539 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896f682-0de0-47e4-9de3-8387535bd86b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:41.104693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 215/443] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:41.105444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f682-0de0-47e4-9de3-8387535bd86b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:41.195370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 229/444] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:41.196152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f9111-00d9-4b25-902f-1f3c73cc0ca6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:41.209525 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f682-0de0-47e4-9de3-8387535bd86b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:41.223330 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:41.244599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42189f7f-4d71-4471-b640-adfed7737ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:41.245199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42189f7f-4d71-4471-b640-adfed7737ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:41.245472 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42189f7f-4d71-4471-b640-adfed7737ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:41.246265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42189f7f-4d71-4471-b640-adfed7737ea8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:41.295589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f9111-00d9-4b25-902f-1f3c73cc0ca6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:41.297118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:41.314198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42189f7f-4d71-4471-b640-adfed7737ea8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:41.315661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42189f7f-4d71-4471-b640-adfed7737ea8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:41.329728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cdf96-90e2-409d-a955-46f72337ab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:41.330318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cdf96-90e2-409d-a955-46f72337ab87 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:41.330593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cdf96-90e2-409d-a955-46f72337ab87 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:41.330857 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cdf96-90e2-409d-a955-46f72337ab87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:41.397240 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cdf96-90e2-409d-a955-46f72337ab87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:41.398686 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cdf96-90e2-409d-a955-46f72337ab87 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:41.412960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 216/445] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:41.413776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42189f7f-4d71-4471-b640-adfed7737ea8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:41.426181 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:41.496398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:41.500733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 230/446] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:41.501584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cdf96-90e2-409d-a955-46f72337ab87 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:41.517381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42189f7f-4d71-4471-b640-adfed7737ea8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:41.551299 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097cdba-31ec-4559-9206-27f05b1ef0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:41.551919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097cdba-31ec-4559-9206-27f05b1ef0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:41.552217 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097cdba-31ec-4559-9206-27f05b1ef0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:41.552482 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097cdba-31ec-4559-9206-27f05b1ef0c4 None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:41.553934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097cdba-31ec-4559-9206-27f05b1ef0c4 None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:41.555374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097cdba-31ec-4559-9206-27f05b1ef0c4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:41.557019 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 217/447] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:41 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:41.557762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097cdba-31ec-4559-9206-27f05b1ef0c4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:41.599208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cdf96-90e2-409d-a955-46f72337ab87 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:41.625693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:41.635588 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1a859-bac3-47f4-91b3-11da98ab4d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:41.636242 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1a859-bac3-47f4-91b3-11da98ab4d3e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:41.636521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1a859-bac3-47f4-91b3-11da98ab4d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:41.636784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1a859-bac3-47f4-91b3-11da98ab4d3e None admin] PATH_INFO: `/v3/projects/01a8779a6dd0442da92e2069510aded8` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:41.637893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1a859-bac3-47f4-91b3-11da98ab4d3e None admin] RBAC: Authorizing `identity:get_project(project_id=01a8779a6dd0442da92e2069510aded8)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:41.639329 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1a859-bac3-47f4-91b3-11da98ab4d3e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:41.640967 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 231/448] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:41 2022] GET /identity/v3/projects/01a8779a6dd0442da92e2069510aded8 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:41.641708 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1a859-bac3-47f4-91b3-11da98ab4d3e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:41.664918 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097cdba-31ec-4559-9206-27f05b1ef0c4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:41.698563 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187bad2-76d7-4f5b-96e1-a5605a0fb9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:41.699210 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187bad2-76d7-4f5b-96e1-a5605a0fb9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:41.699477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187bad2-76d7-4f5b-96e1-a5605a0fb9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:41.699741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187bad2-76d7-4f5b-96e1-a5605a0fb9a9 None admin] PATH_INFO: `/v3/projects/30fb7a46e3a647738501ffab48bae602` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:41.700882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187bad2-76d7-4f5b-96e1-a5605a0fb9a9 None admin] RBAC: Authorizing `identity:get_project(project_id=30fb7a46e3a647738501ffab48bae602)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:41.702298 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187bad2-76d7-4f5b-96e1-a5605a0fb9a9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:41.703890 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 218/449] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:56:41 2022] GET /identity/v3/projects/30fb7a46e3a647738501ffab48bae602 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:41.704658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187bad2-76d7-4f5b-96e1-a5605a0fb9a9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:41.729095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:41.742893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1a859-bac3-47f4-91b3-11da98ab4d3e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:41.776834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853e422-1f79-4e42-9180-a2ed49228a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:41.777992 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853e422-1f79-4e42-9180-a2ed49228a2f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:41.778261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853e422-1f79-4e42-9180-a2ed49228a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:41.778525 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853e422-1f79-4e42-9180-a2ed49228a2f None admin] PATH_INFO: `/v3/groups/dadefdc03fe848e09048bc5d111ee09b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:41.779629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853e422-1f79-4e42-9180-a2ed49228a2f None admin] RBAC: Authorizing `identity:get_group(group_id=dadefdc03fe848e09048bc5d111ee09b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:41.781373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853e422-1f79-4e42-9180-a2ed49228a2f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:41.782925 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 232/450] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Aug 30 04:56:41 2022] GET /identity/v3/groups/dadefdc03fe848e09048bc5d111ee09b => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:41.783671 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853e422-1f79-4e42-9180-a2ed49228a2f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:41.812772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187bad2-76d7-4f5b-96e1-a5605a0fb9a9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:41.845367 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:41.846534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07b43c-b0b7-42c7-8d7d-87bb462b9422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:41.847196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07b43c-b0b7-42c7-8d7d-87bb462b9422 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:41.847472 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07b43c-b0b7-42c7-8d7d-87bb462b9422 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:41.847740 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07b43c-b0b7-42c7-8d7d-87bb462b9422 None admin] PATH_INFO: `/v3/groups/dadefdc03fe848e09048bc5d111ee09b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:41.848927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07b43c-b0b7-42c7-8d7d-87bb462b9422 None admin] RBAC: Authorizing `identity:get_group(group_id=dadefdc03fe848e09048bc5d111ee09b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:41.850346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07b43c-b0b7-42c7-8d7d-87bb462b9422 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:41.851894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 219/451] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Aug 30 04:56:41 2022] GET /identity/v3/groups/dadefdc03fe848e09048bc5d111ee09b => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:41.852672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07b43c-b0b7-42c7-8d7d-87bb462b9422 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:41.886010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853e422-1f79-4e42-9180-a2ed49228a2f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:41.920065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b420af1-1cfa-4e97-ba25-897ccdd493d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:41.920681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b420af1-1cfa-4e97-ba25-897ccdd493d7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:41.920953 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b420af1-1cfa-4e97-ba25-897ccdd493d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:41.921218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b420af1-1cfa-4e97-ba25-897ccdd493d7 None admin] PATH_INFO: `/v3/groups/2cfe4ae853804d08b6e3a761adcc824b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:41.922434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b420af1-1cfa-4e97-ba25-897ccdd493d7 None admin] RBAC: Authorizing `identity:get_group(group_id=2cfe4ae853804d08b6e3a761adcc824b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:41.924409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b420af1-1cfa-4e97-ba25-897ccdd493d7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:41.925953 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 233/452] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Aug 30 04:56:41 2022] GET /identity/v3/groups/2cfe4ae853804d08b6e3a761adcc824b => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:41.926699 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b420af1-1cfa-4e97-ba25-897ccdd493d7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:41.949364 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:41.961811 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07b43c-b0b7-42c7-8d7d-87bb462b9422 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:41.996632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8d3e0-5313-45e5-9c91-0784dc812bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:41.997233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8d3e0-5313-45e5-9c91-0784dc812bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:41.997508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8d3e0-5313-45e5-9c91-0784dc812bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:41.997784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8d3e0-5313-45e5-9c91-0784dc812bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:41.998511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8d3e0-5313-45e5-9c91-0784dc812bc4 None admin] RBAC: Adding query filter params (group.id=dadefdc03fe848e09048bc5d111ee09b, role.id=1201453b538f4257a1dc8723d67c0cdd, scope.project.id=01a8779a6dd0442da92e2069510aded8) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:41.998815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8d3e0-5313-45e5-9c91-0784dc812bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:42.000280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8d3e0-5313-45e5-9c91-0784dc812bc4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:42.006282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 220/453] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Aug 30 04:56:41 2022] GET /identity/v3/role_assignments?group.id=dadefdc03fe848e09048bc5d111ee09b&scope.project.id=01a8779a6dd0442da92e2069510aded8&role.id=1201453b538f4257a1dc8723d67c0cdd => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:42.007051 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8d3e0-5313-45e5-9c91-0784dc812bc4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:42.029875 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b420af1-1cfa-4e97-ba25-897ccdd493d7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:42.062833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:42.071282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f01c7-6e0c-4afb-82e9-a5a23e3c1f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:42.071903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f01c7-6e0c-4afb-82e9-a5a23e3c1f48 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:42.072225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f01c7-6e0c-4afb-82e9-a5a23e3c1f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:42.072494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f01c7-6e0c-4afb-82e9-a5a23e3c1f48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:42.073301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f01c7-6e0c-4afb-82e9-a5a23e3c1f48 None admin] RBAC: Adding query filter params (group.id=dadefdc03fe848e09048bc5d111ee09b, role.id=b0fa1b252ab74641b309e4a3d6aacc68, scope.project.id=01a8779a6dd0442da92e2069510aded8) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:42.073604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f01c7-6e0c-4afb-82e9-a5a23e3c1f48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:42.075334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f01c7-6e0c-4afb-82e9-a5a23e3c1f48 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:42.091978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 234/454] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Aug 30 04:56:41 2022] GET /identity/v3/role_assignments?group.id=dadefdc03fe848e09048bc5d111ee09b&scope.project.id=01a8779a6dd0442da92e2069510aded8&role.id=b0fa1b252ab74641b309e4a3d6aacc68 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:42.163729 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8d3e0-5313-45e5-9c91-0784dc812bc4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:42.204456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2fc9c-ccf0-4ba2-93f5-503bc23e6202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:42.205082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2fc9c-ccf0-4ba2-93f5-503bc23e6202 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:42.205361 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2fc9c-ccf0-4ba2-93f5-503bc23e6202 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:42.205632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2fc9c-ccf0-4ba2-93f5-503bc23e6202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:42.206375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2fc9c-ccf0-4ba2-93f5-503bc23e6202 None admin] RBAC: Adding query filter params (group.id=2cfe4ae853804d08b6e3a761adcc824b, role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=30fb7a46e3a647738501ffab48bae602) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:42.206678 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2fc9c-ccf0-4ba2-93f5-503bc23e6202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:42.208304 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2fc9c-ccf0-4ba2-93f5-503bc23e6202 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:42.216054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 221/455] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Aug 30 04:56:42 2022] GET /identity/v3/role_assignments?group.id=2cfe4ae853804d08b6e3a761adcc824b&scope.project.id=30fb7a46e3a647738501ffab48bae602&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:44.621884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f94faa-30a6-492d-af15-def0049784be None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:44.622427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f94faa-30a6-492d-af15-def0049784be None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:44.622427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f94faa-30a6-492d-af15-def0049784be None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:44.623982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 235/456] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:44.629644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eef1ff-6616-4171-9fea-39fdbe18d185 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:44.630794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eef1ff-6616-4171-9fea-39fdbe18d185 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:44.631358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eef1ff-6616-4171-9fea-39fdbe18d185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:44.650201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-86eef1ff-6616-4171-9fea-39fdbe18d185 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:44.652279 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-86eef1ff-6616-4171-9fea-39fdbe18d185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:44.671937 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:44.753635 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 222/457] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:44.854238 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2e4d9-aefa-49b9-847b-0cccd3a0d3af None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:44.855430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2e4d9-aefa-49b9-847b-0cccd3a0d3af None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:44.855910 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2e4d9-aefa-49b9-847b-0cccd3a0d3af None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:44.857744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 236/458] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:44.862699 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5ae28-77a3-4670-b2b8-c33666d1474a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:44.863232 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5ae28-77a3-4670-b2b8-c33666d1474a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:44.863729 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5ae28-77a3-4670-b2b8-c33666d1474a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:44.886797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-10f5ae28-77a3-4670-b2b8-c33666d1474a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:44.888406 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-10f5ae28-77a3-4670-b2b8-c33666d1474a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:44.987962 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 223/459] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:44.994401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39193f8-cec2-48c0-9b16-0a948ecdc75d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:44.994949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39193f8-cec2-48c0-9b16-0a948ecdc75d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:44.995413 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39193f8-cec2-48c0-9b16-0a948ecdc75d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:44.997258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 237/460] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:45.002187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22badc6c-ed9a-4326-80b8-aaa212b55266 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:45.002565 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22badc6c-ed9a-4326-80b8-aaa212b55266 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:45.002844 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22badc6c-ed9a-4326-80b8-aaa212b55266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:45.030549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-22badc6c-ed9a-4326-80b8-aaa212b55266 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:45.031750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-22badc6c-ed9a-4326-80b8-aaa212b55266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:45.150660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 224/461] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:45.225198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39193f8-cec2-48c0-9b16-0a948ecdc75d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:45.320797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22badc6c-ed9a-4326-80b8-aaa212b55266 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:45.329963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:45.363734 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39193f8-cec2-48c0-9b16-0a948ecdc75d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:45.438651 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bdd6c-229e-41b3-82f1-afcbc254189b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:45.439609 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bdd6c-229e-41b3-82f1-afcbc254189b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:45.440152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bdd6c-229e-41b3-82f1-afcbc254189b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:45.440978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bdd6c-229e-41b3-82f1-afcbc254189b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:45.463555 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bdd6c-229e-41b3-82f1-afcbc254189b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:45.470129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bdd6c-229e-41b3-82f1-afcbc254189b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-022bdd6c-229e-41b3-82f1-afcbc254189b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:45.488056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:45.489012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:45.489871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:45.489871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:45.489871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:45.492076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 238/462] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:45.504100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bdd6c-229e-41b3-82f1-afcbc254189b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:45.510772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22badc6c-ed9a-4326-80b8-aaa212b55266 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:45.547567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e5ad7-8897-4867-a995-cfd6baf135da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:45.548245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e5ad7-8897-4867-a995-cfd6baf135da None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:45.548517 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e5ad7-8897-4867-a995-cfd6baf135da None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:45.548784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e5ad7-8897-4867-a995-cfd6baf135da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:45.560654 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e5ad7-8897-4867-a995-cfd6baf135da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:45.562219 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e5ad7-8897-4867-a995-cfd6baf135da None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-693e5ad7-8897-4867-a995-cfd6baf135da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:45.577795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:45.578752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:45.579596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:45.579596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:45.579596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:45.579596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 225/463] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:56:45.580262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e5ad7-8897-4867-a995-cfd6baf135da None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:45.584405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:45.646739 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:45.654821 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bdd6c-229e-41b3-82f1-afcbc254189b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:45.696372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e5ad7-8897-4867-a995-cfd6baf135da None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:45.697526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667960d-944d-4ecd-8ab4-6e5d4fcdb7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:45.698181 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667960d-944d-4ecd-8ab4-6e5d4fcdb7da None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:45.698751 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667960d-944d-4ecd-8ab4-6e5d4fcdb7da None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:45.699047 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667960d-944d-4ecd-8ab4-6e5d4fcdb7da None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:45.699802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667960d-944d-4ecd-8ab4-6e5d4fcdb7da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:45.700147 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667960d-944d-4ecd-8ab4-6e5d4fcdb7da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:45.702607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667960d-944d-4ecd-8ab4-6e5d4fcdb7da None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:45.726694 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 239/464] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:45.727972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667960d-944d-4ecd-8ab4-6e5d4fcdb7da None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:45.739894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97b59b-f226-4f4b-a7f4-3d469d7f126d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:45.740906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97b59b-f226-4f4b-a7f4-3d469d7f126d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:45.741462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97b59b-f226-4f4b-a7f4-3d469d7f126d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:45.741931 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97b59b-f226-4f4b-a7f4-3d469d7f126d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:45.755476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97b59b-f226-4f4b-a7f4-3d469d7f126d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:45.757309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97b59b-f226-4f4b-a7f4-3d469d7f126d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-ec97b59b-f226-4f4b-a7f4-3d469d7f126d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:45.774576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:45.775570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:45.776478 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:45.776478 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:45.776478 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:45.781873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 226/465] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:45.781873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97b59b-f226-4f4b-a7f4-3d469d7f126d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:45.841407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667960d-944d-4ecd-8ab4-6e5d4fcdb7da None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:45.849878 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:45.879173 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c54b8b-4b7a-4fce-98ce-04d693397cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:45.880149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54b8b-4b7a-4fce-98ce-04d693397cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:45.880426 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54b8b-4b7a-4fce-98ce-04d693397cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:45.880692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54b8b-4b7a-4fce-98ce-04d693397cb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:45.881327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c54b8b-4b7a-4fce-98ce-04d693397cb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:45.881618 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c54b8b-4b7a-4fce-98ce-04d693397cb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:45.882990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c54b8b-4b7a-4fce-98ce-04d693397cb9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:45.894931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 240/466] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:45.896203 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11ef68-c110-4f3b-be71-feb86e88d7ad None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:45.896482 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11ef68-c110-4f3b-be71-feb86e88d7ad None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:45.896803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11ef68-c110-4f3b-be71-feb86e88d7ad None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:45.902098 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 241/467] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:45.902098 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11ef68-c110-4f3b-be71-feb86e88d7ad None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:45.903322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97b59b-f226-4f4b-a7f4-3d469d7f126d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:45.916682 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:45.943384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d1916-f9b6-4925-992c-0ac802932776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:45.944010 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d1916-f9b6-4925-992c-0ac802932776 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:45.944304 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d1916-f9b6-4925-992c-0ac802932776 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:45.944551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d1916-f9b6-4925-992c-0ac802932776 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:45.945381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d1916-f9b6-4925-992c-0ac802932776 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:45.946865 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d1916-f9b6-4925-992c-0ac802932776 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:45.970124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 227/468] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:56:45 2022] POST /identity/v3/users => generated 246 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:45.971624 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d1916-f9b6-4925-992c-0ac802932776 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:46.019648 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11ef68-c110-4f3b-be71-feb86e88d7ad None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:46.074647 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67804123-2980-4160-822a-f3906b7541ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:46.075543 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67804123-2980-4160-822a-f3906b7541ad None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.076037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67804123-2980-4160-822a-f3906b7541ad None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.076699 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67804123-2980-4160-822a-f3906b7541ad None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.078285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67804123-2980-4160-822a-f3906b7541ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:46.078746 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67804123-2980-4160-822a-f3906b7541ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:46.081044 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67804123-2980-4160-822a-f3906b7541ad None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:46.099915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 242/469] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:46.101925 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a800df9-5cfa-488d-97a6-59e407f425f3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.102835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a800df9-5cfa-488d-97a6-59e407f425f3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.103260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a800df9-5cfa-488d-97a6-59e407f425f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.121730 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d1916-f9b6-4925-992c-0ac802932776 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:46.128277 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9a800df9-5cfa-488d-97a6-59e407f425f3 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:46.131031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9a800df9-5cfa-488d-97a6-59e407f425f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:46.160655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:46.168806 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90148ff9-c307-4d58-bf88-15cf3950ba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:46.169767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90148ff9-c307-4d58-bf88-15cf3950ba4b None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.170389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90148ff9-c307-4d58-bf88-15cf3950ba4b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.170857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90148ff9-c307-4d58-bf88-15cf3950ba4b None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.172612 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90148ff9-c307-4d58-bf88-15cf3950ba4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:46.174922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90148ff9-c307-4d58-bf88-15cf3950ba4b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:46.205342 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 228/470] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:56:45 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:46.206519 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90148ff9-c307-4d58-bf88-15cf3950ba4b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:46.232213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 243/471] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:46.257999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:46.334847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a5bb9-6bad-4cc2-86fa-da1a6a5b9f78 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.335480 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a5bb9-6bad-4cc2-86fa-da1a6a5b9f78 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.335961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a5bb9-6bad-4cc2-86fa-da1a6a5b9f78 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.337850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 244/472] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:46.353564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479278b-1808-494a-9808-268e9a359346 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.354183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479278b-1808-494a-9808-268e9a359346 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.354654 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479278b-1808-494a-9808-268e9a359346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.369348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90148ff9-c307-4d58-bf88-15cf3950ba4b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:46.393908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e479278b-1808-494a-9808-268e9a359346 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:46.395092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e479278b-1808-494a-9808-268e9a359346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:46.419807 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967bf4d-93f3-457d-ab42-b095bbd9e81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:46.421046 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967bf4d-93f3-457d-ab42-b095bbd9e81d None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.421616 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967bf4d-93f3-457d-ab42-b095bbd9e81d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.422104 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967bf4d-93f3-457d-ab42-b095bbd9e81d None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.423126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967bf4d-93f3-457d-ab42-b095bbd9e81d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:46.425496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967bf4d-93f3-457d-ab42-b095bbd9e81d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:46.459261 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 229/473] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:56:46 2022] POST /identity/v3/users => generated 248 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:46.488354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 245/474] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:46.621850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967bf4d-93f3-457d-ab42-b095bbd9e81d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:46.704263 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:46.728415 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967bf4d-93f3-457d-ab42-b095bbd9e81d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:46.774512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3402f74-195a-46d6-9954-59b7d72c1390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:46.775147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3402f74-195a-46d6-9954-59b7d72c1390 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.775425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3402f74-195a-46d6-9954-59b7d72c1390 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.775698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3402f74-195a-46d6-9954-59b7d72c1390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.790187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3402f74-195a-46d6-9954-59b7d72c1390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:46.791665 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3402f74-195a-46d6-9954-59b7d72c1390 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:46.801390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479278b-1808-494a-9808-268e9a359346 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e3402f74-195a-46d6-9954-59b7d72c1390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:46.822480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:46.823485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:46.825187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:46.825187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:46.825187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:46.825187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 230/475] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:46.831881 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3402f74-195a-46d6-9954-59b7d72c1390 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:46.960876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:46.991791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479278b-1808-494a-9808-268e9a359346 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:47.002274 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3402f74-195a-46d6-9954-59b7d72c1390 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:47.052543 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:47.066973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907c8ac-a0d9-436d-b17a-6d6ad1f7fd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:47.067602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907c8ac-a0d9-436d-b17a-6d6ad1f7fd33 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:47.067879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907c8ac-a0d9-436d-b17a-6d6ad1f7fd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:47.068183 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907c8ac-a0d9-436d-b17a-6d6ad1f7fd33 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:47.069356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907c8ac-a0d9-436d-b17a-6d6ad1f7fd33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:47.069664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907c8ac-a0d9-436d-b17a-6d6ad1f7fd33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:47.071055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907c8ac-a0d9-436d-b17a-6d6ad1f7fd33 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:47.074707 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf77425-91f4-4133-a23d-b0de56565246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:47.075328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf77425-91f4-4133-a23d-b0de56565246 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:47.075601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf77425-91f4-4133-a23d-b0de56565246 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:47.075866 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf77425-91f4-4133-a23d-b0de56565246 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:47.076565 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf77425-91f4-4133-a23d-b0de56565246 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:47.077984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf77425-91f4-4133-a23d-b0de56565246 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:47.093125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.sql.core [None req-bbf77425-91f4-4133-a23d-b0de56565246 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 04:56:47.093125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 04:56:47.093125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [parameters: {'id': '54f971c50e714370a9b629b3d364755f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 04:56:47.093125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81676) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 04:56:47.101787 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 231/476] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:47.112893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-bbf77425-91f4-4133-a23d-b0de56565246 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 04:56:47.112893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:47.112893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:56:47.112893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:56:47.112893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:56:47.112893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:56:47.112893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:56:47.112893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:56:47.112893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:56:47.112893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:56:47.112893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:56:47.112893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:56:47.112893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:56:47.112893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result.read() Aug 30 04:56:47.112893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:56:47.113851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application yield resource Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise self.value Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application session.commit() Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 04:56:47.114748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.session.flush() Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application compat.raise_( Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 04:56:47.115619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:56:47.116652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result.read() Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:56:47.117496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [parameters: {'id': '54f971c50e714370a9b629b3d364755f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:47.118278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 04:56:47.119100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:47.122013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907c8ac-a0d9-436d-b17a-6d6ad1f7fd33 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:47.123875 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 246/477] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Aug 30 04:56:46 2022] POST /identity/v3/roles => generated 144 bytes in 323 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:47.130341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf77425-91f4-4133-a23d-b0de56565246 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:47.269971 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907c8ac-a0d9-436d-b17a-6d6ad1f7fd33 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:47.308376 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb625c-fbee-4470-bb20-c6a12ed46485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:47.309413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb625c-fbee-4470-bb20-c6a12ed46485 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:47.310054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb625c-fbee-4470-bb20-c6a12ed46485 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:47.311696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb625c-fbee-4470-bb20-c6a12ed46485 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:47.312657 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb625c-fbee-4470-bb20-c6a12ed46485 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:47.315039 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb625c-fbee-4470-bb20-c6a12ed46485 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:47.320408 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf77425-91f4-4133-a23d-b0de56565246 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:47.356936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 232/478] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:56:47 2022] POST /identity/v3/users => generated 249 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:47.389616 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7234b-d78c-4a78-8e1b-f52c20b25246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:47.390678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7234b-d78c-4a78-8e1b-f52c20b25246 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:47.391154 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7234b-d78c-4a78-8e1b-f52c20b25246 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:47.391622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7234b-d78c-4a78-8e1b-f52c20b25246 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:47.413310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7234b-d78c-4a78-8e1b-f52c20b25246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c9d7234b-d78c-4a78-8e1b-f52c20b25246 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:47.418934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:47.419876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:47.420741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:47.420741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:47.420741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:47.420741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:47.420741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:47.420741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:47.420741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:47.420741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:47.420741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:47.420741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:47.420741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:56:47.420741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:47.423510 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 247/479] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:56:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:47.429060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb625c-fbee-4470-bb20-c6a12ed46485 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:47.508220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:47.597219 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb625c-fbee-4470-bb20-c6a12ed46485 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:47.642195 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc535b-d3fe-472d-9978-40c6bfd7bfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:47.642813 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc535b-d3fe-472d-9978-40c6bfd7bfe4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:47.643092 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc535b-d3fe-472d-9978-40c6bfd7bfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:47.643362 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc535b-d3fe-472d-9978-40c6bfd7bfe4 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:47.644073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc535b-d3fe-472d-9978-40c6bfd7bfe4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:47.644380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc535b-d3fe-472d-9978-40c6bfd7bfe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:47.645765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc535b-d3fe-472d-9978-40c6bfd7bfe4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:47.660100 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 233/480] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:48.514977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebac808-1e1f-404d-a069-af007eccbe2c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:48.516055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebac808-1e1f-404d-a069-af007eccbe2c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:48.516539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebac808-1e1f-404d-a069-af007eccbe2c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:48.518381 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 248/481] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:48.523516 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb78fcb-a11d-4857-a750-1599eb6313fc None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:48.524390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb78fcb-a11d-4857-a750-1599eb6313fc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:48.524891 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb78fcb-a11d-4857-a750-1599eb6313fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:48.548834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7fb78fcb-a11d-4857-a750-1599eb6313fc None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:48.550423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7fb78fcb-a11d-4857-a750-1599eb6313fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:48.641440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 234/482] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:48.716434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f058d27-b22c-4d20-8764-b354b3ad09d3 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:48.717078 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f058d27-b22c-4d20-8764-b354b3ad09d3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:48.717599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f058d27-b22c-4d20-8764-b354b3ad09d3 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:48.720010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 249/483] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:48.725324 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bf32e-cfa6-40fe-9834-082069f5ece8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:48.725607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bf32e-cfa6-40fe-9834-082069f5ece8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:48.725880 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bf32e-cfa6-40fe-9834-082069f5ece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:48.752900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-fa3bf32e-cfa6-40fe-9834-082069f5ece8 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:48.754098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fa3bf32e-cfa6-40fe-9834-082069f5ece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:48.789504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:48.845547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 235/484] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:48.965101 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f058d27-b22c-4d20-8764-b354b3ad09d3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:48.989059 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de872eb-32f9-4427-9786-86a5d8cf30b8 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:48.989894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de872eb-32f9-4427-9786-86a5d8cf30b8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:48.991417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:48.991548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de872eb-32f9-4427-9786-86a5d8cf30b8 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:48.993823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 236/485] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:48.999017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc0857-c08f-4a8e-bc31-899407d09e72 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:48.999289 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc0857-c08f-4a8e-bc31-899407d09e72 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:48.999559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc0857-c08f-4a8e-bc31-899407d09e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:49.028988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1abc0857-c08f-4a8e-bc31-899407d09e72 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:49.032149 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1abc0857-c08f-4a8e-bc31-899407d09e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:49.172887 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f058d27-b22c-4d20-8764-b354b3ad09d3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:49.174203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 237/486] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:49.186410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc0857-c08f-4a8e-bc31-899407d09e72 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:49.244648 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4ffe1-c52e-43a4-9e11-b3772a07f93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:49.245313 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4ffe1-c52e-43a4-9e11-b3772a07f93d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:49.245590 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4ffe1-c52e-43a4-9e11-b3772a07f93d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:49.245856 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4ffe1-c52e-43a4-9e11-b3772a07f93d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:49.265161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4ffe1-c52e-43a4-9e11-b3772a07f93d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-caa4ffe1-c52e-43a4-9e11-b3772a07f93d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:49.269963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:49.270833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:49.271627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:49.271627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:49.271627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:49.271627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:49.271627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:49.271627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:49.271627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:49.271627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:49.271627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:49.271627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:49.271627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:49.271627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:49.273506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 250/487] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:56:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:49.281663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4ffe1-c52e-43a4-9e11-b3772a07f93d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:49.361483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:49.369192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc0857-c08f-4a8e-bc31-899407d09e72 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:49.424401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:49.437874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2b257-2b25-449f-ae2d-3b61d8899e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:49.438508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2b257-2b25-449f-ae2d-3b61d8899e88 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:49.438777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2b257-2b25-449f-ae2d-3b61d8899e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:49.439043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2b257-2b25-449f-ae2d-3b61d8899e88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:49.459304 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2b257-2b25-449f-ae2d-3b61d8899e88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e5d2b257-2b25-449f-ae2d-3b61d8899e88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:49.464347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:49.465438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:49.467367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:49.467367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:49.467367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:49.467367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:49.467367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:49.467367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:49.467367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:49.467367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:49.467367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:49.467367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:49.467367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:49.467367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:49.467367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 238/488] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:56:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:56:49.467367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2b257-2b25-449f-ae2d-3b61d8899e88 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:49.474906 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4ffe1-c52e-43a4-9e11-b3772a07f93d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:49.521099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4515728-94bf-487e-a3c4-324f32925ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:49.521731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515728-94bf-487e-a3c4-324f32925ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:49.521972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515728-94bf-487e-a3c4-324f32925ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:49.522216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515728-94bf-487e-a3c4-324f32925ec4 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:49.522874 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4515728-94bf-487e-a3c4-324f32925ec4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:49.523165 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4515728-94bf-487e-a3c4-324f32925ec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:49.525093 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4515728-94bf-487e-a3c4-324f32925ec4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:49.537667 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 251/489] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:56:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:49.538524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4515728-94bf-487e-a3c4-324f32925ec4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:49.608503 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2b257-2b25-449f-ae2d-3b61d8899e88 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:49.652764 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181f2a2-7790-44e1-a883-acf7215b3382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:49.654086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181f2a2-7790-44e1-a883-acf7215b3382 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:49.654757 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181f2a2-7790-44e1-a883-acf7215b3382 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:49.655189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181f2a2-7790-44e1-a883-acf7215b3382 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:49.663500 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4515728-94bf-487e-a3c4-324f32925ec4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:49.669263 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181f2a2-7790-44e1-a883-acf7215b3382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8181f2a2-7790-44e1-a883-acf7215b3382 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:49.675282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:49.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:49.677473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:49.677473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:49.677473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:49.677473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:49.677473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:49.677473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:49.677473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:49.677473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:49.677473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:49.677473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:49.677473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:49.677473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:49.685520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 239/490] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:56:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:49.686828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181f2a2-7790-44e1-a883-acf7215b3382 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:49.704933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:49.711827 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:49.713130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccb4e9-c003-4310-82ad-e41ad9ed27b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:49.714099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccb4e9-c003-4310-82ad-e41ad9ed27b2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:49.714749 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccb4e9-c003-4310-82ad-e41ad9ed27b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:49.715265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccb4e9-c003-4310-82ad-e41ad9ed27b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:49.716464 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccb4e9-c003-4310-82ad-e41ad9ed27b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:49.716866 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccb4e9-c003-4310-82ad-e41ad9ed27b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:49.718742 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccb4e9-c003-4310-82ad-e41ad9ed27b2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:49.731496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 252/491] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:56:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:49.733831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccb4e9-c003-4310-82ad-e41ad9ed27b2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:49.831236 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181f2a2-7790-44e1-a883-acf7215b3382 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:49.861775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccb4e9-c003-4310-82ad-e41ad9ed27b2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:49.867410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4948ce0-0c26-462a-a6cb-35bae0644d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:49.868273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4948ce0-0c26-462a-a6cb-35bae0644d5c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:49.868722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4948ce0-0c26-462a-a6cb-35bae0644d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:49.869189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4948ce0-0c26-462a-a6cb-35bae0644d5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:49.881073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4948ce0-0c26-462a-a6cb-35bae0644d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:49.882925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4948ce0-0c26-462a-a6cb-35bae0644d5c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-c4948ce0-0c26-462a-a6cb-35bae0644d5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:49.898837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:49.899785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:49.901012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:49.901012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:49.901012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:49.902480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 240/492] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:49.903230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4948ce0-0c26-462a-a6cb-35bae0644d5c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:49.904220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aa9d7-ad0b-4e1e-809c-8ab47517178a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:49.904830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aa9d7-ad0b-4e1e-809c-8ab47517178a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:49.905102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aa9d7-ad0b-4e1e-809c-8ab47517178a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:49.905368 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aa9d7-ad0b-4e1e-809c-8ab47517178a None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:49.906097 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147aa9d7-ad0b-4e1e-809c-8ab47517178a None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:49.906318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147aa9d7-ad0b-4e1e-809c-8ab47517178a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:49.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147aa9d7-ad0b-4e1e-809c-8ab47517178a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:49.916660 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 253/493] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:56:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:49.917630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aa9d7-ad0b-4e1e-809c-8ab47517178a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:49.982125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:49.985761 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:50.018620 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4948ce0-0c26-462a-a6cb-35bae0644d5c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:50.038160 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aa9d7-ad0b-4e1e-809c-8ab47517178a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:50.057520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70505d-78a1-4a5e-941b-b05e7e263f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:50.058178 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70505d-78a1-4a5e-941b-b05e7e263f9e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:50.058456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70505d-78a1-4a5e-941b-b05e7e263f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:50.058725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70505d-78a1-4a5e-941b-b05e7e263f9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:50.069877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70505d-78a1-4a5e-941b-b05e7e263f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:50.071323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70505d-78a1-4a5e-941b-b05e7e263f9e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:50.072120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc636ed-c63c-441c-9e1d-f99b6f5e03b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:50.072726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc636ed-c63c-441c-9e1d-f99b6f5e03b7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:50.073006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc636ed-c63c-441c-9e1d-f99b6f5e03b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:50.073799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc636ed-c63c-441c-9e1d-f99b6f5e03b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:50.074433 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc636ed-c63c-441c-9e1d-f99b6f5e03b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:50.074729 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc636ed-c63c-441c-9e1d-f99b6f5e03b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:50.076106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc636ed-c63c-441c-9e1d-f99b6f5e03b7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1f70505d-78a1-4a5e-941b-b05e7e263f9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:50.085782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:50.086849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:50.087712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:50.087712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:50.087712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:50.087712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 241/494] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:50.087923 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70505d-78a1-4a5e-941b-b05e7e263f9e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:50.092505 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 254/495] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:50.093368 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebaead-d088-48d1-b52a-4ec58ae396a0 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:50.093644 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebaead-d088-48d1-b52a-4ec58ae396a0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:50.093911 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebaead-d088-48d1-b52a-4ec58ae396a0 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:50.095168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 255/496] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:50.096178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cd6db-255e-406f-93cd-bbe68402605a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:50.096469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cd6db-255e-406f-93cd-bbe68402605a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:50.096717 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cd6db-255e-406f-93cd-bbe68402605a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:50.098014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 256/497] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:50.100715 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cd6db-255e-406f-93cd-bbe68402605a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:50.193595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70505d-78a1-4a5e-941b-b05e7e263f9e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:50.201575 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cd6db-255e-406f-93cd-bbe68402605a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:50.214848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:50.218368 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:50.226906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9d659-8d5b-4572-b738-df63d8312e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:50.227526 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9d659-8d5b-4572-b738-df63d8312e3c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:50.227798 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9d659-8d5b-4572-b738-df63d8312e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:50.228093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9d659-8d5b-4572-b738-df63d8312e3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:50.237491 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c0b1c-133a-4fda-b28c-160cc40657fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:50.238042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c0b1c-133a-4fda-b28c-160cc40657fb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:50.238315 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c0b1c-133a-4fda-b28c-160cc40657fb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:50.238581 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c0b1c-133a-4fda-b28c-160cc40657fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:50.239052 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9d659-8d5b-4572-b738-df63d8312e3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:50.240530 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9d659-8d5b-4572-b738-df63d8312e3c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:50.246152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c0b1c-133a-4fda-b28c-160cc40657fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:50.247553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c0b1c-133a-4fda-b28c-160cc40657fb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-66c9d659-8d5b-4572-b738-df63d8312e3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:50.255564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:50.256480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:50.257403 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:50.257403 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:50.257403 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:50.257403 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 242/498] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:50.257622 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9d659-8d5b-4572-b738-df63d8312e3c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-630c0b1c-133a-4fda-b28c-160cc40657fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:56:50.260320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:50.261343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:50.267051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:50.267051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:50.267051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:56:50.267051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:56:50.267051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:56:50.267051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:56:50.267051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:56:50.267051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:56:50.267051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:56:50.267051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:50.267051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 257/499] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Aug 30 04:56:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:50.267051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747d0ad-bfe7-4e06-a727-b593de84a32b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:50.267051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747d0ad-bfe7-4e06-a727-b593de84a32b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:50.267717 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747d0ad-bfe7-4e06-a727-b593de84a32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:50.281370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d747d0ad-bfe7-4e06-a727-b593de84a32b None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:50.282556 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d747d0ad-bfe7-4e06-a727-b593de84a32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:50.350594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 258/500] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:50.352088 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c29dd-4b6c-4fbe-8a50-11294b7a9dac None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:50.352448 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c29dd-4b6c-4fbe-8a50-11294b7a9dac None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:50.352796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c29dd-4b6c-4fbe-8a50-11294b7a9dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:50.361690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9d659-8d5b-4572-b738-df63d8312e3c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:50.377918 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fe6c29dd-4b6c-4fbe-8a50-11294b7a9dac None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:50.379487 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fe6c29dd-4b6c-4fbe-8a50-11294b7a9dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:50.399206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa3363-115e-4f3a-8212-50e69b7409b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:50.399807 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa3363-115e-4f3a-8212-50e69b7409b8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:50.400130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa3363-115e-4f3a-8212-50e69b7409b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:50.400444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa3363-115e-4f3a-8212-50e69b7409b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:50.401031 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa3363-115e-4f3a-8212-50e69b7409b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:50.401327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa3363-115e-4f3a-8212-50e69b7409b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:50.403316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa3363-115e-4f3a-8212-50e69b7409b8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:50.415289 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 243/501] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:50.416126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa3363-115e-4f3a-8212-50e69b7409b8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:50.450358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:50.471972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 259/502] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:50.471972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c29dd-4b6c-4fbe-8a50-11294b7a9dac None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:50.505898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:50.535156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa3363-115e-4f3a-8212-50e69b7409b8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:50.569866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7985c-a25b-4033-8e55-047166caf003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:50.570591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7985c-a25b-4033-8e55-047166caf003 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:50.570930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7985c-a25b-4033-8e55-047166caf003 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:50.571287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7985c-a25b-4033-8e55-047166caf003 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:50.572168 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7985c-a25b-4033-8e55-047166caf003 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:50.572533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7985c-a25b-4033-8e55-047166caf003 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:50.574354 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7985c-a25b-4033-8e55-047166caf003 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:50.592802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c29dd-4b6c-4fbe-8a50-11294b7a9dac None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:50.618259 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 244/503] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Aug 30 04:56:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:50.619342 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7985c-a25b-4033-8e55-047166caf003 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:50.633808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74c63d-34bd-4e16-a037-b4cba2af2f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:50.634424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74c63d-34bd-4e16-a037-b4cba2af2f94 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:50.634699 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74c63d-34bd-4e16-a037-b4cba2af2f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:50.634978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74c63d-34bd-4e16-a037-b4cba2af2f94 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:50.635629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74c63d-34bd-4e16-a037-b4cba2af2f94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:50.636520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74c63d-34bd-4e16-a037-b4cba2af2f94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:50.637906 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74c63d-34bd-4e16-a037-b4cba2af2f94 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:50.649885 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 260/504] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:50.650976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74c63d-34bd-4e16-a037-b4cba2af2f94 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:50.728375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:50.738869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7985c-a25b-4033-8e55-047166caf003 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:50.751290 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:50.757285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74c63d-34bd-4e16-a037-b4cba2af2f94 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:50.775185 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c4924-55a6-4bdd-8986-ea24c173ae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:50.775812 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c4924-55a6-4bdd-8986-ea24c173ae5d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:50.776128 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c4924-55a6-4bdd-8986-ea24c173ae5d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:50.776398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c4924-55a6-4bdd-8986-ea24c173ae5d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:50.783354 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c4924-55a6-4bdd-8986-ea24c173ae5d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:50.784862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c4924-55a6-4bdd-8986-ea24c173ae5d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:50.791033 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a89695-ab36-4915-afce-8a308e790cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:50.791620 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a89695-ab36-4915-afce-8a308e790cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:50.791890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a89695-ab36-4915-afce-8a308e790cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:50.792216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a89695-ab36-4915-afce-8a308e790cf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1a0c4924-55a6-4bdd-8986-ea24c173ae5d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:56:50.797562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:50.798696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:50.799866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:50.799866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:50.799866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:56:50.799866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:56:50.799866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:56:50.799866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:56:50.799866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:56:50.799866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:56:50.799866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:56:50.799866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:50.799866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 245/505] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:50.799866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c4924-55a6-4bdd-8986-ea24c173ae5d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:50.860608 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a89695-ab36-4915-afce-8a308e790cf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:50.862064 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a89695-ab36-4915-afce-8a308e790cf4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:50.900926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c4924-55a6-4bdd-8986-ea24c173ae5d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:50.936078 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6366a8-cfa8-45d1-8eed-cac4a729ab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:50.936709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6366a8-cfa8-45d1-8eed-cac4a729ab98 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:50.936986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6366a8-cfa8-45d1-8eed-cac4a729ab98 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:50.937258 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6366a8-cfa8-45d1-8eed-cac4a729ab98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:50.949114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6366a8-cfa8-45d1-8eed-cac4a729ab98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:50.950579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6366a8-cfa8-45d1-8eed-cac4a729ab98 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:50.965283 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-2d6366a8-cfa8-45d1-8eed-cac4a729ab98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:50.965477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:50.966532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:50.967594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:50.967594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:50.967594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:50.967594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 246/506] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:50.967594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6366a8-cfa8-45d1-8eed-cac4a729ab98 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:50.973389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:50.975848 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 261/507] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:50.976894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a89695-ab36-4915-afce-8a308e790cf4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:51.077248 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a89695-ab36-4915-afce-8a308e790cf4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:51.079085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6366a8-cfa8-45d1-8eed-cac4a729ab98 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:51.118539 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84bc2b-90cc-429d-9349-d0c713c5b9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:51.119167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84bc2b-90cc-429d-9349-d0c713c5b9ba None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:51.119439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84bc2b-90cc-429d-9349-d0c713c5b9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:51.119706 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84bc2b-90cc-429d-9349-d0c713c5b9ba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:51.121729 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1ae98-a60f-4e84-bc04-647d78748ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:51.122360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1ae98-a60f-4e84-bc04-647d78748ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:51.122634 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1ae98-a60f-4e84-bc04-647d78748ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:51.122899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1ae98-a60f-4e84-bc04-647d78748ea6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:51.128700 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84bc2b-90cc-429d-9349-d0c713c5b9ba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:51.130422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84bc2b-90cc-429d-9349-d0c713c5b9ba None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:51.133902 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1ae98-a60f-4e84-bc04-647d78748ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-29f1ae98-a60f-4e84-bc04-647d78748ea6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:51.138757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:51.139627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:51.140466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:51.140466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:51.140466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:51.140466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:51.140466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:51.140466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:51.140466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:51.140466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:51.140466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:51.140466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:51.140466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:51.140466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:51.140466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 262/508] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:56:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:51.141119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1ae98-a60f-4e84-bc04-647d78748ea6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-4a84bc2b-90cc-429d-9349-d0c713c5b9ba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:56:51.142173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:51.143017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:51.143900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:51.143900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:51.143900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:56:51.143900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:56:51.143900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:56:51.143900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:56:51.143900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:56:51.143900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:56:51.143900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:56:51.143900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:51.143900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 247/509] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:51.145007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84bc2b-90cc-429d-9349-d0c713c5b9ba None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:51.202981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:51.207993 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:51.246793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84bc2b-90cc-429d-9349-d0c713c5b9ba None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:51.248136 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1ae98-a60f-4e84-bc04-647d78748ea6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:51.282315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a03c7-16bc-4516-8a77-1c28ba3aad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:51.282587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f391c94-b3bf-4609-bbfd-3dc5ae707780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:51.282920 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a03c7-16bc-4516-8a77-1c28ba3aad5a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:51.283187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f391c94-b3bf-4609-bbfd-3dc5ae707780 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:51.283281 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a03c7-16bc-4516-8a77-1c28ba3aad5a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:51.283453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a03c7-16bc-4516-8a77-1c28ba3aad5a None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:51.283542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f391c94-b3bf-4609-bbfd-3dc5ae707780 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:51.283716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f391c94-b3bf-4609-bbfd-3dc5ae707780 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:51.284136 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a03c7-16bc-4516-8a77-1c28ba3aad5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:51.284440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a03c7-16bc-4516-8a77-1c28ba3aad5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:51.284530 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f391c94-b3bf-4609-bbfd-3dc5ae707780 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:51.284760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f391c94-b3bf-4609-bbfd-3dc5ae707780 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:51.285832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a03c7-16bc-4516-8a77-1c28ba3aad5a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:51.286162 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f391c94-b3bf-4609-bbfd-3dc5ae707780 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:51.298973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 248/510] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:51.299807 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a03c7-16bc-4516-8a77-1c28ba3aad5a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:51.327733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 263/511] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Aug 30 04:56:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:51.328530 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f391c94-b3bf-4609-bbfd-3dc5ae707780 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:51.412223 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a03c7-16bc-4516-8a77-1c28ba3aad5a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:51.432917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f391c94-b3bf-4609-bbfd-3dc5ae707780 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:51.439099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:51.447795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:51.450838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c868b0-a168-4bb5-a26c-7b8d3930e8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:51.451475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c868b0-a168-4bb5-a26c-7b8d3930e8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:51.451750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c868b0-a168-4bb5-a26c-7b8d3930e8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:51.452054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c868b0-a168-4bb5-a26c-7b8d3930e8b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:51.463529 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c868b0-a168-4bb5-a26c-7b8d3930e8b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:51.465566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c868b0-a168-4bb5-a26c-7b8d3930e8b1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:51.470815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb966bf-762d-4d51-8655-5ae69f6a8bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:51.471480 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb966bf-762d-4d51-8655-5ae69f6a8bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:51.471762 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb966bf-762d-4d51-8655-5ae69f6a8bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:51.472066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb966bf-762d-4d51-8655-5ae69f6a8bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:51.472739 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb966bf-762d-4d51-8655-5ae69f6a8bc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:51.473035 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb966bf-762d-4d51-8655-5ae69f6a8bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:51.474457 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb966bf-762d-4d51-8655-5ae69f6a8bc1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-80c868b0-a168-4bb5-a26c-7b8d3930e8b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:51.481240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:51.482572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:51.483443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:51.483443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:51.483443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:51.483443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 249/512] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:51.483443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c868b0-a168-4bb5-a26c-7b8d3930e8b1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:51.486087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 264/513] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:56:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:51.486919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb966bf-762d-4d51-8655-5ae69f6a8bc1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:51.593169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb966bf-762d-4d51-8655-5ae69f6a8bc1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:51.594670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c868b0-a168-4bb5-a26c-7b8d3930e8b1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:51.627330 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8405e-98ce-4acf-8e5b-438ce42d7814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:51.628027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128bb6c-e327-4f60-82cb-044d1a655ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:51.628198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8405e-98ce-4acf-8e5b-438ce42d7814 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:51.628344 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8405e-98ce-4acf-8e5b-438ce42d7814 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:51.628452 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128bb6c-e327-4f60-82cb-044d1a655ae9 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:51.628553 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8405e-98ce-4acf-8e5b-438ce42d7814 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:51.628637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128bb6c-e327-4f60-82cb-044d1a655ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:51.628904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128bb6c-e327-4f60-82cb-044d1a655ae9 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:51.629206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8405e-98ce-4acf-8e5b-438ce42d7814 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:51.629502 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8405e-98ce-4acf-8e5b-438ce42d7814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:51.629865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128bb6c-e327-4f60-82cb-044d1a655ae9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:51.631177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8405e-98ce-4acf-8e5b-438ce42d7814 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:51.631271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128bb6c-e327-4f60-82cb-044d1a655ae9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:51.649082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 250/514] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Aug 30 04:56:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:51.662703 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 265/515] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:56:51 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:51.662703 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128bb6c-e327-4f60-82cb-044d1a655ae9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:51.663042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8405e-98ce-4acf-8e5b-438ce42d7814 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:51.688792 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:51.712790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:51.769295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128bb6c-e327-4f60-82cb-044d1a655ae9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:51.794928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8405e-98ce-4acf-8e5b-438ce42d7814 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:51.808673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13bc4f-59d1-4bf1-8b66-54e4cecab18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:51.809423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13bc4f-59d1-4bf1-8b66-54e4cecab18b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:51.809711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13bc4f-59d1-4bf1-8b66-54e4cecab18b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:51.809974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13bc4f-59d1-4bf1-8b66-54e4cecab18b None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:51.810994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13bc4f-59d1-4bf1-8b66-54e4cecab18b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:51.811558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13bc4f-59d1-4bf1-8b66-54e4cecab18b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:51.813128 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13bc4f-59d1-4bf1-8b66-54e4cecab18b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:51.826474 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 266/516] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:51.827711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13bc4f-59d1-4bf1-8b66-54e4cecab18b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:51.844175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786c413-20df-4773-ac26-bf0e06060a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:51.844175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c413-20df-4773-ac26-bf0e06060a30 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:51.844175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c413-20df-4773-ac26-bf0e06060a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:51.844175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c413-20df-4773-ac26-bf0e06060a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:51.917837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786c413-20df-4773-ac26-bf0e06060a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:51.919342 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786c413-20df-4773-ac26-bf0e06060a30 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:51.936597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:51.945796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13bc4f-59d1-4bf1-8b66-54e4cecab18b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:51.958034 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:51.985244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ca197-2339-4b37-bfa7-cdbd1aa4576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:51.986090 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ca197-2339-4b37-bfa7-cdbd1aa4576f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:51.986392 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ca197-2339-4b37-bfa7-cdbd1aa4576f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:51.986752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ca197-2339-4b37-bfa7-cdbd1aa4576f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:51.998902 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ca197-2339-4b37-bfa7-cdbd1aa4576f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:52.000398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ca197-2339-4b37-bfa7-cdbd1aa4576f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-2f5ca197-2339-4b37-bfa7-cdbd1aa4576f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:52.015904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:52.016851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:52.017689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:52.017689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:52.017689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:52.017689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 267/517] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:52.017898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ca197-2339-4b37-bfa7-cdbd1aa4576f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:52.035814 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 251/518] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:52.037058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786c413-20df-4773-ac26-bf0e06060a30 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:52.132663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ca197-2339-4b37-bfa7-cdbd1aa4576f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:52.139828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786c413-20df-4773-ac26-bf0e06060a30 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:52.169776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dde8d-4ed6-406b-90f7-c7bebe12f10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:52.170388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dde8d-4ed6-406b-90f7-c7bebe12f10c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:52.170649 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dde8d-4ed6-406b-90f7-c7bebe12f10c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:52.170919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dde8d-4ed6-406b-90f7-c7bebe12f10c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:52.176936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a72a1-df3f-41d0-8b03-d5247a455f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:52.177566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a72a1-df3f-41d0-8b03-d5247a455f8d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:52.177842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a72a1-df3f-41d0-8b03-d5247a455f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:52.178109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a72a1-df3f-41d0-8b03-d5247a455f8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:52.180070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:52.187576 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:52.188421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a72a1-df3f-41d0-8b03-d5247a455f8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:52.190501 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a72a1-df3f-41d0-8b03-d5247a455f8d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:52.203592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-9d3a72a1-df3f-41d0-8b03-d5247a455f8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:56:52.203592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:52.203592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:52.203592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:52.203592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:52.203592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:52.203592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:52.203592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:52.203592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:52.203592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:52.203592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:52.203592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:52.203592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:56:52.203592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:56:52.203592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:52.204658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:52.205702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:56:52.205702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:56:52.205702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:56:52.205702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:56:52.205702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:56:52.205702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:56:52.205702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:56:52.205702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:52.207363 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 252/519] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:52.208347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a72a1-df3f-41d0-8b03-d5247a455f8d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:52.256002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dde8d-4ed6-406b-90f7-c7bebe12f10c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:52.257730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dde8d-4ed6-406b-90f7-c7bebe12f10c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:52.314659 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a72a1-df3f-41d0-8b03-d5247a455f8d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:52.353188 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481e4eb-0f5b-4584-a211-5d0d9eb4d829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:52.354028 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481e4eb-0f5b-4584-a211-5d0d9eb4d829 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:52.355005 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481e4eb-0f5b-4584-a211-5d0d9eb4d829 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:52.355439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481e4eb-0f5b-4584-a211-5d0d9eb4d829 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:52.356265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481e4eb-0f5b-4584-a211-5d0d9eb4d829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:52.356702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481e4eb-0f5b-4584-a211-5d0d9eb4d829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:52.358225 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481e4eb-0f5b-4584-a211-5d0d9eb4d829 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:52.362282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 268/520] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:52.363128 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dde8d-4ed6-406b-90f7-c7bebe12f10c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:52.373069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 253/521] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:52.374198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481e4eb-0f5b-4584-a211-5d0d9eb4d829 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:52.418277 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:52.433313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:52.476990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dde8d-4ed6-406b-90f7-c7bebe12f10c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:52.479305 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481e4eb-0f5b-4584-a211-5d0d9eb4d829 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:52.514028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d4c87-78ad-40af-a185-c206854fe394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:52.514634 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d4c87-78ad-40af-a185-c206854fe394 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:52.514916 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d4c87-78ad-40af-a185-c206854fe394 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:52.515176 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d4c87-78ad-40af-a185-c206854fe394 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:52.518361 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd44ba-b4e9-4634-99ac-2ff5ee2efbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:52.519142 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd44ba-b4e9-4634-99ac-2ff5ee2efbaf None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:52.519596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd44ba-b4e9-4634-99ac-2ff5ee2efbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:52.520040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd44ba-b4e9-4634-99ac-2ff5ee2efbaf None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:52.520946 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd44ba-b4e9-4634-99ac-2ff5ee2efbaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:52.521819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd44ba-b4e9-4634-99ac-2ff5ee2efbaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:52.523812 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd44ba-b4e9-4634-99ac-2ff5ee2efbaf None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:52.524937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d4c87-78ad-40af-a185-c206854fe394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:52.526381 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d4c87-78ad-40af-a185-c206854fe394 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-cf4d4c87-78ad-40af-a185-c206854fe394 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:52.541299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:52.542952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:52.543847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:52.543847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:52.543847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:52.543847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 269/522] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:52.544207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d4c87-78ad-40af-a185-c206854fe394 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:52.545053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 254/523] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:56:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:52.546009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd44ba-b4e9-4634-99ac-2ff5ee2efbaf None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:52.652933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:52.657080 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd44ba-b4e9-4634-99ac-2ff5ee2efbaf None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:52.668162 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d4c87-78ad-40af-a185-c206854fe394 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:52.673344 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:52.694679 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace37f2-074a-4612-b22a-ced5fa63116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:52.695306 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace37f2-074a-4612-b22a-ced5fa63116a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:52.695585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace37f2-074a-4612-b22a-ced5fa63116a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:52.695850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace37f2-074a-4612-b22a-ced5fa63116a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:52.703517 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace37f2-074a-4612-b22a-ced5fa63116a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:52.704977 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace37f2-074a-4612-b22a-ced5fa63116a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:52.708577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34008b-17b8-46fa-b4a8-cb1b09f5d9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:52.709209 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34008b-17b8-46fa-b4a8-cb1b09f5d9ed None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:52.709485 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34008b-17b8-46fa-b4a8-cb1b09f5d9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:52.709754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34008b-17b8-46fa-b4a8-cb1b09f5d9ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-0ace37f2-074a-4612-b22a-ced5fa63116a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:56:52.717606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:52.718494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:52.719398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:52.719398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:52.719398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:56:52.719398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:56:52.719398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:56:52.719398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:56:52.719398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:56:52.719398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:56:52.719398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:56:52.719398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:52.719398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 255/524] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:56:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:52.720716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace37f2-074a-4612-b22a-ced5fa63116a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:52.727170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34008b-17b8-46fa-b4a8-cb1b09f5d9ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:52.728846 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34008b-17b8-46fa-b4a8-cb1b09f5d9ed None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4f34008b-17b8-46fa-b4a8-cb1b09f5d9ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:52.744818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:52.746453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:52.747364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:52.747364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:52.747364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:52.747364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 270/525] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:52.747364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34008b-17b8-46fa-b4a8-cb1b09f5d9ed None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:52.833071 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace37f2-074a-4612-b22a-ced5fa63116a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:52.871519 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b9bc-d069-4174-88aa-dcbbf40457e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:52.872165 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b9bc-d069-4174-88aa-dcbbf40457e6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:52.872449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b9bc-d069-4174-88aa-dcbbf40457e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:52.872717 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b9bc-d069-4174-88aa-dcbbf40457e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:52.873356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4b9bc-d069-4174-88aa-dcbbf40457e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:52.873658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4b9bc-d069-4174-88aa-dcbbf40457e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:52.875024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4b9bc-d069-4174-88aa-dcbbf40457e6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:52.877025 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34008b-17b8-46fa-b4a8-cb1b09f5d9ed None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:52.887982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 256/526] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:52.888151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b9bc-d069-4174-88aa-dcbbf40457e6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:52.925755 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:52.933119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f0cac-70fd-4562-8e81-efe778a59c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:52.933678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f0cac-70fd-4562-8e81-efe778a59c79 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:52.933952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f0cac-70fd-4562-8e81-efe778a59c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:52.934223 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f0cac-70fd-4562-8e81-efe778a59c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:52.934993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f0cac-70fd-4562-8e81-efe778a59c79 None admin] RBAC: Adding query filter params (role.id=2381dab0bb194ddfaf31c2933c683b71, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=1aa002909502426b80c97dbf05dca008) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:52.935298 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f0cac-70fd-4562-8e81-efe778a59c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:52.936795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f0cac-70fd-4562-8e81-efe778a59c79 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:52.942606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 271/527] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:52 2022] GET /identity/v3/role_assignments?user.id=1aa002909502426b80c97dbf05dca008&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=2381dab0bb194ddfaf31c2933c683b71 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:52.943376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f0cac-70fd-4562-8e81-efe778a59c79 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:52.967706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:53.013863 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b9bc-d069-4174-88aa-dcbbf40457e6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:53.058384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0e1fe-cca1-454e-90ee-761d1a7d5fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:53.058998 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0e1fe-cca1-454e-90ee-761d1a7d5fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:53.059276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0e1fe-cca1-454e-90ee-761d1a7d5fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:53.059536 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0e1fe-cca1-454e-90ee-761d1a7d5fd4 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:53.060761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0e1fe-cca1-454e-90ee-761d1a7d5fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:53.061062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0e1fe-cca1-454e-90ee-761d1a7d5fd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:53.062838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0e1fe-cca1-454e-90ee-761d1a7d5fd4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:53.085335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f0cac-70fd-4562-8e81-efe778a59c79 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:53.093991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 257/528] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Aug 30 04:56:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:53.093991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0e1fe-cca1-454e-90ee-761d1a7d5fd4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:53.132958 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09fba1-38d8-4fc0-846a-38d34e48421d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:53.133957 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09fba1-38d8-4fc0-846a-38d34e48421d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:53.134430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09fba1-38d8-4fc0-846a-38d34e48421d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:53.134913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09fba1-38d8-4fc0-846a-38d34e48421d None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:53.136367 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09fba1-38d8-4fc0-846a-38d34e48421d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:53.136883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09fba1-38d8-4fc0-846a-38d34e48421d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:53.138463 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09fba1-38d8-4fc0-846a-38d34e48421d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:53.156214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 272/529] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:53.157438 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09fba1-38d8-4fc0-846a-38d34e48421d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:53.212948 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:53.221350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0e1fe-cca1-454e-90ee-761d1a7d5fd4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:53.242731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:53.262779 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df4b25-6504-43e2-9d0e-2e34f87efb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:53.263755 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df4b25-6504-43e2-9d0e-2e34f87efb52 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:53.264272 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df4b25-6504-43e2-9d0e-2e34f87efb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:53.264769 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df4b25-6504-43e2-9d0e-2e34f87efb52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:53.272722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df4b25-6504-43e2-9d0e-2e34f87efb52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:53.274456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df4b25-6504-43e2-9d0e-2e34f87efb52 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:53.279098 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09fba1-38d8-4fc0-846a-38d34e48421d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:53.287160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-21df4b25-6504-43e2-9d0e-2e34f87efb52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:56:53.287160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:53.287160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:53.287160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:53.287160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:53.287160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:53.287160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:53.287160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:53.287160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:53.287160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:53.287160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:53.287160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:53.287160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:56:53.287160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:56:53.287160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:53.288086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:53.288965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:56:53.288965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:56:53.288965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:56:53.288965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:56:53.288965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:56:53.288965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:56:53.288965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:56:53.288965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:53.291601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 258/530] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:53.293617 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df4b25-6504-43e2-9d0e-2e34f87efb52 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:53.319390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dee15-41da-4a89-bb2e-f8a660e445b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:53.320029 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dee15-41da-4a89-bb2e-f8a660e445b8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:53.320304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dee15-41da-4a89-bb2e-f8a660e445b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:53.320573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dee15-41da-4a89-bb2e-f8a660e445b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:53.408749 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df4b25-6504-43e2-9d0e-2e34f87efb52 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:53.412133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dee15-41da-4a89-bb2e-f8a660e445b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:53.413798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dee15-41da-4a89-bb2e-f8a660e445b8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:53.450451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aa1cd-2367-4238-8145-d43d56b71afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:53.451230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aa1cd-2367-4238-8145-d43d56b71afa None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:53.451513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aa1cd-2367-4238-8145-d43d56b71afa None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:53.451781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aa1cd-2367-4238-8145-d43d56b71afa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:53.460378 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96aa1cd-2367-4238-8145-d43d56b71afa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:53.462127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96aa1cd-2367-4238-8145-d43d56b71afa None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:53.476424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a96aa1cd-2367-4238-8145-d43d56b71afa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:56:53.476424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:53.476424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:53.476424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:53.476424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:53.476424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:53.476424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:53.476424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:53.476424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:53.476424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:53.476424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:53.476424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:53.476424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:56:53.476424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:56:53.476424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:53.477270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:53.482992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:56:53.482992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:56:53.482992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:56:53.482992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:56:53.482992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:56:53.482992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:56:53.482992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:56:53.482992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:53.482992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 259/531] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:53.482992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aa1cd-2367-4238-8145-d43d56b71afa None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:53.498175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:53.504371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:53.548005 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 273/532] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:53.548005 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dee15-41da-4a89-bb2e-f8a660e445b8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:53.605941 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aa1cd-2367-4238-8145-d43d56b71afa None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:53.648193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5bbd9-db2f-4310-a05f-b02e6d653367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:53.648802 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5bbd9-db2f-4310-a05f-b02e6d653367 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:53.649074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5bbd9-db2f-4310-a05f-b02e6d653367 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:53.649340 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5bbd9-db2f-4310-a05f-b02e6d653367 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:53.650035 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5bbd9-db2f-4310-a05f-b02e6d653367 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:53.650334 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5bbd9-db2f-4310-a05f-b02e6d653367 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:53.652342 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5bbd9-db2f-4310-a05f-b02e6d653367 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:53.660188 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dee15-41da-4a89-bb2e-f8a660e445b8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:53.668040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 260/533] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:56:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:53.668040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5bbd9-db2f-4310-a05f-b02e6d653367 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:53.696022 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81009ba9-da80-449c-afe8-6a0e1aee470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:53.696847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81009ba9-da80-449c-afe8-6a0e1aee470a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:53.697267 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81009ba9-da80-449c-afe8-6a0e1aee470a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:53.697566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81009ba9-da80-449c-afe8-6a0e1aee470a None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:53.698779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81009ba9-da80-449c-afe8-6a0e1aee470a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:53.699085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81009ba9-da80-449c-afe8-6a0e1aee470a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:53.700559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81009ba9-da80-449c-afe8-6a0e1aee470a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:53.718146 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 274/534] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:56:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:53.719336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb032a55-58bf-4c57-bad5-f1354252bd40 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:53.719617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb032a55-58bf-4c57-bad5-f1354252bd40 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:53.719887 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb032a55-58bf-4c57-bad5-f1354252bd40 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:53.723996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 275/535] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:53.723996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb032a55-58bf-4c57-bad5-f1354252bd40 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:53.749448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:53.755075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:53.786511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5bbd9-db2f-4310-a05f-b02e6d653367 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:53.825648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732e866-28d1-42a4-8bf6-e45826ef5d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:53.826278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732e866-28d1-42a4-8bf6-e45826ef5d83 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:53.826555 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732e866-28d1-42a4-8bf6-e45826ef5d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:53.826824 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732e866-28d1-42a4-8bf6-e45826ef5d83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:53.837000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb032a55-58bf-4c57-bad5-f1354252bd40 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:53.837951 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732e866-28d1-42a4-8bf6-e45826ef5d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:53.840517 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732e866-28d1-42a4-8bf6-e45826ef5d83 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-7732e866-28d1-42a4-8bf6-e45826ef5d83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:53.859766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:53.860734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:53.861560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:53.861560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:53.861560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:53.861560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 261/536] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:53.861782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732e866-28d1-42a4-8bf6-e45826ef5d83 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:53.879430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cebe1c-5399-402c-942c-669f774b29f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:53.880327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cebe1c-5399-402c-942c-669f774b29f4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:53.880603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cebe1c-5399-402c-942c-669f774b29f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:53.880871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cebe1c-5399-402c-942c-669f774b29f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:53.881597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cebe1c-5399-402c-942c-669f774b29f4 None admin] RBAC: Adding query filter params (role.id=2381dab0bb194ddfaf31c2933c683b71, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=77d3889156524b388b761cedfac8ed6e) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:53.881905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cebe1c-5399-402c-942c-669f774b29f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:53.883343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cebe1c-5399-402c-942c-669f774b29f4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:53.895985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 276/537] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:53 2022] GET /identity/v3/role_assignments?user.id=77d3889156524b388b761cedfac8ed6e&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=2381dab0bb194ddfaf31c2933c683b71 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:53.895985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecea63-689e-4ab3-9ffc-8c7becd9fb9b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:53.895985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecea63-689e-4ab3-9ffc-8c7becd9fb9b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:53.895985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecea63-689e-4ab3-9ffc-8c7becd9fb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:53.910611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c5ecea63-689e-4ab3-9ffc-8c7becd9fb9b None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:53.911842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c5ecea63-689e-4ab3-9ffc-8c7becd9fb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:53.997232 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732e866-28d1-42a4-8bf6-e45826ef5d83 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:54.007758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 277/538] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:54.008670 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecea63-689e-4ab3-9ffc-8c7becd9fb9b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:54.051299 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:54.061140 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:54.068441 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274abd2-9b71-43da-886a-df95b43d28bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:54.069419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274abd2-9b71-43da-886a-df95b43d28bf None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:54.069896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274abd2-9b71-43da-886a-df95b43d28bf None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:54.070861 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274abd2-9b71-43da-886a-df95b43d28bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:54.072258 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274abd2-9b71-43da-886a-df95b43d28bf None admin] RBAC: Adding query filter params (role.id=2381dab0bb194ddfaf31c2933c683b71, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=eee3162303924aaeb91af567f02980e2) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:54.072791 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274abd2-9b71-43da-886a-df95b43d28bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:54.075226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274abd2-9b71-43da-886a-df95b43d28bf None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:54.082489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 262/539] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:53 2022] GET /identity/v3/role_assignments?user.id=eee3162303924aaeb91af567f02980e2&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=2381dab0bb194ddfaf31c2933c683b71 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:54.161112 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecea63-689e-4ab3-9ffc-8c7becd9fb9b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:54.207752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795d98f-d17c-4d25-a244-c6d77de92911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:54.208412 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795d98f-d17c-4d25-a244-c6d77de92911 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:54.208689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795d98f-d17c-4d25-a244-c6d77de92911 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:54.208959 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795d98f-d17c-4d25-a244-c6d77de92911 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:54.209624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795d98f-d17c-4d25-a244-c6d77de92911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:54.209923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795d98f-d17c-4d25-a244-c6d77de92911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:54.211315 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795d98f-d17c-4d25-a244-c6d77de92911 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:54.230258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 278/540] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:54.236398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274abd2-9b71-43da-886a-df95b43d28bf None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:54.340093 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795d98f-d17c-4d25-a244-c6d77de92911 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:54.364649 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274abd2-9b71-43da-886a-df95b43d28bf None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:54.436317 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:54.440917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb286e54-1cce-4870-8d7b-f76625e5d59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:54.442456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb286e54-1cce-4870-8d7b-f76625e5d59e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:54.442932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb286e54-1cce-4870-8d7b-f76625e5d59e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:54.443415 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb286e54-1cce-4870-8d7b-f76625e5d59e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:54.453067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795d98f-d17c-4d25-a244-c6d77de92911 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:54.465086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb286e54-1cce-4870-8d7b-f76625e5d59e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:54.466591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb286e54-1cce-4870-8d7b-f76625e5d59e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:54.480147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-cb286e54-1cce-4870-8d7b-f76625e5d59e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:56:54.480147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:54.480147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:54.480147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:54.480147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:54.480147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:54.480147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:54.480147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:54.480147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:54.480147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:54.480147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:54.480147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:54.480147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:56:54.480147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:56:54.480147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:54.481027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:54.481857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:56:54.481857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:56:54.481857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:56:54.481857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:56:54.481857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:56:54.481857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:56:54.481857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:56:54.481857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:54.481857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 263/541] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:54.486699 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb286e54-1cce-4870-8d7b-f76625e5d59e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:54.503914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ef80a-b4a9-49e2-a174-089faffd8588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:54.504895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ef80a-b4a9-49e2-a174-089faffd8588 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:54.505172 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ef80a-b4a9-49e2-a174-089faffd8588 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:54.505500 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ef80a-b4a9-49e2-a174-089faffd8588 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:54.527418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ef80a-b4a9-49e2-a174-089faffd8588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-420ef80a-b4a9-49e2-a174-089faffd8588 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:54.536894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:54.537816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:54.538613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:54.538613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:54.538613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:54.538613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:54.538613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:54.538613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:54.538613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:54.538613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:54.538613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:54.538613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:54.538613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:54.538613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:54.545557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 279/542] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:56:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:54.561746 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ef80a-b4a9-49e2-a174-089faffd8588 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:54.593936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:54.699507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb286e54-1cce-4870-8d7b-f76625e5d59e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:54.714592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ef80a-b4a9-49e2-a174-089faffd8588 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:54.746881 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa043567-a38a-4509-aa0c-da04ba882a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:54.747534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa043567-a38a-4509-aa0c-da04ba882a40 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:54.747815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa043567-a38a-4509-aa0c-da04ba882a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:54.748154 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa043567-a38a-4509-aa0c-da04ba882a40 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:54.748860 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa043567-a38a-4509-aa0c-da04ba882a40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:54.749162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa043567-a38a-4509-aa0c-da04ba882a40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:54.750732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa043567-a38a-4509-aa0c-da04ba882a40 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:54.768076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 264/543] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:56:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:54.770909 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa043567-a38a-4509-aa0c-da04ba882a40 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:54.796237 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c68de-d26e-421b-8be5-1f1073e10aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:54.796847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c68de-d26e-421b-8be5-1f1073e10aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:54.797120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c68de-d26e-421b-8be5-1f1073e10aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:54.797387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c68de-d26e-421b-8be5-1f1073e10aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:54.798052 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c68de-d26e-421b-8be5-1f1073e10aa6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:54.798471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c68de-d26e-421b-8be5-1f1073e10aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:54.802085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c68de-d26e-421b-8be5-1f1073e10aa6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:54.820159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 280/544] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:56:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:54.826687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c68de-d26e-421b-8be5-1f1073e10aa6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:54.838827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:54.911356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa043567-a38a-4509-aa0c-da04ba882a40 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:54.923282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:54.953307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be4fea-7c0d-47d4-a684-26541aa892a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:54.954085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be4fea-7c0d-47d4-a684-26541aa892a8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:54.954410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be4fea-7c0d-47d4-a684-26541aa892a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:54.954684 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be4fea-7c0d-47d4-a684-26541aa892a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:54.955984 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be4fea-7c0d-47d4-a684-26541aa892a8 None admin] RBAC: Adding query filter params (role.id=2381dab0bb194ddfaf31c2933c683b71, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=4398d5175c8c409789d62c277da35ed7) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:54.956303 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be4fea-7c0d-47d4-a684-26541aa892a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:54.957879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be4fea-7c0d-47d4-a684-26541aa892a8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:54.969869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 265/545] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:54 2022] GET /identity/v3/role_assignments?user.id=4398d5175c8c409789d62c277da35ed7&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=2381dab0bb194ddfaf31c2933c683b71 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:55.022952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c68de-d26e-421b-8be5-1f1073e10aa6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:55.078223 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93bfb1-4ccf-4d05-a4ba-7e68e56eb663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:55.079293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93bfb1-4ccf-4d05-a4ba-7e68e56eb663 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:55.080977 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c11230-ced5-4f68-8a1a-2e57f36d66be None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:55.081464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c11230-ced5-4f68-8a1a-2e57f36d66be None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:55.081920 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c11230-ced5-4f68-8a1a-2e57f36d66be None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:55.084054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 266/546] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:55.084663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93bfb1-4ccf-4d05-a4ba-7e68e56eb663 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:55.085150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93bfb1-4ccf-4d05-a4ba-7e68e56eb663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:55.090004 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dec1cc-3058-4273-ba84-1ad84f81a86f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:55.090276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dec1cc-3058-4273-ba84-1ad84f81a86f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:55.090546 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dec1cc-3058-4273-ba84-1ad84f81a86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:55.100214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93bfb1-4ccf-4d05-a4ba-7e68e56eb663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:55.102190 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93bfb1-4ccf-4d05-a4ba-7e68e56eb663 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:55.118806 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-36dec1cc-3058-4273-ba84-1ad84f81a86f None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:55.120609 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-36dec1cc-3058-4273-ba84-1ad84f81a86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ca93bfb1-4ccf-4d05-a4ba-7e68e56eb663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:55.120831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:55.121702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:55.122516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:55.122516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:55.122516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:55.130884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 281/547] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:55.139150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93bfb1-4ccf-4d05-a4ba-7e68e56eb663 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:55.220314 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:55.254876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 267/548] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:55.271106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93bfb1-4ccf-4d05-a4ba-7e68e56eb663 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:55.306627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776931c2-77bd-4233-89c6-411149221a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:55.307231 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776931c2-77bd-4233-89c6-411149221a93 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:55.308104 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776931c2-77bd-4233-89c6-411149221a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:55.308375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776931c2-77bd-4233-89c6-411149221a93 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:55.309011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776931c2-77bd-4233-89c6-411149221a93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:55.309309 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776931c2-77bd-4233-89c6-411149221a93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:55.310731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776931c2-77bd-4233-89c6-411149221a93 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:55.325815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 282/549] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:55.328479 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dec1cc-3058-4273-ba84-1ad84f81a86f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:55.476271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dec1cc-3058-4273-ba84-1ad84f81a86f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:55.479671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:55.528658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac13cd-7cdf-447c-98e9-b8e9c230bd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:55.529670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac13cd-7cdf-447c-98e9-b8e9c230bd13 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:55.530142 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac13cd-7cdf-447c-98e9-b8e9c230bd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:55.530620 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac13cd-7cdf-447c-98e9-b8e9c230bd13 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:55.538541 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac13cd-7cdf-447c-98e9-b8e9c230bd13 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:55.540268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac13cd-7cdf-447c-98e9-b8e9c230bd13 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:55.545712 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776931c2-77bd-4233-89c6-411149221a93 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8bac13cd-7cdf-447c-98e9-b8e9c230bd13 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:56:55.556264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:55.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:55.558888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:55.558888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:55.558888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:56:55.558888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:56:55.558888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:56:55.558888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:56:55.558888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:56:55.558888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:56:55.558888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:56:55.558888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:55.561379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 268/550] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:56:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:55.573654 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac13cd-7cdf-447c-98e9-b8e9c230bd13 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:55.695731 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac13cd-7cdf-447c-98e9-b8e9c230bd13 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:55.736904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9ddeb-e2b0-4626-8b0b-498e24cc0144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:55.737532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9ddeb-e2b0-4626-8b0b-498e24cc0144 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:55.737766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9ddeb-e2b0-4626-8b0b-498e24cc0144 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:55.737980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9ddeb-e2b0-4626-8b0b-498e24cc0144 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:55.738714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9ddeb-e2b0-4626-8b0b-498e24cc0144 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:55.739014 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9ddeb-e2b0-4626-8b0b-498e24cc0144 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:55.740464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9ddeb-e2b0-4626-8b0b-498e24cc0144 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:55.748179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776931c2-77bd-4233-89c6-411149221a93 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:55.777820 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 269/551] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Aug 30 04:56:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:55.783012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9ddeb-e2b0-4626-8b0b-498e24cc0144 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:55.790993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:55.816758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75ca3c-daee-4009-bd5c-d3dc0f5663e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:55.817991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75ca3c-daee-4009-bd5c-d3dc0f5663e7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:55.818463 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75ca3c-daee-4009-bd5c-d3dc0f5663e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:55.818943 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75ca3c-daee-4009-bd5c-d3dc0f5663e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:55.828582 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:55.830743 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75ca3c-daee-4009-bd5c-d3dc0f5663e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4b75ca3c-daee-4009-bd5c-d3dc0f5663e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:55.836028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:55.836898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:55.837868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:55.837868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:55.837868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:55.837868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:55.837868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:55.837868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:55.837868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:55.837868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:55.837868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:55.837868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:55.837868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:55.837868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:55.840434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 283/552] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:56:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:56:55.846656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75ca3c-daee-4009-bd5c-d3dc0f5663e7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:55.973020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75ca3c-daee-4009-bd5c-d3dc0f5663e7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:55.976285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9ddeb-e2b0-4626-8b0b-498e24cc0144 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:56.010791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8f98c-970f-4a37-af03-6037661a27de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:56.011821 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8f98c-970f-4a37-af03-6037661a27de None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:56.012370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8f98c-970f-4a37-af03-6037661a27de None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:56.012831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8f98c-970f-4a37-af03-6037661a27de None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:56.013696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8f98c-970f-4a37-af03-6037661a27de None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:56.014252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8f98c-970f-4a37-af03-6037661a27de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:56.016196 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8f98c-970f-4a37-af03-6037661a27de None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:56.025441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 284/553] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:56:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:56.031053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8f98c-970f-4a37-af03-6037661a27de None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:56.049935 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed215d7-aef3-444c-8759-97a9d8ee4f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:56.050895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed215d7-aef3-444c-8759-97a9d8ee4f48 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:56.051387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed215d7-aef3-444c-8759-97a9d8ee4f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:56.051848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed215d7-aef3-444c-8759-97a9d8ee4f48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:56.104361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:56.152972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8f98c-970f-4a37-af03-6037661a27de None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:56.190378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2a9d6-f518-47bf-907b-262a9305f782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:56.191389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2a9d6-f518-47bf-907b-262a9305f782 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:56.191859 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2a9d6-f518-47bf-907b-262a9305f782 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:56.196108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2a9d6-f518-47bf-907b-262a9305f782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:56.211721 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2a9d6-f518-47bf-907b-262a9305f782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:56.212398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed215d7-aef3-444c-8759-97a9d8ee4f48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:56.213909 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed215d7-aef3-444c-8759-97a9d8ee4f48 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:56.215434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2a9d6-f518-47bf-907b-262a9305f782 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-11b2a9d6-f518-47bf-907b-262a9305f782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:56.234625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:56.235594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:56.236560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:56.236560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:56.236560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:56.237445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:56.240016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 285/554] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:56:56.241704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f955d6-8728-4c0f-a0a5-784a5f1e0b06 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:56.242552 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f955d6-8728-4c0f-a0a5-784a5f1e0b06 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:56.243265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f955d6-8728-4c0f-a0a5-784a5f1e0b06 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:56.248866 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 286/555] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:56.249606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f955d6-8728-4c0f-a0a5-784a5f1e0b06 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:56.343481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 270/556] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:56.344867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989887ee-7fe2-4ef1-b3e9-4bf613d21c10 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:56.345147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989887ee-7fe2-4ef1-b3e9-4bf613d21c10 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:56.345420 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989887ee-7fe2-4ef1-b3e9-4bf613d21c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:56.364722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-989887ee-7fe2-4ef1-b3e9-4bf613d21c10 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:56.365911 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-989887ee-7fe2-4ef1-b3e9-4bf613d21c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:56.389864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:56.401473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f955d6-8728-4c0f-a0a5-784a5f1e0b06 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:56.448370 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 271/557] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:56.448370 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989887ee-7fe2-4ef1-b3e9-4bf613d21c10 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:56.462255 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845596b-c6b3-4c86-992a-3bd13a4f8caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:56.462864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845596b-c6b3-4c86-992a-3bd13a4f8caf None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:56.463139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845596b-c6b3-4c86-992a-3bd13a4f8caf None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:56.463411 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845596b-c6b3-4c86-992a-3bd13a4f8caf None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:56.465394 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845596b-c6b3-4c86-992a-3bd13a4f8caf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:56.465698 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845596b-c6b3-4c86-992a-3bd13a4f8caf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:56.467079 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845596b-c6b3-4c86-992a-3bd13a4f8caf None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:56.493454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 287/558] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:56.498044 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845596b-c6b3-4c86-992a-3bd13a4f8caf None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:56.543851 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:56.620664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989887ee-7fe2-4ef1-b3e9-4bf613d21c10 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:56.657976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cef4fd-27a2-43d9-a430-354d9b9a4a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:56.658691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cef4fd-27a2-43d9-a430-354d9b9a4a6a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:56.658965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cef4fd-27a2-43d9-a430-354d9b9a4a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:56.659234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cef4fd-27a2-43d9-a430-354d9b9a4a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:56.667643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845596b-c6b3-4c86-992a-3bd13a4f8caf None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:56.670453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cef4fd-27a2-43d9-a430-354d9b9a4a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:56.671927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cef4fd-27a2-43d9-a430-354d9b9a4a6a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f9cef4fd-27a2-43d9-a430-354d9b9a4a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:56.688373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:56.689336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:56.690214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:56.690214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:56.690214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:56.694133 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 272/559] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:56.695425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09810bb3-f9be-4a15-9a9c-b74d66072593 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:56.695706 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09810bb3-f9be-4a15-9a9c-b74d66072593 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:56.695989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09810bb3-f9be-4a15-9a9c-b74d66072593 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:56.697743 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 273/560] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:56.698661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09810bb3-f9be-4a15-9a9c-b74d66072593 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:56.715024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69140ae-7d1a-4a27-b26e-73b97b2db3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:56.715903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69140ae-7d1a-4a27-b26e-73b97b2db3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:56.716215 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69140ae-7d1a-4a27-b26e-73b97b2db3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:56.717007 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69140ae-7d1a-4a27-b26e-73b97b2db3f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:56.726436 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69140ae-7d1a-4a27-b26e-73b97b2db3f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:56.728681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69140ae-7d1a-4a27-b26e-73b97b2db3f3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-e69140ae-7d1a-4a27-b26e-73b97b2db3f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:56:56.744462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:56.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:56.749027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:56.749027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:56.749027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:56:56.749027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:56:56.749027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:56:56.749027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:56:56.749027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:56:56.749027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:56:56.749027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:56:56.749027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:56.755981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 288/561] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Aug 30 04:56:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:56.755981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5d61-7fdb-4812-99e1-bd8a28200478 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:56.755981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5d61-7fdb-4812-99e1-bd8a28200478 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:56.755981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5d61-7fdb-4812-99e1-bd8a28200478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:56.775093 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8a4f5d61-7fdb-4812-99e1-bd8a28200478 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:56.776843 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8a4f5d61-7fdb-4812-99e1-bd8a28200478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:56.787146 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:56.826067 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09810bb3-f9be-4a15-9a9c-b74d66072593 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:56.827586 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:56.850905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 289/562] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:56.851754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f5d61-7fdb-4812-99e1-bd8a28200478 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:56.873857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af00ed-2a5d-4040-8650-28ea6d6cca9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:56.874854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af00ed-2a5d-4040-8650-28ea6d6cca9a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:56.875319 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af00ed-2a5d-4040-8650-28ea6d6cca9a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:56.875656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af00ed-2a5d-4040-8650-28ea6d6cca9a None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:56.876492 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af00ed-2a5d-4040-8650-28ea6d6cca9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:56.876908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af00ed-2a5d-4040-8650-28ea6d6cca9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:56.878610 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af00ed-2a5d-4040-8650-28ea6d6cca9a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:56.897358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 274/563] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:56.898476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af00ed-2a5d-4040-8650-28ea6d6cca9a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:56.979169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f5d61-7fdb-4812-99e1-bd8a28200478 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:57.019547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af00ed-2a5d-4040-8650-28ea6d6cca9a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:57.025843 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49259f01-2ed6-4170-95ca-7fa326785174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:57.027092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49259f01-2ed6-4170-95ca-7fa326785174 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:57.027373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49259f01-2ed6-4170-95ca-7fa326785174 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:57.027647 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49259f01-2ed6-4170-95ca-7fa326785174 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:57.028418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49259f01-2ed6-4170-95ca-7fa326785174 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:57.028728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49259f01-2ed6-4170-95ca-7fa326785174 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:57.030639 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49259f01-2ed6-4170-95ca-7fa326785174 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:57.052476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 290/564] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Aug 30 04:56:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:57.053676 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49259f01-2ed6-4170-95ca-7fa326785174 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:57.056954 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:57.066300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a223a-05ea-4452-b45f-1ea6dadb9adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:57.067371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a223a-05ea-4452-b45f-1ea6dadb9adc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:57.067878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a223a-05ea-4452-b45f-1ea6dadb9adc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:57.068481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a223a-05ea-4452-b45f-1ea6dadb9adc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:57.080996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a223a-05ea-4452-b45f-1ea6dadb9adc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-9a0a223a-05ea-4452-b45f-1ea6dadb9adc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:57.086538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:57.087473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:57.088351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:57.088351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:57.088351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:57.088351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:57.088351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:57.088351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:57.088351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:57.088351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:57.088351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:57.088351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:57.088351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:57.088351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:57.091182 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 275/565] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:56:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:57.092265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a223a-05ea-4452-b45f-1ea6dadb9adc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:57.122815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:57.177466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49259f01-2ed6-4170-95ca-7fa326785174 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:57.204230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a223a-05ea-4452-b45f-1ea6dadb9adc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:57.211088 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3a963-93b7-4288-8c00-eee3abc52eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:57.211712 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3a963-93b7-4288-8c00-eee3abc52eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:57.212014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3a963-93b7-4288-8c00-eee3abc52eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:57.212284 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3a963-93b7-4288-8c00-eee3abc52eb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:57.219348 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3a963-93b7-4288-8c00-eee3abc52eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:57.220817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3a963-93b7-4288-8c00-eee3abc52eb2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:57.233833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-35a3a963-93b7-4288-8c00-eee3abc52eb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:56:57.233833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:57.233833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:57.233833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:57.233833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:57.233833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:57.233833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:57.233833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:57.233833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:57.233833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:57.233833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:57.233833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:57.233833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:56:57.233833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:56:57.233833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:57.234730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:57.235629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:56:57.235629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:56:57.235629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:56:57.235629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:56:57.235629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:56:57.235629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:56:57.235629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:56:57.235629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:57.235629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 291/566] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:57.235629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3a963-93b7-4288-8c00-eee3abc52eb2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:57.240995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f93ae6-1e39-49a5-89fe-a24a6596996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:57.242361 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f93ae6-1e39-49a5-89fe-a24a6596996b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:57.242361 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f93ae6-1e39-49a5-89fe-a24a6596996b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:57.242361 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f93ae6-1e39-49a5-89fe-a24a6596996b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:57.253394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f93ae6-1e39-49a5-89fe-a24a6596996b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:57.255522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f93ae6-1e39-49a5-89fe-a24a6596996b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-75f93ae6-1e39-49a5-89fe-a24a6596996b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:57.270026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:57.271009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:57.271908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:57.271908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:57.271908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:57.271908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 276/567] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:57.271908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f93ae6-1e39-49a5-89fe-a24a6596996b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:57.302796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:57.342350 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3a963-93b7-4288-8c00-eee3abc52eb2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:57.347144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:57.372467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f93ae6-1e39-49a5-89fe-a24a6596996b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:57.375742 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f93bc-0a90-4b3d-90d1-48b4b29e7b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:57.376366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f93bc-0a90-4b3d-90d1-48b4b29e7b4f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:57.376697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f93bc-0a90-4b3d-90d1-48b4b29e7b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:57.376899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f93bc-0a90-4b3d-90d1-48b4b29e7b4f None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:57.377553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f93bc-0a90-4b3d-90d1-48b4b29e7b4f None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:57.377846 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f93bc-0a90-4b3d-90d1-48b4b29e7b4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:57.379224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f93bc-0a90-4b3d-90d1-48b4b29e7b4f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:57.388037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 292/568] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:56:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:57.392833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc64b7-ffac-4314-a070-d3f57a3690ec None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:57.392833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc64b7-ffac-4314-a070-d3f57a3690ec None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:57.392833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc64b7-ffac-4314-a070-d3f57a3690ec None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:57.392833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 293/569] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:56:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:56:57.392833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc64b7-ffac-4314-a070-d3f57a3690ec None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:57.409773 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc76471-7a6a-4853-bbe7-5f3d8f131ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:57.410402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc76471-7a6a-4853-bbe7-5f3d8f131ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:57.410680 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc76471-7a6a-4853-bbe7-5f3d8f131ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:57.410947 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc76471-7a6a-4853-bbe7-5f3d8f131ed6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:57.420832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc76471-7a6a-4853-bbe7-5f3d8f131ed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-3bc76471-7a6a-4853-bbe7-5f3d8f131ed6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:57.426000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:57.427085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:57.427917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:57.427917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:57.427917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:57.427917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:57.427917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:57.427917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:57.427917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:57.427917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:57.427917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:57.427917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:57.427917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:57.427917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:57.427917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 277/570] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:56:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:57.427917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc76471-7a6a-4853-bbe7-5f3d8f131ed6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:57.493940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc64b7-ffac-4314-a070-d3f57a3690ec None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:57.517056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:57.527711 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc76471-7a6a-4853-bbe7-5f3d8f131ed6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:57.528336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51513420-5e25-4ccd-b6ad-6199fd848b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:57.528939 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51513420-5e25-4ccd-b6ad-6199fd848b95 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:57.529217 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51513420-5e25-4ccd-b6ad-6199fd848b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:57.529485 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51513420-5e25-4ccd-b6ad-6199fd848b95 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:57.530175 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51513420-5e25-4ccd-b6ad-6199fd848b95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:57.530478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51513420-5e25-4ccd-b6ad-6199fd848b95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:57.531900 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51513420-5e25-4ccd-b6ad-6199fd848b95 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:57.543747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 294/571] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:56:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:57.544580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51513420-5e25-4ccd-b6ad-6199fd848b95 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:57.566349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a16394-fbc3-4dc7-825e-f56ab5795fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:57.566947 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a16394-fbc3-4dc7-825e-f56ab5795fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:57.567219 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a16394-fbc3-4dc7-825e-f56ab5795fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:57.567483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a16394-fbc3-4dc7-825e-f56ab5795fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:57.568219 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a16394-fbc3-4dc7-825e-f56ab5795fc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:57.568516 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a16394-fbc3-4dc7-825e-f56ab5795fc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:57.569922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a16394-fbc3-4dc7-825e-f56ab5795fc5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:57.571421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:57.583078 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 278/572] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:57.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe766f-2495-4be6-8ba2-1734610fd4fe None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:57.584570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe766f-2495-4be6-8ba2-1734610fd4fe None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:57.584835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe766f-2495-4be6-8ba2-1734610fd4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:57.602204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9bbe766f-2495-4be6-8ba2-1734610fd4fe None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:57.603384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9bbe766f-2495-4be6-8ba2-1734610fd4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:57.648830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51513420-5e25-4ccd-b6ad-6199fd848b95 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:57.671026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 279/573] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:57.671847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe766f-2495-4be6-8ba2-1734610fd4fe None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:57.684615 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6711cd-e681-4460-bb48-9b8fb87c1aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:57.685251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6711cd-e681-4460-bb48-9b8fb87c1aaa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:57.685528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6711cd-e681-4460-bb48-9b8fb87c1aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:57.685799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6711cd-e681-4460-bb48-9b8fb87c1aaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:57.695834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6711cd-e681-4460-bb48-9b8fb87c1aaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:57.697295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6711cd-e681-4460-bb48-9b8fb87c1aaa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-2e6711cd-e681-4460-bb48-9b8fb87c1aaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:57.713004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:57.713999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:57.719782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:57.719782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:57.719782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:57.719782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 295/574] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:57.719782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6711cd-e681-4460-bb48-9b8fb87c1aaa None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:57.753609 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:57.783357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe766f-2495-4be6-8ba2-1734610fd4fe None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:57.810262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:57.821899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6711cd-e681-4460-bb48-9b8fb87c1aaa None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:57.822353 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c58ab-e47f-4509-b40a-aee28c7a99be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:57.823613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c58ab-e47f-4509-b40a-aee28c7a99be None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:57.823791 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c58ab-e47f-4509-b40a-aee28c7a99be None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:57.824072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c58ab-e47f-4509-b40a-aee28c7a99be None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:57.824726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c58ab-e47f-4509-b40a-aee28c7a99be None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:57.825031 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c58ab-e47f-4509-b40a-aee28c7a99be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:57.826712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c58ab-e47f-4509-b40a-aee28c7a99be None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:57.837794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 280/575] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:56:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:57.839276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c58ab-e47f-4509-b40a-aee28c7a99be None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:57.867261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b735e-534c-4a02-bdfe-1b244672dec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:57.867865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b735e-534c-4a02-bdfe-1b244672dec1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:57.868186 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b735e-534c-4a02-bdfe-1b244672dec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:57.868459 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b735e-534c-4a02-bdfe-1b244672dec1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:57.869186 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b735e-534c-4a02-bdfe-1b244672dec1 None admin] RBAC: Adding query filter params (role.id=2381dab0bb194ddfaf31c2933c683b71, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=a96ac878c106422ebf438a64ca618747) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:57.869493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b735e-534c-4a02-bdfe-1b244672dec1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:57.870933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b735e-534c-4a02-bdfe-1b244672dec1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:57.876476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 296/576] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:56:57 2022] GET /identity/v3/role_assignments?user.id=a96ac878c106422ebf438a64ca618747&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=2381dab0bb194ddfaf31c2933c683b71 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:57.877143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b735e-534c-4a02-bdfe-1b244672dec1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:57.964992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c58ab-e47f-4509-b40a-aee28c7a99be None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:57.998514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:58.001501 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b735e-534c-4a02-bdfe-1b244672dec1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:58.009922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23558ac-3016-4d11-9898-e3ece93d8e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:58.010655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23558ac-3016-4d11-9898-e3ece93d8e97 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:58.010929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23558ac-3016-4d11-9898-e3ece93d8e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:58.011197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23558ac-3016-4d11-9898-e3ece93d8e97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:58.018554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23558ac-3016-4d11-9898-e3ece93d8e97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:58.020040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23558ac-3016-4d11-9898-e3ece93d8e97 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:58.032365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-d23558ac-3016-4d11-9898-e3ece93d8e97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:56:58.032365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:58.032365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:58.032365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:58.032365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:58.032365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:58.032365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:58.032365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:58.032365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:58.032365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:58.032365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:58.032365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:58.032365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:56:58.032365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:56:58.032365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:58.033462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:58.039333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:56:58.039333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:56:58.039333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:56:58.039333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:56:58.039333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:56:58.039333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:56:58.039333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:56:58.039333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:58.039333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 281/577] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:58.039333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23558ac-3016-4d11-9898-e3ece93d8e97 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:58.045051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa0ea7-f88c-45d0-b261-f58f940fe136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:58.046417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa0ea7-f88c-45d0-b261-f58f940fe136 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:58.046691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa0ea7-f88c-45d0-b261-f58f940fe136 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:58.046959 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa0ea7-f88c-45d0-b261-f58f940fe136 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:58.047602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa0ea7-f88c-45d0-b261-f58f940fe136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:58.047919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa0ea7-f88c-45d0-b261-f58f940fe136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:58.049323 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa0ea7-f88c-45d0-b261-f58f940fe136 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:58.062156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 297/578] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:58.063102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa0ea7-f88c-45d0-b261-f58f940fe136 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:58.093908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:58.154054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23558ac-3016-4d11-9898-e3ece93d8e97 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:58.168324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa0ea7-f88c-45d0-b261-f58f940fe136 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:58.191471 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c97c87-e3a0-4d3a-bf67-88d58664b884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:58.192135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c97c87-e3a0-4d3a-bf67-88d58664b884 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:58.192441 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c97c87-e3a0-4d3a-bf67-88d58664b884 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:58.192713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c97c87-e3a0-4d3a-bf67-88d58664b884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:58.203615 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c97c87-e3a0-4d3a-bf67-88d58664b884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:58.204080 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88239182-3638-40ac-bfb8-57a5f859ef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:58.204708 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88239182-3638-40ac-bfb8-57a5f859ef99 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:58.204979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88239182-3638-40ac-bfb8-57a5f859ef99 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:58.205137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c97c87-e3a0-4d3a-bf67-88d58664b884 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:58.205240 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88239182-3638-40ac-bfb8-57a5f859ef99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:58.216038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88239182-3638-40ac-bfb8-57a5f859ef99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-49c97c87-e3a0-4d3a-bf67-88d58664b884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:58.220008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:58.220986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:58.221879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:58.221879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:58.221879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-88239182-3638-40ac-bfb8-57a5f859ef99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:56:58.222049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:58.222879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:58.223704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:58.223704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:58.223704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:58.223704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:58.223704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:56:58.223704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:56:58.223704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:56:58.223704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:56:58.223704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:56:58.223704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:56:58.223704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:56:58.223704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:58.226038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 282/579] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:58.226038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c97c87-e3a0-4d3a-bf67-88d58664b884 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:58.226305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 298/580] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:56:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:58.227271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88239182-3638-40ac-bfb8-57a5f859ef99 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:58.252253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:58.335866 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88239182-3638-40ac-bfb8-57a5f859ef99 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:58.349446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:58.354069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c97c87-e3a0-4d3a-bf67-88d58664b884 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:58.373608 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e7bf9-1a53-4456-bd1f-3e2ced30c4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:58.374231 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e7bf9-1a53-4456-bd1f-3e2ced30c4ea None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:58.374502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e7bf9-1a53-4456-bd1f-3e2ced30c4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:58.374766 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e7bf9-1a53-4456-bd1f-3e2ced30c4ea None admin] PATH_INFO: `/v3/users/glance` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:58.382002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e7bf9-1a53-4456-bd1f-3e2ced30c4ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:58.383670 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e7bf9-1a53-4456-bd1f-3e2ced30c4ea None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:58.392377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5bf06-6e6b-41d8-bdf9-58a189139ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:58.394170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5bf06-6e6b-41d8-bdf9-58a189139ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:58.394626 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5bf06-6e6b-41d8-bdf9-58a189139ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:58.394894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5bf06-6e6b-41d8-bdf9-58a189139ad0 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:58.395588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5bf06-6e6b-41d8-bdf9-58a189139ad0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:58.395887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5bf06-6e6b-41d8-bdf9-58a189139ad0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:58.397334 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5bf06-6e6b-41d8-bdf9-58a189139ad0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f49e7bf9-1a53-4456-bd1f-3e2ced30c4ea None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:56:58.397872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:58.398799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:58.399796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:58.399796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:58.399796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:56:58.399796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:56:58.399796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:56:58.399796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:56:58.399796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:56:58.399796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:56:58.399796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:56:58.399796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:58.399796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 299/581] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:58.399796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e7bf9-1a53-4456-bd1f-3e2ced30c4ea None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:58.415131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 283/582] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:56:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:58.422020 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5bf06-6e6b-41d8-bdf9-58a189139ad0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:58.484949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:58.506299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e7bf9-1a53-4456-bd1f-3e2ced30c4ea None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:58.532551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5bf06-6e6b-41d8-bdf9-58a189139ad0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:58.541035 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd80b5-4163-4268-8fa7-368ffd0acb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:58.542275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd80b5-4163-4268-8fa7-368ffd0acb73 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:58.542650 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd80b5-4163-4268-8fa7-368ffd0acb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:58.543035 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd80b5-4163-4268-8fa7-368ffd0acb73 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:58.543757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd80b5-4163-4268-8fa7-368ffd0acb73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:58.544184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd80b5-4163-4268-8fa7-368ffd0acb73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:58.545635 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd80b5-4163-4268-8fa7-368ffd0acb73 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:58.558187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 300/583] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:58.558187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd80b5-4163-4268-8fa7-368ffd0acb73 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:58.572213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4c432-4d2e-41cb-98a6-28c1757e3830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:58.573487 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4c432-4d2e-41cb-98a6-28c1757e3830 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:58.573856 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4c432-4d2e-41cb-98a6-28c1757e3830 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:58.574235 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4c432-4d2e-41cb-98a6-28c1757e3830 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:58.574992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4c432-4d2e-41cb-98a6-28c1757e3830 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:58.575383 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4c432-4d2e-41cb-98a6-28c1757e3830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:58.576862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4c432-4d2e-41cb-98a6-28c1757e3830 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:58.584951 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 284/584] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:56:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:58.585712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4c432-4d2e-41cb-98a6-28c1757e3830 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:58.626332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:58.696997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd80b5-4163-4268-8fa7-368ffd0acb73 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:58.729688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4c432-4d2e-41cb-98a6-28c1757e3830 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:58.736208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7bb0e-72a0-400d-b6ec-bbdd21e62c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:58.736826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7bb0e-72a0-400d-b6ec-bbdd21e62c31 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:58.737100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7bb0e-72a0-400d-b6ec-bbdd21e62c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:58.737369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7bb0e-72a0-400d-b6ec-bbdd21e62c31 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:58.738213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7bb0e-72a0-400d-b6ec-bbdd21e62c31 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:58.738517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7bb0e-72a0-400d-b6ec-bbdd21e62c31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:58.740099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7bb0e-72a0-400d-b6ec-bbdd21e62c31 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:58.750462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:58.765258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 301/585] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Aug 30 04:56:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:58.765258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7bb0e-72a0-400d-b6ec-bbdd21e62c31 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:58.768468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87597a37-e711-4563-955e-d7198a6ab192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:58.769131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87597a37-e711-4563-955e-d7198a6ab192 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:58.769395 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87597a37-e711-4563-955e-d7198a6ab192 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:58.769661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87597a37-e711-4563-955e-d7198a6ab192 None admin] PATH_INFO: `/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/1aa002909502426b80c97dbf05dca008/roles/2381dab0bb194ddfaf31c2933c683b71` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:58.785251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87597a37-e711-4563-955e-d7198a6ab192 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8aae17def04cf48190ede4bffefe70, user_id=1aa002909502426b80c97dbf05dca008, role_id=2381dab0bb194ddfaf31c2933c683b71)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:58.786796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87597a37-e711-4563-955e-d7198a6ab192 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:58.804169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 285/586] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:56:58 2022] PUT /identity/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/1aa002909502426b80c97dbf05dca008/roles/2381dab0bb194ddfaf31c2933c683b71 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:58.804169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87597a37-e711-4563-955e-d7198a6ab192 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:58.905830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7bb0e-72a0-400d-b6ec-bbdd21e62c31 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:58.969794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:59.016464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87597a37-e711-4563-955e-d7198a6ab192 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:59.021319 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083368b-ff47-42b8-86ae-7a9c9960cca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:59.021978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083368b-ff47-42b8-86ae-7a9c9960cca5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:59.022255 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083368b-ff47-42b8-86ae-7a9c9960cca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:59.022523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083368b-ff47-42b8-86ae-7a9c9960cca5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:59.036714 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083368b-ff47-42b8-86ae-7a9c9960cca5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:59.038295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083368b-ff47-42b8-86ae-7a9c9960cca5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f083368b-ff47-42b8-86ae-7a9c9960cca5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:56:59.064355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:59.065366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:59.066292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:59.066292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:59.066292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:56:59.066292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:56:59.066292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:56:59.066292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:56:59.066292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:56:59.066292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:56:59.066292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:56:59.066292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:59.066292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 302/587] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:56:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:59.066892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083368b-ff47-42b8-86ae-7a9c9960cca5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:59.073635 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49232b-d915-42bb-9dd0-11193084c2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:59.074401 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49232b-d915-42bb-9dd0-11193084c2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:59.075088 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49232b-d915-42bb-9dd0-11193084c2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:59.075358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49232b-d915-42bb-9dd0-11193084c2d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:59.087110 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49232b-d915-42bb-9dd0-11193084c2d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:59.088762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49232b-d915-42bb-9dd0-11193084c2d9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-7c49232b-d915-42bb-9dd0-11193084c2d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:59.108782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:59.109776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:59.110671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:59.110671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:59.110671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:59.110671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 286/588] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:59.115796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49232b-d915-42bb-9dd0-11193084c2d9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:59.154794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:59.216323 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083368b-ff47-42b8-86ae-7a9c9960cca5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:59.241629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49232b-d915-42bb-9dd0-11193084c2d9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:59.261361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3a9bc-d36f-4f62-8fac-25c0bc6a4097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:59.261993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3a9bc-d36f-4f62-8fac-25c0bc6a4097 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:59.262263 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3a9bc-d36f-4f62-8fac-25c0bc6a4097 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:59.262529 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3a9bc-d36f-4f62-8fac-25c0bc6a4097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:59.270215 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:59.273406 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3a9bc-d36f-4f62-8fac-25c0bc6a4097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:59.274891 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3a9bc-d36f-4f62-8fac-25c0bc6a4097 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:59.284889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0336c-a12d-424b-80a8-09629a1634bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:59.285795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0336c-a12d-424b-80a8-09629a1634bc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:59.286266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0336c-a12d-424b-80a8-09629a1634bc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:59.286726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0336c-a12d-424b-80a8-09629a1634bc None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:59.287671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0336c-a12d-424b-80a8-09629a1634bc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:59.288187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0336c-a12d-424b-80a8-09629a1634bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-40b3a9bc-d36f-4f62-8fac-25c0bc6a4097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:59.289469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:59.290488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:59.291965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:59.291965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:59.291965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:59.293285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0336c-a12d-424b-80a8-09629a1634bc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:59.295756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 303/589] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:59.296632 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3a9bc-d36f-4f62-8fac-25c0bc6a4097 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:59.315387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 287/590] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Aug 30 04:56:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:59.316694 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0336c-a12d-424b-80a8-09629a1634bc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:59.399918 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3a9bc-d36f-4f62-8fac-25c0bc6a4097 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:59.416904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:59.424925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0336c-a12d-424b-80a8-09629a1634bc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:59.435722 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd4f45-b1d1-4824-8481-5672b209b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:59.436364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd4f45-b1d1-4824-8481-5672b209b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:59.436638 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd4f45-b1d1-4824-8481-5672b209b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:59.436907 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd4f45-b1d1-4824-8481-5672b209b3a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:59.437665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd4f45-b1d1-4824-8481-5672b209b3a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:59.437839 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd4f45-b1d1-4824-8481-5672b209b3a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:59.439183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd4f45-b1d1-4824-8481-5672b209b3a4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:59.456485 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 304/591] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:59.457616 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd4f45-b1d1-4824-8481-5672b209b3a4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:59.465805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258817c2-274e-4bfb-865a-076cd4c47461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:59.466809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258817c2-274e-4bfb-865a-076cd4c47461 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:59.467323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258817c2-274e-4bfb-865a-076cd4c47461 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:59.467796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258817c2-274e-4bfb-865a-076cd4c47461 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:59.468727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258817c2-274e-4bfb-865a-076cd4c47461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:59.469221 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258817c2-274e-4bfb-865a-076cd4c47461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:59.470785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258817c2-274e-4bfb-865a-076cd4c47461 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:59.483613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 288/592] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:59.484787 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258817c2-274e-4bfb-865a-076cd4c47461 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:59.531726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:59.566290 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd4f45-b1d1-4824-8481-5672b209b3a4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:59.596498 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258817c2-274e-4bfb-865a-076cd4c47461 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:59.603137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389511d-0957-4bad-a82e-ce3390e8a571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:59.603760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389511d-0957-4bad-a82e-ce3390e8a571 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:59.604125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389511d-0957-4bad-a82e-ce3390e8a571 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:59.604387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389511d-0957-4bad-a82e-ce3390e8a571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:59.614812 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389511d-0957-4bad-a82e-ce3390e8a571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:59.616493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389511d-0957-4bad-a82e-ce3390e8a571 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c389511d-0957-4bad-a82e-ce3390e8a571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:56:59.632067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:59.633026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:56:59.633907 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:56:59.633907 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:56:59.633907 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:59.633907 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 305/593] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:59.634531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389511d-0957-4bad-a82e-ce3390e8a571 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:59.637697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42383db-13a9-4012-a5df-23bf7602cd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:59.638625 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42383db-13a9-4012-a5df-23bf7602cd8b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:59.639095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42383db-13a9-4012-a5df-23bf7602cd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:59.639556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42383db-13a9-4012-a5df-23bf7602cd8b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:59.648178 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42383db-13a9-4012-a5df-23bf7602cd8b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:59.649916 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42383db-13a9-4012-a5df-23bf7602cd8b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:59.659691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a42383db-13a9-4012-a5df-23bf7602cd8b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:56:59.662337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:59.663242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:59.664218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:59.664218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:59.664218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:56:59.664218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:56:59.664218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:56:59.664218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:56:59.664218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:56:59.664218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:56:59.664218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:56:59.664218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:56:59.666246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 289/594] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:56:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:59.668124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42383db-13a9-4012-a5df-23bf7602cd8b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:59.745147 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389511d-0957-4bad-a82e-ce3390e8a571 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:59.772026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:59.776278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42383db-13a9-4012-a5df-23bf7602cd8b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:59.780723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217c294-4e96-4726-9dee-0fe396afa311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:59.781233 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217c294-4e96-4726-9dee-0fe396afa311 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:59.781233 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217c294-4e96-4726-9dee-0fe396afa311 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:59.781507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217c294-4e96-4726-9dee-0fe396afa311 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:59.788519 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217c294-4e96-4726-9dee-0fe396afa311 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:59.789954 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217c294-4e96-4726-9dee-0fe396afa311 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:59.801592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1217c294-4e96-4726-9dee-0fe396afa311 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:56:59.801592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:56:59.801592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:56:59.801592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:56:59.801592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:56:59.801592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:56:59.801592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:56:59.801592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:56:59.801592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:56:59.801592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:56:59.801592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:56:59.801592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:56:59.801592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:56:59.801592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:56:59.801592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:56:59.802688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:56:59.803735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:56:59.803735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:56:59.803735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:56:59.803735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:56:59.803735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:56:59.803735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:56:59.803735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:56:59.803735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:56:59.807796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 306/595] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:56:59.808646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217c294-4e96-4726-9dee-0fe396afa311 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:59.819646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2ed2e-6208-4b25-a4f4-cfa52c7d9b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:59.820585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2ed2e-6208-4b25-a4f4-cfa52c7d9b14 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:59.821040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2ed2e-6208-4b25-a4f4-cfa52c7d9b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:59.821582 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2ed2e-6208-4b25-a4f4-cfa52c7d9b14 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:59.822365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2ed2e-6208-4b25-a4f4-cfa52c7d9b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:59.822943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2ed2e-6208-4b25-a4f4-cfa52c7d9b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:59.824618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2ed2e-6208-4b25-a4f4-cfa52c7d9b14 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:59.838785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 290/596] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:59.840064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2ed2e-6208-4b25-a4f4-cfa52c7d9b14 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:59.896931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:59.917662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217c294-4e96-4726-9dee-0fe396afa311 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:59.951971 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2ed2e-6208-4b25-a4f4-cfa52c7d9b14 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:59.954149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87765b48-d4b0-470c-bc65-abef017fe35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:59.955127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87765b48-d4b0-470c-bc65-abef017fe35f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:59.955127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87765b48-d4b0-470c-bc65-abef017fe35f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:59.955365 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87765b48-d4b0-470c-bc65-abef017fe35f None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:59.956045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87765b48-d4b0-470c-bc65-abef017fe35f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:59.956343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87765b48-d4b0-470c-bc65-abef017fe35f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:59.957836 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87765b48-d4b0-470c-bc65-abef017fe35f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:59.976876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 307/597] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Aug 30 04:56:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:59.977535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87765b48-d4b0-470c-bc65-abef017fe35f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:59.998999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f8fd8-f1d6-474a-94b1-81db46ea12b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:59.999649 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f8fd8-f1d6-474a-94b1-81db46ea12b8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:00.000049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f8fd8-f1d6-474a-94b1-81db46ea12b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:00.000750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f8fd8-f1d6-474a-94b1-81db46ea12b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:00.001224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f8fd8-f1d6-474a-94b1-81db46ea12b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:00.001615 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f8fd8-f1d6-474a-94b1-81db46ea12b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:00.003131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f8fd8-f1d6-474a-94b1-81db46ea12b8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:00.015314 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 291/598] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:56:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:00.016614 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e02fb-fbdb-4276-b7b6-517edb5c7e36 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:00.016996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e02fb-fbdb-4276-b7b6-517edb5c7e36 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:00.017365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e02fb-fbdb-4276-b7b6-517edb5c7e36 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:00.018953 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 292/599] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:00.019723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e02fb-fbdb-4276-b7b6-517edb5c7e36 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:00.050065 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:00.091073 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87765b48-d4b0-470c-bc65-abef017fe35f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:00.127478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de77eb2-cfb8-4d62-a446-3625217d0777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:00.128368 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de77eb2-cfb8-4d62-a446-3625217d0777 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:00.128789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de77eb2-cfb8-4d62-a446-3625217d0777 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:00.129205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de77eb2-cfb8-4d62-a446-3625217d0777 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:00.135652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e02fb-fbdb-4276-b7b6-517edb5c7e36 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:00.137263 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de77eb2-cfb8-4d62-a446-3625217d0777 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:00.138869 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de77eb2-cfb8-4d62-a446-3625217d0777 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:00.141841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:00.152051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4de77eb2-cfb8-4d62-a446-3625217d0777 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:00.152051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:00.152051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:00.152051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:00.152051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:00.152051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:00.152051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:00.152051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:00.152051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:00.152051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:00.152051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:00.152051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:00.152051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:00.152051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:00.152051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:00.152964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:00.153852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:00.153852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:00.153852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:00.153852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:00.153852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:00.153852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:00.153852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:00.153852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:00.153852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 308/600] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:56:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:00.154337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47a5e0-7f65-4008-93bc-7a24348a7f30 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:00.154979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47a5e0-7f65-4008-93bc-7a24348a7f30 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:00.154979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47a5e0-7f65-4008-93bc-7a24348a7f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:00.174197 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3d47a5e0-7f65-4008-93bc-7a24348a7f30 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:00.175363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3d47a5e0-7f65-4008-93bc-7a24348a7f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:00.178199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e5ef7-c38d-4854-a0b1-06eefa55f0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:00.178829 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e5ef7-c38d-4854-a0b1-06eefa55f0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:00.179102 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e5ef7-c38d-4854-a0b1-06eefa55f0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:00.179365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e5ef7-c38d-4854-a0b1-06eefa55f0c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:00.190255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e5ef7-c38d-4854-a0b1-06eefa55f0c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:00.191697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e5ef7-c38d-4854-a0b1-06eefa55f0c9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-af8e5ef7-c38d-4854-a0b1-06eefa55f0c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:00.205960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:00.206960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:00.207867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:00.207867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:00.207867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:00.207867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 293/601] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:00.207867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e5ef7-c38d-4854-a0b1-06eefa55f0c9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:00.253589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 309/602] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:00.254179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47a5e0-7f65-4008-93bc-7a24348a7f30 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:00.302007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:00.346023 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e5ef7-c38d-4854-a0b1-06eefa55f0c9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:00.362820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47a5e0-7f65-4008-93bc-7a24348a7f30 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:00.392495 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cf562-85d9-4d66-bbe3-7146323b1a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:00.394042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cf562-85d9-4d66-bbe3-7146323b1a68 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:00.394519 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cf562-85d9-4d66-bbe3-7146323b1a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:00.395168 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cf562-85d9-4d66-bbe3-7146323b1a68 None admin] PATH_INFO: `/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/77d3889156524b388b761cedfac8ed6e/roles/2381dab0bb194ddfaf31c2933c683b71` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:00.396468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:00.405284 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54631f3d-132a-43b2-b528-8f23d7308568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:00.406488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54631f3d-132a-43b2-b528-8f23d7308568 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:00.407072 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54631f3d-132a-43b2-b528-8f23d7308568 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:00.407919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54631f3d-132a-43b2-b528-8f23d7308568 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:00.411245 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54631f3d-132a-43b2-b528-8f23d7308568 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:00.411245 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54631f3d-132a-43b2-b528-8f23d7308568 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:00.412946 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54631f3d-132a-43b2-b528-8f23d7308568 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:00.418773 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cf562-85d9-4d66-bbe3-7146323b1a68 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8aae17def04cf48190ede4bffefe70, user_id=77d3889156524b388b761cedfac8ed6e, role_id=2381dab0bb194ddfaf31c2933c683b71)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:00.420401 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cf562-85d9-4d66-bbe3-7146323b1a68 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:00.427064 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 310/603] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:00.428913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54631f3d-132a-43b2-b528-8f23d7308568 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:00.443539 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 294/604] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:57:00 2022] PUT /identity/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/77d3889156524b388b761cedfac8ed6e/roles/2381dab0bb194ddfaf31c2933c683b71 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:00.444559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cf562-85d9-4d66-bbe3-7146323b1a68 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:00.605168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54631f3d-132a-43b2-b528-8f23d7308568 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:00.606727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cf562-85d9-4d66-bbe3-7146323b1a68 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:00.636400 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:00.646348 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0344d-a334-4340-9913-8e6c9d87d42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:00.646962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0344d-a334-4340-9913-8e6c9d87d42f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:00.647241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0344d-a334-4340-9913-8e6c9d87d42f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:00.647510 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0344d-a334-4340-9913-8e6c9d87d42f None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:00.648176 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0344d-a334-4340-9913-8e6c9d87d42f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:00.648476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0344d-a334-4340-9913-8e6c9d87d42f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:00.649841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0344d-a334-4340-9913-8e6c9d87d42f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:00.654555 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98f642-a688-442c-8c65-7431eed85985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:00.655445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98f642-a688-442c-8c65-7431eed85985 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:00.655924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98f642-a688-442c-8c65-7431eed85985 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:00.656445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98f642-a688-442c-8c65-7431eed85985 None admin] PATH_INFO: `/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/eee3162303924aaeb91af567f02980e2/roles/2381dab0bb194ddfaf31c2933c683b71` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:00.669512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 311/605] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:00.670386 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0344d-a334-4340-9913-8e6c9d87d42f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:00.678515 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98f642-a688-442c-8c65-7431eed85985 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8aae17def04cf48190ede4bffefe70, user_id=eee3162303924aaeb91af567f02980e2, role_id=2381dab0bb194ddfaf31c2933c683b71)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:00.680051 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98f642-a688-442c-8c65-7431eed85985 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:00.701821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 295/606] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:57:00 2022] PUT /identity/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/eee3162303924aaeb91af567f02980e2/roles/2381dab0bb194ddfaf31c2933c683b71 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:00.702928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98f642-a688-442c-8c65-7431eed85985 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:00.769643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:00.844401 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98f642-a688-442c-8c65-7431eed85985 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:00.858188 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0344d-a334-4340-9913-8e6c9d87d42f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:00.885858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b88e77-a88b-48e2-b67d-dce115b03133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:00.886581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b88e77-a88b-48e2-b67d-dce115b03133 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:00.886864 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b88e77-a88b-48e2-b67d-dce115b03133 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:00.887241 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b88e77-a88b-48e2-b67d-dce115b03133 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:00.895170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b88e77-a88b-48e2-b67d-dce115b03133 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:00.896731 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b88e77-a88b-48e2-b67d-dce115b03133 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:00.903401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce125366-2983-46b9-9c52-191055a9fbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:00.904071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce125366-2983-46b9-9c52-191055a9fbbb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:00.904347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce125366-2983-46b9-9c52-191055a9fbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:00.904669 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce125366-2983-46b9-9c52-191055a9fbbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:00.909704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-18b88e77-a88b-48e2-b67d-dce115b03133 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:00.909704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:00.909704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:00.909704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:00.909704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:00.909704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:00.909704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:00.909704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:00.909704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:00.909704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:00.909704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:00.909704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:00.909704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:00.909704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:00.909704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:00.910598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:00.911490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:00.911490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:00.911490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:00.911490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:00.911490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:00.911490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:00.911490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:00.911490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:00.911490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 296/607] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:00.912453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f59c9-6425-46eb-8107-e85a24b292be None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:00.912612 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f59c9-6425-46eb-8107-e85a24b292be None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:00.912952 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f59c9-6425-46eb-8107-e85a24b292be None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:00.914297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 297/608] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:00.918333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f59c9-6425-46eb-8107-e85a24b292be None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:00.922592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce125366-2983-46b9-9c52-191055a9fbbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ce125366-2983-46b9-9c52-191055a9fbbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:00.927765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:00.928779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:00.929678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:00.929678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:00.929678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:00.929678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:00.929678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:00.929678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:00.929678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:00.929678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:00.929678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:00.929678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:00.929678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:00.929678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:00.929678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 312/609] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:57:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:00.935742 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36450661-2a9d-4b72-ad8b-c83e2cdefebe None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:00.935742 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36450661-2a9d-4b72-ad8b-c83e2cdefebe None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:00.935742 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36450661-2a9d-4b72-ad8b-c83e2cdefebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:00.951153 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-36450661-2a9d-4b72-ad8b-c83e2cdefebe None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:00.952488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-36450661-2a9d-4b72-ad8b-c83e2cdefebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:00.959972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:01.039661 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 313/610] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:01.040631 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36450661-2a9d-4b72-ad8b-c83e2cdefebe None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:01.056399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f59c9-6425-46eb-8107-e85a24b292be None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:01.091296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:01.094469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a935b22-f8f2-48f3-a0b7-9c87621c4fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:01.095486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a935b22-f8f2-48f3-a0b7-9c87621c4fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:01.095768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a935b22-f8f2-48f3-a0b7-9c87621c4fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:01.096111 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a935b22-f8f2-48f3-a0b7-9c87621c4fd8 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:01.097085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a935b22-f8f2-48f3-a0b7-9c87621c4fd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:01.097391 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a935b22-f8f2-48f3-a0b7-9c87621c4fd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:01.099264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a935b22-f8f2-48f3-a0b7-9c87621c4fd8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:01.113200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 298/611] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:01.124962 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a935b22-f8f2-48f3-a0b7-9c87621c4fd8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:01.162024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36450661-2a9d-4b72-ad8b-c83e2cdefebe None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:01.205760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c232f3-2bf3-4529-ae07-7b979ab2fd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:01.207000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c232f3-2bf3-4529-ae07-7b979ab2fd02 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:01.208241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c232f3-2bf3-4529-ae07-7b979ab2fd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:01.209697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c232f3-2bf3-4529-ae07-7b979ab2fd02 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:01.210533 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c232f3-2bf3-4529-ae07-7b979ab2fd02 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:01.211731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c232f3-2bf3-4529-ae07-7b979ab2fd02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:01.214908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c232f3-2bf3-4529-ae07-7b979ab2fd02 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:01.233794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 314/612] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:57:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:01.239903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c232f3-2bf3-4529-ae07-7b979ab2fd02 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:01.268173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:01.278996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a935b22-f8f2-48f3-a0b7-9c87621c4fd8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:01.329210 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89541094-6a44-47b1-8416-06d2b8582001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:01.330144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89541094-6a44-47b1-8416-06d2b8582001 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:01.330576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89541094-6a44-47b1-8416-06d2b8582001 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:01.331018 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89541094-6a44-47b1-8416-06d2b8582001 None admin] PATH_INFO: `/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/4398d5175c8c409789d62c277da35ed7/roles/2381dab0bb194ddfaf31c2933c683b71` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:01.351577 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89541094-6a44-47b1-8416-06d2b8582001 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8aae17def04cf48190ede4bffefe70, user_id=4398d5175c8c409789d62c277da35ed7, role_id=2381dab0bb194ddfaf31c2933c683b71)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:01.353347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89541094-6a44-47b1-8416-06d2b8582001 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:01.373650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 299/613] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:57:01 2022] PUT /identity/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/4398d5175c8c409789d62c277da35ed7/roles/2381dab0bb194ddfaf31c2933c683b71 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:01.415775 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89541094-6a44-47b1-8416-06d2b8582001 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:01.438400 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c232f3-2bf3-4529-ae07-7b979ab2fd02 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:01.440893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:01.522933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b0ebb-4e1c-4071-bdb0-9ac4b91b5b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:01.523588 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b0ebb-4e1c-4071-bdb0-9ac4b91b5b9a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:01.523864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b0ebb-4e1c-4071-bdb0-9ac4b91b5b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:01.524157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b0ebb-4e1c-4071-bdb0-9ac4b91b5b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:01.528821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89541094-6a44-47b1-8416-06d2b8582001 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:01.540364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b0ebb-4e1c-4071-bdb0-9ac4b91b5b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:01.541929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b0ebb-4e1c-4071-bdb0-9ac4b91b5b9a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:01.565550 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06a637-91bf-4222-9b33-b144abfa1277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:01.566186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06a637-91bf-4222-9b33-b144abfa1277 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:01.566463 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06a637-91bf-4222-9b33-b144abfa1277 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:01.566735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06a637-91bf-4222-9b33-b144abfa1277 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-998b0ebb-4e1c-4071-bdb0-9ac4b91b5b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:01.568037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:01.568949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:01.569823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:01.569823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:01.569823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:01.569823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 315/614] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:01.575128 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b0ebb-4e1c-4071-bdb0-9ac4b91b5b9a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:01.578356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06a637-91bf-4222-9b33-b144abfa1277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-0e06a637-91bf-4222-9b33-b144abfa1277 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:01.583222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:01.584211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:01.585042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:01.585042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:01.585042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:01.585042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:01.585042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:01.585042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:01.585042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:01.585042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:01.585042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:01.585042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:01.585042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:01.585042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:01.585042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 300/615] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:57:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:01.590475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06a637-91bf-4222-9b33-b144abfa1277 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:01.593710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:01.700783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06a637-91bf-4222-9b33-b144abfa1277 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:01.736251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eeb5d-e39e-44ec-a0af-bc3642279811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:01.736862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eeb5d-e39e-44ec-a0af-bc3642279811 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:01.737140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eeb5d-e39e-44ec-a0af-bc3642279811 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:01.737412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eeb5d-e39e-44ec-a0af-bc3642279811 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:01.738083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eeb5d-e39e-44ec-a0af-bc3642279811 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:01.738373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eeb5d-e39e-44ec-a0af-bc3642279811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:01.739732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eeb5d-e39e-44ec-a0af-bc3642279811 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:01.748999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 301/616] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:57:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:01.754544 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eeb5d-e39e-44ec-a0af-bc3642279811 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:01.801914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b0ebb-4e1c-4071-bdb0-9ac4b91b5b9a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:01.819773 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:01.865369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eeb5d-e39e-44ec-a0af-bc3642279811 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:01.865602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93d25f-515b-44e4-8d29-dafe5232e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:01.866164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93d25f-515b-44e4-8d29-dafe5232e625 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:01.866372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93d25f-515b-44e4-8d29-dafe5232e625 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:01.866646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93d25f-515b-44e4-8d29-dafe5232e625 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:01.867456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93d25f-515b-44e4-8d29-dafe5232e625 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:01.867851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93d25f-515b-44e4-8d29-dafe5232e625 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:01.869943 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93d25f-515b-44e4-8d29-dafe5232e625 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:01.892988 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 316/617] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:01.898985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93d25f-515b-44e4-8d29-dafe5232e625 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:01.910009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317986f-2b0b-4f69-ae06-513e16194523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:01.910653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317986f-2b0b-4f69-ae06-513e16194523 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:01.910934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317986f-2b0b-4f69-ae06-513e16194523 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:01.911200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317986f-2b0b-4f69-ae06-513e16194523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:01.921996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:01.922623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317986f-2b0b-4f69-ae06-513e16194523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:01.924186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317986f-2b0b-4f69-ae06-513e16194523 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b317986f-2b0b-4f69-ae06-513e16194523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:01.943780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:01.944823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:01.945736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:01.945736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:01.945736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:01.945736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 302/618] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:01.952996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317986f-2b0b-4f69-ae06-513e16194523 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:02.025073 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93d25f-515b-44e4-8d29-dafe5232e625 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:02.099603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4624ac-a81f-45db-984d-161a1c6e6693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:02.102641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4624ac-a81f-45db-984d-161a1c6e6693 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:02.102917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4624ac-a81f-45db-984d-161a1c6e6693 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:02.103162 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4624ac-a81f-45db-984d-161a1c6e6693 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:02.121238 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4624ac-a81f-45db-984d-161a1c6e6693 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:02.122685 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4624ac-a81f-45db-984d-161a1c6e6693 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:02.126232 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317986f-2b0b-4f69-ae06-513e16194523 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:02.147692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-af4624ac-a81f-45db-984d-161a1c6e6693 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:02.149449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:02.150376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:02.151611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:02.151611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:02.151611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:02.151611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:02.151611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:02.151611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:02.151611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:02.151611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:02.151611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:57:02.151611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:02.151611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 317/619] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:57:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:02.158704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4624ac-a81f-45db-984d-161a1c6e6693 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:02.174632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e7500-3598-4a84-af71-2a236f5d57fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:02.175243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e7500-3598-4a84-af71-2a236f5d57fa None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:02.175643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e7500-3598-4a84-af71-2a236f5d57fa None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:02.175918 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e7500-3598-4a84-af71-2a236f5d57fa None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:02.176660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e7500-3598-4a84-af71-2a236f5d57fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:02.176959 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e7500-3598-4a84-af71-2a236f5d57fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:02.178320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e7500-3598-4a84-af71-2a236f5d57fa None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:02.191370 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 303/620] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:02.201095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e7500-3598-4a84-af71-2a236f5d57fa None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:02.310608 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e7500-3598-4a84-af71-2a236f5d57fa None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:02.344311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:02.346754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4e361-78a6-49f0-9a41-6a0f2ec6f13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:02.348190 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4e361-78a6-49f0-9a41-6a0f2ec6f13e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:02.348190 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4e361-78a6-49f0-9a41-6a0f2ec6f13e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:02.348190 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4e361-78a6-49f0-9a41-6a0f2ec6f13e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:02.355877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4e361-78a6-49f0-9a41-6a0f2ec6f13e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:02.357350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4e361-78a6-49f0-9a41-6a0f2ec6f13e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-49f4e361-78a6-49f0-9a41-6a0f2ec6f13e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:02.369737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:02.370907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:02.372002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:02.372002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:02.372002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:02.372002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:02.372002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:02.372002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:02.372002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:02.372002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:02.372002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:57:02.372002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:02.372002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 304/621] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Aug 30 04:57:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:02.376526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4624ac-a81f-45db-984d-161a1c6e6693 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:02.376940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4e361-78a6-49f0-9a41-6a0f2ec6f13e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:02.423359 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:02.446548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076201c-5a76-4384-b0bc-13e72b7b2217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:02.447168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076201c-5a76-4384-b0bc-13e72b7b2217 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:02.447985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076201c-5a76-4384-b0bc-13e72b7b2217 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:02.448272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076201c-5a76-4384-b0bc-13e72b7b2217 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:02.449009 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076201c-5a76-4384-b0bc-13e72b7b2217 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:02.449309 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076201c-5a76-4384-b0bc-13e72b7b2217 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:02.450739 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076201c-5a76-4384-b0bc-13e72b7b2217 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:02.489375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4e361-78a6-49f0-9a41-6a0f2ec6f13e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:02.497122 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 318/622] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Aug 30 04:57:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:02.503323 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076201c-5a76-4384-b0bc-13e72b7b2217 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:02.528162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf22437-61ab-4588-8209-502963ac3c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:02.529144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf22437-61ab-4588-8209-502963ac3c08 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:02.529627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf22437-61ab-4588-8209-502963ac3c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:02.530126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf22437-61ab-4588-8209-502963ac3c08 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:02.531145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf22437-61ab-4588-8209-502963ac3c08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:02.531715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf22437-61ab-4588-8209-502963ac3c08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:02.533583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf22437-61ab-4588-8209-502963ac3c08 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:02.575068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 305/623] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Aug 30 04:57:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:02.580483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf22437-61ab-4588-8209-502963ac3c08 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:02.659346 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076201c-5a76-4384-b0bc-13e72b7b2217 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:02.685630 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:02.694326 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e1798-80c2-4e30-9ad3-87418da46786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:02.694964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e1798-80c2-4e30-9ad3-87418da46786 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:02.695240 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e1798-80c2-4e30-9ad3-87418da46786 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:02.695505 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e1798-80c2-4e30-9ad3-87418da46786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:02.696287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf22437-61ab-4588-8209-502963ac3c08 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:02.705122 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:02.712315 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e1798-80c2-4e30-9ad3-87418da46786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:02.714424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e1798-80c2-4e30-9ad3-87418da46786 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:02.738094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec8646-6aad-469c-892b-cf87e09730d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:02.738712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec8646-6aad-469c-892b-cf87e09730d4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:02.738990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec8646-6aad-469c-892b-cf87e09730d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:02.739264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec8646-6aad-469c-892b-cf87e09730d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-116e1798-80c2-4e30-9ad3-87418da46786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:02.744183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:02.745271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:02.746169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:02.746169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:02.746169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:02.756389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 319/624] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:02.763013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e1798-80c2-4e30-9ad3-87418da46786 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:02.818067 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec8646-6aad-469c-892b-cf87e09730d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:02.819530 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec8646-6aad-469c-892b-cf87e09730d4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:02.912148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e1798-80c2-4e30-9ad3-87418da46786 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:02.926480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:02.936010 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 306/625] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:02.944943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec8646-6aad-469c-892b-cf87e09730d4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:02.973170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6780263-9848-4ea9-b1a2-8a0db20a0980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:02.973772 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6780263-9848-4ea9-b1a2-8a0db20a0980 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:02.974045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6780263-9848-4ea9-b1a2-8a0db20a0980 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:02.974313 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6780263-9848-4ea9-b1a2-8a0db20a0980 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:02.974947 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6780263-9848-4ea9-b1a2-8a0db20a0980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:02.975241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6780263-9848-4ea9-b1a2-8a0db20a0980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:02.976620 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6780263-9848-4ea9-b1a2-8a0db20a0980 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:02.999507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 320/626] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:03.009259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6780263-9848-4ea9-b1a2-8a0db20a0980 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:03.069246 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:03.098329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec8646-6aad-469c-892b-cf87e09730d4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:03.126971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6780263-9848-4ea9-b1a2-8a0db20a0980 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:03.137265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834fd54-428a-4664-a1c2-caf2bdba9231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:03.138005 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834fd54-428a-4664-a1c2-caf2bdba9231 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:03.138287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834fd54-428a-4664-a1c2-caf2bdba9231 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:03.138557 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834fd54-428a-4664-a1c2-caf2bdba9231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:03.155738 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834fd54-428a-4664-a1c2-caf2bdba9231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:03.157399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834fd54-428a-4664-a1c2-caf2bdba9231 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:03.167339 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577048d7-ba83-4a44-ad18-efb6e3e6ecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:03.168337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577048d7-ba83-4a44-ad18-efb6e3e6ecbc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:03.168613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577048d7-ba83-4a44-ad18-efb6e3e6ecbc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:03.168881 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577048d7-ba83-4a44-ad18-efb6e3e6ecbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-5834fd54-428a-4664-a1c2-caf2bdba9231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:03.174269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:03.175470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:03.176894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:03.176894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:03.176894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:03.177286 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577048d7-ba83-4a44-ad18-efb6e3e6ecbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:03.177442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 307/627] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:03.177585 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577048d7-ba83-4a44-ad18-efb6e3e6ecbc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:03.177735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ac807-c5d4-4b8a-a70a-36c9c367dc5b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:03.177877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ac807-c5d4-4b8a-a70a-36c9c367dc5b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:03.178674 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ac807-c5d4-4b8a-a70a-36c9c367dc5b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:03.183687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 308/628] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:03.184526 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ac807-c5d4-4b8a-a70a-36c9c367dc5b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:03.195301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-577048d7-ba83-4a44-ad18-efb6e3e6ecbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:03.195301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:03.195301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:03.195301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:03.195301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:03.195301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:03.195301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:03.195301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:03.195301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:03.195301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:03.195301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:03.195301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:03.195301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:03.195301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:03.195301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:03.197960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:03.199790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:03.199790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:03.199790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:03.199790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:03.199790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:03.199790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:03.199790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:03.199790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:03.199790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 321/629] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:03.199790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbfe72-f91c-413d-8682-6260546fc2be None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:03.199790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbfe72-f91c-413d-8682-6260546fc2be None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:03.200849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbfe72-f91c-413d-8682-6260546fc2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:03.219065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-98fbfe72-f91c-413d-8682-6260546fc2be None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:03.220453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-98fbfe72-f91c-413d-8682-6260546fc2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:03.245920 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:03.298034 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 322/630] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:03.299494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbfe72-f91c-413d-8682-6260546fc2be None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:03.308012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ac807-c5d4-4b8a-a70a-36c9c367dc5b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:03.337022 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:03.358452 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40515c9-9c64-4fcd-9c24-90e7ec68a2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:03.359063 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40515c9-9c64-4fcd-9c24-90e7ec68a2cb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:03.359339 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40515c9-9c64-4fcd-9c24-90e7ec68a2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:03.359609 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40515c9-9c64-4fcd-9c24-90e7ec68a2cb None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:03.360579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40515c9-9c64-4fcd-9c24-90e7ec68a2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:03.360886 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40515c9-9c64-4fcd-9c24-90e7ec68a2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:03.362257 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40515c9-9c64-4fcd-9c24-90e7ec68a2cb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:03.380558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 309/631] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:03.382088 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a182-0d49-4fe5-9d18-9090e9212e0f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:03.382565 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a182-0d49-4fe5-9d18-9090e9212e0f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:03.383039 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a182-0d49-4fe5-9d18-9090e9212e0f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:03.389543 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 310/632] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:03.389543 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1a182-0d49-4fe5-9d18-9090e9212e0f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:03.437267 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbfe72-f91c-413d-8682-6260546fc2be None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:03.483401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb5281-69ed-4865-b431-8830627122cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:03.484310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb5281-69ed-4865-b431-8830627122cc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:03.484595 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb5281-69ed-4865-b431-8830627122cc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:03.484864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb5281-69ed-4865-b431-8830627122cc None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:03.485558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb5281-69ed-4865-b431-8830627122cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:03.485855 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb5281-69ed-4865-b431-8830627122cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:03.488148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb5281-69ed-4865-b431-8830627122cc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:03.510571 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 323/633] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:03.510571 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3752a-bfb3-4165-a2e0-9ebf885040f5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:03.510571 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3752a-bfb3-4165-a2e0-9ebf885040f5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:03.510571 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3752a-bfb3-4165-a2e0-9ebf885040f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:03.511665 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1a182-0d49-4fe5-9d18-9090e9212e0f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:03.521021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:03.534055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1be3752a-bfb3-4165-a2e0-9ebf885040f5 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:03.535249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1be3752a-bfb3-4165-a2e0-9ebf885040f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:03.552392 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facce6fc-75ab-44e1-bc08-ba57ae523222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:03.553421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facce6fc-75ab-44e1-bc08-ba57ae523222 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:03.553939 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facce6fc-75ab-44e1-bc08-ba57ae523222 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:03.554418 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facce6fc-75ab-44e1-bc08-ba57ae523222 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:03.562910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facce6fc-75ab-44e1-bc08-ba57ae523222 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:03.565106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facce6fc-75ab-44e1-bc08-ba57ae523222 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:03.583198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-facce6fc-75ab-44e1-bc08-ba57ae523222 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:03.583198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:03.583198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:03.583198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:03.583198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:03.583198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:03.583198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:03.583198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:03.583198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:03.583198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:03.583198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:03.583198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:03.583198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:03.583198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:03.583198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:03.584464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:03.585372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:03.585372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:03.585372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:03.585372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:03.585372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:03.585372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:03.585372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:03.585372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:03.585372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 311/634] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:03.585887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facce6fc-75ab-44e1-bc08-ba57ae523222 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:03.614962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 324/635] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:03.616129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3752a-bfb3-4165-a2e0-9ebf885040f5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:03.656201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:03.705097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facce6fc-75ab-44e1-bc08-ba57ae523222 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:03.739163 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db960e-5b7d-4919-b803-c3a7bebcc1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:03.739843 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db960e-5b7d-4919-b803-c3a7bebcc1d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:03.740147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db960e-5b7d-4919-b803-c3a7bebcc1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:03.740418 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db960e-5b7d-4919-b803-c3a7bebcc1d5 None admin] PATH_INFO: `/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/a96ac878c106422ebf438a64ca618747/roles/2381dab0bb194ddfaf31c2933c683b71` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:03.742606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3752a-bfb3-4165-a2e0-9ebf885040f5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:03.757033 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db960e-5b7d-4919-b803-c3a7bebcc1d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8aae17def04cf48190ede4bffefe70, user_id=a96ac878c106422ebf438a64ca618747, role_id=2381dab0bb194ddfaf31c2933c683b71)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:03.758487 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db960e-5b7d-4919-b803-c3a7bebcc1d5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:03.773270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 312/636] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:57:03 2022] PUT /identity/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/a96ac878c106422ebf438a64ca618747/roles/2381dab0bb194ddfaf31c2933c683b71 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:03.774372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db960e-5b7d-4919-b803-c3a7bebcc1d5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:03.792343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae2a96-7d1c-4dfa-b278-519a75f8bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:03.793445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae2a96-7d1c-4dfa-b278-519a75f8bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:03.794028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae2a96-7d1c-4dfa-b278-519a75f8bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:03.794480 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae2a96-7d1c-4dfa-b278-519a75f8bdc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:03.802322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:03.811514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae2a96-7d1c-4dfa-b278-519a75f8bdc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-d0ae2a96-7d1c-4dfa-b278-519a75f8bdc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:03.819031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:03.820087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:03.820994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:03.820994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:03.820994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:03.820994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:03.820994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:03.820994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:03.820994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:03.820994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:03.820994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:03.820994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:03.820994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:03.820994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:03.829351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 325/637] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:57:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:03.831192 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05323f-f3ee-4fe7-8fee-1278c108ba15 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:03.831871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05323f-f3ee-4fe7-8fee-1278c108ba15 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:03.832393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05323f-f3ee-4fe7-8fee-1278c108ba15 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:03.834552 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 326/638] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:03.835651 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05323f-f3ee-4fe7-8fee-1278c108ba15 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:03.912636 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db960e-5b7d-4919-b803-c3a7bebcc1d5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:03.940786 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:03.960037 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4ca32-d89b-4575-8475-f4c6f4aa4ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:03.960752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4ca32-d89b-4575-8475-f4c6f4aa4ddc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:03.961012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4ca32-d89b-4575-8475-f4c6f4aa4ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:03.961277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4ca32-d89b-4575-8475-f4c6f4aa4ddc None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:03.962020 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4ca32-d89b-4575-8475-f4c6f4aa4ddc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:03.962311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4ca32-d89b-4575-8475-f4c6f4aa4ddc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:03.964327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4ca32-d89b-4575-8475-f4c6f4aa4ddc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:03.968229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05323f-f3ee-4fe7-8fee-1278c108ba15 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:03.977431 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 313/639] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:03.979125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fa1ac-402b-4aa7-af8f-99eea697ee0e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:03.979713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fa1ac-402b-4aa7-af8f-99eea697ee0e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:03.980010 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fa1ac-402b-4aa7-af8f-99eea697ee0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:04.001142 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-804fa1ac-402b-4aa7-af8f-99eea697ee0e None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:04.002406 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-804fa1ac-402b-4aa7-af8f-99eea697ee0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:04.015229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e6e5e-ce88-4985-8c43-17da02eb2f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:04.016017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e6e5e-ce88-4985-8c43-17da02eb2f3b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:04.016296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e6e5e-ce88-4985-8c43-17da02eb2f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:04.016562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e6e5e-ce88-4985-8c43-17da02eb2f3b None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:04.017219 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e6e5e-ce88-4985-8c43-17da02eb2f3b None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:04.017517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e6e5e-ce88-4985-8c43-17da02eb2f3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:04.018867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e6e5e-ce88-4985-8c43-17da02eb2f3b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:04.027419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 327/640] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:57:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:04.028415 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e6e5e-ce88-4985-8c43-17da02eb2f3b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:04.082017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 314/641] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:04.090682 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fa1ac-402b-4aa7-af8f-99eea697ee0e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:04.103254 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:04.148358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e6e5e-ce88-4985-8c43-17da02eb2f3b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:04.191854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce0149-9fa6-44e6-a30f-beb42d77e8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:04.192513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce0149-9fa6-44e6-a30f-beb42d77e8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:04.192788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce0149-9fa6-44e6-a30f-beb42d77e8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:04.193056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce0149-9fa6-44e6-a30f-beb42d77e8d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:04.202711 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fa1ac-402b-4aa7-af8f-99eea697ee0e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:04.203749 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce0149-9fa6-44e6-a30f-beb42d77e8d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-9fce0149-9fa6-44e6-a30f-beb42d77e8d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:04.209183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:04.210559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:04.211968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:04.211968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:04.211968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:04.211968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:04.211968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:04.211968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:04.211968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:04.211968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:04.211968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:04.211968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:04.211968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:04.211968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:04.211968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 328/642] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:57:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:04.211968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce0149-9fa6-44e6-a30f-beb42d77e8d0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:04.221892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:04.247825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e09af3-422b-40f2-b703-7d45db715e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:04.248580 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e09af3-422b-40f2-b703-7d45db715e8a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:04.248923 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e09af3-422b-40f2-b703-7d45db715e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:04.249500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e09af3-422b-40f2-b703-7d45db715e8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:04.250043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e09af3-422b-40f2-b703-7d45db715e8a None admin] RBAC: Adding query filter params (role.id=2381dab0bb194ddfaf31c2933c683b71, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=1aa002909502426b80c97dbf05dca008) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:04.250412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e09af3-422b-40f2-b703-7d45db715e8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:04.252329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e09af3-422b-40f2-b703-7d45db715e8a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:04.259156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 315/643] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:57:04 2022] GET /identity/v3/role_assignments?user.id=1aa002909502426b80c97dbf05dca008&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=2381dab0bb194ddfaf31c2933c683b71 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:04.260201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e09af3-422b-40f2-b703-7d45db715e8a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:04.333879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce0149-9fa6-44e6-a30f-beb42d77e8d0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:04.364371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:04.393456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e09af3-422b-40f2-b703-7d45db715e8a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:04.400217 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc97a4-36d1-4231-b961-805e6fb6a0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:04.400979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc97a4-36d1-4231-b961-805e6fb6a0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:04.401262 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc97a4-36d1-4231-b961-805e6fb6a0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:04.401532 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc97a4-36d1-4231-b961-805e6fb6a0e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:04.429819 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc97a4-36d1-4231-b961-805e6fb6a0e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:04.431641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc97a4-36d1-4231-b961-805e6fb6a0e8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:04.433685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fde86-774f-4b66-a05d-22e7b4156bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:04.433685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fde86-774f-4b66-a05d-22e7b4156bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:04.434157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fde86-774f-4b66-a05d-22e7b4156bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:04.434262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fde86-774f-4b66-a05d-22e7b4156bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:04.434888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fde86-774f-4b66-a05d-22e7b4156bc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:04.435184 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fde86-774f-4b66-a05d-22e7b4156bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:04.439182 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fde86-774f-4b66-a05d-22e7b4156bc1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:04.450548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 316/644] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:57:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ffcc97a4-36d1-4231-b961-805e6fb6a0e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:04.451018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:04.452085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:04.453007 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:04.453007 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:04.453007 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:04.453007 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 329/645] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:04.457397 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fde86-774f-4b66-a05d-22e7b4156bc1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:04.461820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc97a4-36d1-4231-b961-805e6fb6a0e8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:04.544076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:04.594683 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fde86-774f-4b66-a05d-22e7b4156bc1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:04.596137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc97a4-36d1-4231-b961-805e6fb6a0e8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:04.633656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2708ea-3b60-4b3f-83c4-c67ce283de8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:04.634285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:04.635503 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2708ea-3b60-4b3f-83c4-c67ce283de8b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:04.636087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2708ea-3b60-4b3f-83c4-c67ce283de8b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:04.637759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2708ea-3b60-4b3f-83c4-c67ce283de8b None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:04.637759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2708ea-3b60-4b3f-83c4-c67ce283de8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:04.637759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2708ea-3b60-4b3f-83c4-c67ce283de8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:04.639160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ed2bf-0b77-462d-b290-06a73f181993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:04.639467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2708ea-3b60-4b3f-83c4-c67ce283de8b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:04.639794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ed2bf-0b77-462d-b290-06a73f181993 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:04.640105 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ed2bf-0b77-462d-b290-06a73f181993 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:04.640380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ed2bf-0b77-462d-b290-06a73f181993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:04.654124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ed2bf-0b77-462d-b290-06a73f181993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:04.654731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 330/646] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:04.655557 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ed2bf-0b77-462d-b290-06a73f181993 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:04.656071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2708ea-3b60-4b3f-83c4-c67ce283de8b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-244ed2bf-0b77-462d-b290-06a73f181993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:04.676060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:04.677076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:04.678153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:04.678153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:04.678153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:04.680405 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 317/647] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:04.681519 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ed2bf-0b77-462d-b290-06a73f181993 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:04.795195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2708ea-3b60-4b3f-83c4-c67ce283de8b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:04.799445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ed2bf-0b77-462d-b290-06a73f181993 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:04.823036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:04.836307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22083d11-980a-4ac4-ad59-d5b782b5f952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:04.836968 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22083d11-980a-4ac4-ad59-d5b782b5f952 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:04.837218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22083d11-980a-4ac4-ad59-d5b782b5f952 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:04.837540 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22083d11-980a-4ac4-ad59-d5b782b5f952 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:04.840668 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbe8f2-25d5-413f-b02e-bc67fd0648ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:04.841637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbe8f2-25d5-413f-b02e-bc67fd0648ee None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:04.842112 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbe8f2-25d5-413f-b02e-bc67fd0648ee None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:04.842577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbe8f2-25d5-413f-b02e-bc67fd0648ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:04.847470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22083d11-980a-4ac4-ad59-d5b782b5f952 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:04.848949 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22083d11-980a-4ac4-ad59-d5b782b5f952 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:04.854194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbe8f2-25d5-413f-b02e-bc67fd0648ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-5bdbe8f2-25d5-413f-b02e-bc67fd0648ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:04.861161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:04.862126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:04.862973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:04.862973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:04.862973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:04.862973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:04.862973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:04.862973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:04.862973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:04.862973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:04.862973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:04.862973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:04.862973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:04.862973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-22083d11-980a-4ac4-ad59-d5b782b5f952 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:04.864174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:04.865008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:04.865943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:04.865943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:04.865943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:04.865943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:04.865943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:04.865943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:04.865943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:04.865943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:04.865943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:57:04.865943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:04.867129 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 318/648] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:57:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:04.867904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22083d11-980a-4ac4-ad59-d5b782b5f952 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:04.869014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 331/649] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:57:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:04.875219 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbe8f2-25d5-413f-b02e-bc67fd0648ee None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:04.919671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:04.993238 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbe8f2-25d5-413f-b02e-bc67fd0648ee None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:04.996260 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22083d11-980a-4ac4-ad59-d5b782b5f952 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:05.028276 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba61b02-edbe-4ac1-a404-22baf5bdfa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:05.028875 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba61b02-edbe-4ac1-a404-22baf5bdfa42 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:05.029153 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba61b02-edbe-4ac1-a404-22baf5bdfa42 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:05.029417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba61b02-edbe-4ac1-a404-22baf5bdfa42 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:05.030133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba61b02-edbe-4ac1-a404-22baf5bdfa42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:05.030430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba61b02-edbe-4ac1-a404-22baf5bdfa42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:05.031824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba61b02-edbe-4ac1-a404-22baf5bdfa42 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:05.032382 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4cf01-a4af-4979-8f47-0b5825290ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:05.032986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4cf01-a4af-4979-8f47-0b5825290ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:05.033364 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4cf01-a4af-4979-8f47-0b5825290ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:05.033640 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4cf01-a4af-4979-8f47-0b5825290ab1 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:05.034387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4cf01-a4af-4979-8f47-0b5825290ab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:05.034694 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4cf01-a4af-4979-8f47-0b5825290ab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:05.036076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4cf01-a4af-4979-8f47-0b5825290ab1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:05.049567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 319/650] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:05.050578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4cf01-a4af-4979-8f47-0b5825290ab1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:05.054357 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 332/651] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Aug 30 04:57:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:05.055251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba61b02-edbe-4ac1-a404-22baf5bdfa42 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:05.094994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:05.158908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4cf01-a4af-4979-8f47-0b5825290ab1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:05.162711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba61b02-edbe-4ac1-a404-22baf5bdfa42 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:05.185899 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:05.198334 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e6017-26fc-44fb-9a83-4a98dda89cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:05.199169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e6017-26fc-44fb-9a83-4a98dda89cdd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:05.199592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e6017-26fc-44fb-9a83-4a98dda89cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:05.200029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e6017-26fc-44fb-9a83-4a98dda89cdd None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:05.200301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83528f-5ec9-4e9c-ad83-a8d311aff2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:05.200928 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83528f-5ec9-4e9c-ad83-a8d311aff2ac None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:05.201200 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83528f-5ec9-4e9c-ad83-a8d311aff2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:05.201363 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e6017-26fc-44fb-9a83-4a98dda89cdd None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:05.201466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83528f-5ec9-4e9c-ad83-a8d311aff2ac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:05.201899 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e6017-26fc-44fb-9a83-4a98dda89cdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:05.203510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e6017-26fc-44fb-9a83-4a98dda89cdd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:05.208957 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83528f-5ec9-4e9c-ad83-a8d311aff2ac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:05.210449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83528f-5ec9-4e9c-ad83-a8d311aff2ac None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:05.213288 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 320/652] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:57:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:05.214310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e6017-26fc-44fb-9a83-4a98dda89cdd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-0d83528f-5ec9-4e9c-ad83-a8d311aff2ac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:05.223492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:05.224691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:05.225854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:05.225854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:05.225854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:05.225854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:05.225854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:05.225854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:05.225854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:05.225854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:05.225854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:57:05.225854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:05.227298 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 333/653] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:57:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:05.232774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83528f-5ec9-4e9c-ad83-a8d311aff2ac None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:05.325313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e6017-26fc-44fb-9a83-4a98dda89cdd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:05.329939 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:05.336496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83528f-5ec9-4e9c-ad83-a8d311aff2ac None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:05.364342 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f0655-4524-4128-ab47-d87a206f068d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:05.365299 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f0655-4524-4128-ab47-d87a206f068d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:05.365724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f0655-4524-4128-ab47-d87a206f068d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:05.366165 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f0655-4524-4128-ab47-d87a206f068d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:05.373010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31e50c-78a5-4f10-8c53-ba6d85683293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:05.373807 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31e50c-78a5-4f10-8c53-ba6d85683293 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:05.374180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31e50c-78a5-4f10-8c53-ba6d85683293 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:05.374562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31e50c-78a5-4f10-8c53-ba6d85683293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:05.386423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31e50c-78a5-4f10-8c53-ba6d85683293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:05.387979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31e50c-78a5-4f10-8c53-ba6d85683293 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1f31e50c-78a5-4f10-8c53-ba6d85683293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:05.402823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:05.404030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:05.404943 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:05.404943 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:05.404943 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:05.405469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 334/654] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:05.406472 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31e50c-78a5-4f10-8c53-ba6d85683293 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:05.432368 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:05.443621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f0655-4524-4128-ab47-d87a206f068d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:05.445417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f0655-4524-4128-ab47-d87a206f068d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:05.513423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31e50c-78a5-4f10-8c53-ba6d85683293 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:05.551399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3645a3e-f51d-4e51-b753-16a2228888ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:05.551972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645a3e-f51d-4e51-b753-16a2228888ab None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:05.552255 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645a3e-f51d-4e51-b753-16a2228888ab None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:05.552523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645a3e-f51d-4e51-b753-16a2228888ab None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:05.553316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3645a3e-f51d-4e51-b753-16a2228888ab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:05.553537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3645a3e-f51d-4e51-b753-16a2228888ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:05.554959 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3645a3e-f51d-4e51-b753-16a2228888ab None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:05.557323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 321/655] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:05.558459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f0655-4524-4128-ab47-d87a206f068d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:05.582830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 335/656] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Aug 30 04:57:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:05.583655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3645a3e-f51d-4e51-b753-16a2228888ab None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:05.592550 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:05.629979 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:05.667533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f0655-4524-4128-ab47-d87a206f068d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:05.694688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3645a3e-f51d-4e51-b753-16a2228888ab None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:05.706084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1d146-64ca-41a9-b047-c3a11646bc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:05.707073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1d146-64ca-41a9-b047-c3a11646bc20 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:05.707551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1d146-64ca-41a9-b047-c3a11646bc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:05.708055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1d146-64ca-41a9-b047-c3a11646bc20 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:05.708894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1d146-64ca-41a9-b047-c3a11646bc20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:05.709545 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1d146-64ca-41a9-b047-c3a11646bc20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:05.711210 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1d146-64ca-41a9-b047-c3a11646bc20 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:05.723960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 322/657] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:05.725176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1d146-64ca-41a9-b047-c3a11646bc20 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:05.731093 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e006b3-7187-4219-a1db-1388943cee8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:05.731723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e006b3-7187-4219-a1db-1388943cee8c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:05.732031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e006b3-7187-4219-a1db-1388943cee8c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:05.732302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e006b3-7187-4219-a1db-1388943cee8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:05.743384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e006b3-7187-4219-a1db-1388943cee8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:05.745421 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e006b3-7187-4219-a1db-1388943cee8c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-08e006b3-7187-4219-a1db-1388943cee8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:05.761384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:05.762371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:05.763295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:05.763295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:05.763295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:05.763295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 336/658] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:05.763295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e006b3-7187-4219-a1db-1388943cee8c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:05.831154 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:05.836050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1d146-64ca-41a9-b047-c3a11646bc20 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:05.862479 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:05.873307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0a328-4d1b-44f6-875a-04c1233f0672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:05.874333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0a328-4d1b-44f6-875a-04c1233f0672 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:05.874890 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0a328-4d1b-44f6-875a-04c1233f0672 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:05.875331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0a328-4d1b-44f6-875a-04c1233f0672 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:05.878753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e006b3-7187-4219-a1db-1388943cee8c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:05.920148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6af41-2eb3-4ac4-a4d2-7c0a0bf6e69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:05.920783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6af41-2eb3-4ac4-a4d2-7c0a0bf6e69d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:05.921054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6af41-2eb3-4ac4-a4d2-7c0a0bf6e69d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:05.921316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6af41-2eb3-4ac4-a4d2-7c0a0bf6e69d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:05.930134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6af41-2eb3-4ac4-a4d2-7c0a0bf6e69d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:05.931598 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6af41-2eb3-4ac4-a4d2-7c0a0bf6e69d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-e7b6af41-2eb3-4ac4-a4d2-7c0a0bf6e69d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:05.942932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:05.944227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:05.945198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:05.945198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:05.945198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:05.945198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:05.945198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:05.945198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:05.945198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:05.945198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:05.945198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:57:05.945198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:05.945198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 337/659] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:57:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:05.945198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6af41-2eb3-4ac4-a4d2-7c0a0bf6e69d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:05.959039 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0a328-4d1b-44f6-875a-04c1233f0672 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:05.960907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0a328-4d1b-44f6-875a-04c1233f0672 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:06.056974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6af41-2eb3-4ac4-a4d2-7c0a0bf6e69d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:06.075148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 323/660] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:06.075148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f12f0-2b81-4aef-8857-bd5af4d9c39e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:06.075148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f12f0-2b81-4aef-8857-bd5af4d9c39e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:06.075148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f12f0-2b81-4aef-8857-bd5af4d9c39e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:06.075148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 324/661] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:06.075148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f12f0-2b81-4aef-8857-bd5af4d9c39e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:06.085961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:06.103737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:06.106704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d43655-7b8b-4bdc-b9ef-ce308547185b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:06.107303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d43655-7b8b-4bdc-b9ef-ce308547185b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:06.107576 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d43655-7b8b-4bdc-b9ef-ce308547185b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:06.107841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d43655-7b8b-4bdc-b9ef-ce308547185b None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:06.108512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d43655-7b8b-4bdc-b9ef-ce308547185b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:06.108828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d43655-7b8b-4bdc-b9ef-ce308547185b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:06.110216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d43655-7b8b-4bdc-b9ef-ce308547185b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:06.126773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 338/662] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:06.126773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d43655-7b8b-4bdc-b9ef-ce308547185b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:06.190068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f12f0-2b81-4aef-8857-bd5af4d9c39e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:06.225730 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9bf2e-15e6-4b52-8ab0-eddb0b68d474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:06.226355 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9bf2e-15e6-4b52-8ab0-eddb0b68d474 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:06.226629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9bf2e-15e6-4b52-8ab0-eddb0b68d474 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:06.226885 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9bf2e-15e6-4b52-8ab0-eddb0b68d474 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:06.227621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9bf2e-15e6-4b52-8ab0-eddb0b68d474 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:06.227924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9bf2e-15e6-4b52-8ab0-eddb0b68d474 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:06.229420 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9bf2e-15e6-4b52-8ab0-eddb0b68d474 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:06.236331 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d43655-7b8b-4bdc-b9ef-ce308547185b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:06.255759 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 325/663] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Aug 30 04:57:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:06.257380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caed091-e25c-4112-b29f-0d0e28a02440 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:06.257662 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caed091-e25c-4112-b29f-0d0e28a02440 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:06.257936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caed091-e25c-4112-b29f-0d0e28a02440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:06.278416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5caed091-e25c-4112-b29f-0d0e28a02440 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:06.280200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5caed091-e25c-4112-b29f-0d0e28a02440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:06.286855 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c80c06-9833-4e1f-9291-e37a9ede190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:06.287492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c80c06-9833-4e1f-9291-e37a9ede190c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:06.287771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c80c06-9833-4e1f-9291-e37a9ede190c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:06.288083 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c80c06-9833-4e1f-9291-e37a9ede190c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:06.299466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c80c06-9833-4e1f-9291-e37a9ede190c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:06.300971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c80c06-9833-4e1f-9291-e37a9ede190c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-16c80c06-9833-4e1f-9291-e37a9ede190c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:06.316584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:06.317579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:06.318512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:06.318512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:06.318512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:06.318512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 339/664] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:06.318512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c80c06-9833-4e1f-9291-e37a9ede190c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:06.356782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:06.370397 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 326/665] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:06.371891 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caed091-e25c-4112-b29f-0d0e28a02440 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:06.395720 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:06.442760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c80c06-9833-4e1f-9291-e37a9ede190c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:06.485720 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82d605-b03d-4e0f-85bf-d9a5c9d0a1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:06.486350 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82d605-b03d-4e0f-85bf-d9a5c9d0a1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:06.486624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82d605-b03d-4e0f-85bf-d9a5c9d0a1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:06.486896 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82d605-b03d-4e0f-85bf-d9a5c9d0a1f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:06.494811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82d605-b03d-4e0f-85bf-d9a5c9d0a1f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:06.496313 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82d605-b03d-4e0f-85bf-d9a5c9d0a1f0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:06.508335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7e82d605-b03d-4e0f-85bf-d9a5c9d0a1f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:06.508335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:06.508335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:06.508335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:06.508335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:06.508335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:06.508335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:06.508335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:06.508335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:06.508335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:06.508335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:06.508335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:06.508335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:06.508335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:06.508335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:06.509279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:06.510600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:06.510600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:06.510600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:06.510600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:06.510600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:06.510600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:06.510600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:06.510600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:06.510600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 340/666] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:06.510600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82d605-b03d-4e0f-85bf-d9a5c9d0a1f0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:06.518332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caed091-e25c-4112-b29f-0d0e28a02440 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:06.562373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf8f62-5b1f-465e-a1e6-87776a18d6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:06.563110 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf8f62-5b1f-465e-a1e6-87776a18d6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:06.564094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf8f62-5b1f-465e-a1e6-87776a18d6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:06.564591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf8f62-5b1f-465e-a1e6-87776a18d6e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:06.628469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:06.641742 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82d605-b03d-4e0f-85bf-d9a5c9d0a1f0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:06.642362 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf8f62-5b1f-465e-a1e6-87776a18d6e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:06.643868 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf8f62-5b1f-465e-a1e6-87776a18d6e3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:06.659109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:06.679240 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06be1c-b536-4f70-ba45-fc133ddb5ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:06.679843 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06be1c-b536-4f70-ba45-fc133ddb5ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:06.680147 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06be1c-b536-4f70-ba45-fc133ddb5ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:06.680418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06be1c-b536-4f70-ba45-fc133ddb5ab5 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:06.681050 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06be1c-b536-4f70-ba45-fc133ddb5ab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:06.681346 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06be1c-b536-4f70-ba45-fc133ddb5ab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:06.682729 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06be1c-b536-4f70-ba45-fc133ddb5ab5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:06.694431 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 341/667] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:06.695708 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275e634-f8b4-4642-9f37-b010a71e93b2 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:06.696031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275e634-f8b4-4642-9f37-b010a71e93b2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:06.696307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275e634-f8b4-4642-9f37-b010a71e93b2 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:06.698092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 342/668] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:06.700204 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275e634-f8b4-4642-9f37-b010a71e93b2 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:06.745106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 327/669] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:06.746233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf8f62-5b1f-465e-a1e6-87776a18d6e3 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:06.807315 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275e634-f8b4-4642-9f37-b010a71e93b2 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:06.861586 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30ff8b-cdef-474d-8c5d-ac4b27d372dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:06.862524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30ff8b-cdef-474d-8c5d-ac4b27d372dd None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:06.862974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30ff8b-cdef-474d-8c5d-ac4b27d372dd None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:06.863419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30ff8b-cdef-474d-8c5d-ac4b27d372dd None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:06.864592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30ff8b-cdef-474d-8c5d-ac4b27d372dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:06.864741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf8f62-5b1f-465e-a1e6-87776a18d6e3 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:06.865083 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30ff8b-cdef-474d-8c5d-ac4b27d372dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:06.867570 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30ff8b-cdef-474d-8c5d-ac4b27d372dd None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:06.890991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 343/670] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:06.891161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:06.891269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30ff8b-cdef-474d-8c5d-ac4b27d372dd None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:06.906858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:06.918574 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43033812-e25b-494f-bef9-bf2aef2fa382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:06.919277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43033812-e25b-494f-bef9-bf2aef2fa382 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:06.919546 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43033812-e25b-494f-bef9-bf2aef2fa382 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:06.919809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43033812-e25b-494f-bef9-bf2aef2fa382 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:06.930476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43033812-e25b-494f-bef9-bf2aef2fa382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-43033812-e25b-494f-bef9-bf2aef2fa382 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:06.935327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:06.936425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:06.937389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:06.937389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:06.937389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:06.937389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:06.937389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:06.937389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:06.937389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:06.937389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:06.937389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:06.937389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:06.937389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:06.937389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:06.937389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 328/671] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:57:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:06.938140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40167ef3-63ed-49bd-95ff-3697f26b2747 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:06.938140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40167ef3-63ed-49bd-95ff-3697f26b2747 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:06.938276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40167ef3-63ed-49bd-95ff-3697f26b2747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:06.956886 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-40167ef3-63ed-49bd-95ff-3697f26b2747 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:06.958072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-40167ef3-63ed-49bd-95ff-3697f26b2747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:07.008446 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30ff8b-cdef-474d-8c5d-ac4b27d372dd None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:07.027338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 329/672] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:07.028005 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40167ef3-63ed-49bd-95ff-3697f26b2747 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:07.046891 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ca2e0-928e-4905-8481-0b2e16199e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:07.047663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ca2e0-928e-4905-8481-0b2e16199e44 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:07.047983 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ca2e0-928e-4905-8481-0b2e16199e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:07.048251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ca2e0-928e-4905-8481-0b2e16199e44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:07.056492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ca2e0-928e-4905-8481-0b2e16199e44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:07.058457 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ca2e0-928e-4905-8481-0b2e16199e44 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:07.071398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-d91ca2e0-928e-4905-8481-0b2e16199e44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:07.071398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:07.071398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:07.071398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:07.071398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:07.071398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:07.071398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:07.071398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:07.071398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:07.071398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:07.071398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:07.071398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:07.071398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:07.071398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:07.071398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:07.078441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:07.079636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:07.079636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:07.079636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:07.079636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:07.079636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:07.079636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:07.079636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:07.079636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:07.079636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 344/673] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:07.079636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ca2e0-928e-4905-8481-0b2e16199e44 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:07.154592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:07.159659 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40167ef3-63ed-49bd-95ff-3697f26b2747 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:07.163991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:07.190063 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ca2e0-928e-4905-8481-0b2e16199e44 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:07.203217 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927c584-cabd-4b8c-9378-56ab69845d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:07.204124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927c584-cabd-4b8c-9378-56ab69845d04 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:07.204568 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927c584-cabd-4b8c-9378-56ab69845d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:07.205002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927c584-cabd-4b8c-9378-56ab69845d04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:07.216599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927c584-cabd-4b8c-9378-56ab69845d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:07.218234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927c584-cabd-4b8c-9378-56ab69845d04 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:07.231076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268e1b7-865b-4685-acef-8ababc3b308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:07.231685 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268e1b7-865b-4685-acef-8ababc3b308f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:07.231984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268e1b7-865b-4685-acef-8ababc3b308f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:07.232265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268e1b7-865b-4685-acef-8ababc3b308f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:07.233216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268e1b7-865b-4685-acef-8ababc3b308f None admin] RBAC: Adding query filter params (role.id=2381dab0bb194ddfaf31c2933c683b71, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=77d3889156524b388b761cedfac8ed6e) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:07.233216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268e1b7-865b-4685-acef-8ababc3b308f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-2927c584-cabd-4b8c-9378-56ab69845d04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:07.234486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:07.235765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:07.236712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:07.236712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:07.236712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:07.236894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268e1b7-865b-4685-acef-8ababc3b308f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:07.239997 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 330/674] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:07.240985 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927c584-cabd-4b8c-9378-56ab69845d04 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:07.252379 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 345/675] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:57:07 2022] GET /identity/v3/role_assignments?user.id=77d3889156524b388b761cedfac8ed6e&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=2381dab0bb194ddfaf31c2933c683b71 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:07.252379 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268e1b7-865b-4685-acef-8ababc3b308f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:07.367564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268e1b7-865b-4685-acef-8ababc3b308f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:07.375301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927c584-cabd-4b8c-9378-56ab69845d04 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:07.405043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e189021-3cae-4e04-8d2f-7445cf6ae8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:07.405565 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e189021-3cae-4e04-8d2f-7445cf6ae8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:07.405846 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e189021-3cae-4e04-8d2f-7445cf6ae8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:07.406121 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e189021-3cae-4e04-8d2f-7445cf6ae8b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:07.406863 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e189021-3cae-4e04-8d2f-7445cf6ae8b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:07.407229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e189021-3cae-4e04-8d2f-7445cf6ae8b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:07.408700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e189021-3cae-4e04-8d2f-7445cf6ae8b4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:07.411578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:07.416923 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cc8b3-8c86-46ee-b0ad-965618b51321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:07.417709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cc8b3-8c86-46ee-b0ad-965618b51321 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:07.417979 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cc8b3-8c86-46ee-b0ad-965618b51321 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:07.418242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cc8b3-8c86-46ee-b0ad-965618b51321 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:07.418910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cc8b3-8c86-46ee-b0ad-965618b51321 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:07.419206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cc8b3-8c86-46ee-b0ad-965618b51321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:07.421428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cc8b3-8c86-46ee-b0ad-965618b51321 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:07.425501 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 346/676] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:07.426213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e189021-3cae-4e04-8d2f-7445cf6ae8b4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:07.429801 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 331/677] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:57:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:07.430686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cc8b3-8c86-46ee-b0ad-965618b51321 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:07.454852 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:07.546663 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cc8b3-8c86-46ee-b0ad-965618b51321 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:07.548217 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e189021-3cae-4e04-8d2f-7445cf6ae8b4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:07.584194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d4a82-aedd-4f94-89a3-b6f830f92f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:07.584925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d4a82-aedd-4f94-89a3-b6f830f92f39 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:07.585272 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d4a82-aedd-4f94-89a3-b6f830f92f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:07.585547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d4a82-aedd-4f94-89a3-b6f830f92f39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:07.585739 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a915e-4e73-4be2-b09e-9785f7a6ea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:07.586335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a915e-4e73-4be2-b09e-9785f7a6ea0e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:07.586606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a915e-4e73-4be2-b09e-9785f7a6ea0e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:07.586869 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a915e-4e73-4be2-b09e-9785f7a6ea0e None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:07.587807 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a915e-4e73-4be2-b09e-9785f7a6ea0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:07.588520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a915e-4e73-4be2-b09e-9785f7a6ea0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:07.589874 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a915e-4e73-4be2-b09e-9785f7a6ea0e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:07.596195 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d4a82-aedd-4f94-89a3-b6f830f92f39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-4a4d4a82-aedd-4f94-89a3-b6f830f92f39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:07.601380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:07.602333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:07.608647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:07.608647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:07.608647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:07.608647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:07.608647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:07.608647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:07.608647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:07.608647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:07.608647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:07.608647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:07.608647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:07.608647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:07.608647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 332/678] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:57:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:07.608647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d4a82-aedd-4f94-89a3-b6f830f92f39 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:07.609409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 347/679] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:07.609409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a915e-4e73-4be2-b09e-9785f7a6ea0e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:07.675239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:07.694964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:07.720117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d4a82-aedd-4f94-89a3-b6f830f92f39 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:07.722252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a915e-4e73-4be2-b09e-9785f7a6ea0e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:07.757377 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d934a-1cab-4c1b-800a-c722549b8136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:07.757604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b108e-826a-4476-9d95-48bb3de0bf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:07.757983 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b108e-826a-4476-9d95-48bb3de0bf40 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:07.758101 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d934a-1cab-4c1b-800a-c722549b8136 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:07.758273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d934a-1cab-4c1b-800a-c722549b8136 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:07.758368 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b108e-826a-4476-9d95-48bb3de0bf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:07.758520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d934a-1cab-4c1b-800a-c722549b8136 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:07.758620 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b108e-826a-4476-9d95-48bb3de0bf40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:07.759240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b108e-826a-4476-9d95-48bb3de0bf40 None admin] RBAC: Adding query filter params (role.id=2381dab0bb194ddfaf31c2933c683b71, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=eee3162303924aaeb91af567f02980e2) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:07.759772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b108e-826a-4476-9d95-48bb3de0bf40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:07.761739 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b108e-826a-4476-9d95-48bb3de0bf40 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:07.772172 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d934a-1cab-4c1b-800a-c722549b8136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:07.772408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 333/680] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:57:07 2022] GET /identity/v3/role_assignments?user.id=eee3162303924aaeb91af567f02980e2&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=2381dab0bb194ddfaf31c2933c683b71 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:07.772408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b108e-826a-4476-9d95-48bb3de0bf40 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:07.772634 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d934a-1cab-4c1b-800a-c722549b8136 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1e9d934a-1cab-4c1b-800a-c722549b8136 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:07.790405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:07.791521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:07.792481 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:07.792481 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:07.792481 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:07.796789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 348/681] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:07.797765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d934a-1cab-4c1b-800a-c722549b8136 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:07.909209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b108e-826a-4476-9d95-48bb3de0bf40 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:07.938828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d934a-1cab-4c1b-800a-c722549b8136 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:07.947691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:07.948099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87f421-9c9b-443c-a162-3d828520a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:07.948790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87f421-9c9b-443c-a162-3d828520a5ca None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:07.949062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87f421-9c9b-443c-a162-3d828520a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:07.949371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87f421-9c9b-443c-a162-3d828520a5ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:07.958831 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87f421-9c9b-443c-a162-3d828520a5ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:07.960311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87f421-9c9b-443c-a162-3d828520a5ca None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:07.973119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-6b87f421-9c9b-443c-a162-3d828520a5ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:07.973119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:07.973119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:07.973119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:07.973119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:07.973119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:07.973119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:07.973119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:07.973119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:07.973119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:07.973119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:07.973119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:07.973119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:07.973119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:07.973119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:07.974230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:07.975277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:07.975277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:07.975277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:07.975277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:07.975277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:07.975277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:07.975277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:07.975277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:07.975277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 334/682] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:07.975781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87f421-9c9b-443c-a162-3d828520a5ca None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:07.986334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe449a-af2a-41ec-b65c-58164cc10cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:07.987042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe449a-af2a-41ec-b65c-58164cc10cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:07.987393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe449a-af2a-41ec-b65c-58164cc10cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:07.987735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe449a-af2a-41ec-b65c-58164cc10cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:07.988936 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe449a-af2a-41ec-b65c-58164cc10cf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:07.988936 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe449a-af2a-41ec-b65c-58164cc10cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:07.989120 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:07.990589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe449a-af2a-41ec-b65c-58164cc10cf6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:08.001793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 349/683] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:57:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:08.002649 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe449a-af2a-41ec-b65c-58164cc10cf6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:08.097984 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87f421-9c9b-443c-a162-3d828520a5ca None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:08.131406 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe449a-af2a-41ec-b65c-58164cc10cf6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:08.136634 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02545c49-88a3-478d-a8c1-824eddcc4628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:08.137349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02545c49-88a3-478d-a8c1-824eddcc4628 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:08.137731 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02545c49-88a3-478d-a8c1-824eddcc4628 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:08.138123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02545c49-88a3-478d-a8c1-824eddcc4628 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:08.138868 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02545c49-88a3-478d-a8c1-824eddcc4628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:08.139269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02545c49-88a3-478d-a8c1-824eddcc4628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:08.140761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02545c49-88a3-478d-a8c1-824eddcc4628 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:08.154516 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 335/684] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:08.155548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02545c49-88a3-478d-a8c1-824eddcc4628 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:08.177046 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ad48d-3238-4ecd-916d-464a631dcc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:08.177867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ad48d-3238-4ecd-916d-464a631dcc8a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:08.178252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ad48d-3238-4ecd-916d-464a631dcc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:08.178637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ad48d-3238-4ecd-916d-464a631dcc8a None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:08.179431 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ad48d-3238-4ecd-916d-464a631dcc8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:08.179891 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ad48d-3238-4ecd-916d-464a631dcc8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:08.181547 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ad48d-3238-4ecd-916d-464a631dcc8a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:08.200217 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 350/685] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:08.201251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ad48d-3238-4ecd-916d-464a631dcc8a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:08.234199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:08.238592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:08.279826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02545c49-88a3-478d-a8c1-824eddcc4628 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:08.324294 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051099e7-c4cc-4f92-a365-da0a02eaf2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:08.324934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051099e7-c4cc-4f92-a365-da0a02eaf2ae None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:08.325763 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051099e7-c4cc-4f92-a365-da0a02eaf2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:08.326040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051099e7-c4cc-4f92-a365-da0a02eaf2ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:08.339770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051099e7-c4cc-4f92-a365-da0a02eaf2ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:08.340468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ad48d-3238-4ecd-916d-464a631dcc8a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:08.341268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051099e7-c4cc-4f92-a365-da0a02eaf2ae None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-051099e7-c4cc-4f92-a365-da0a02eaf2ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:08.360903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:08.362118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:08.363221 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:08.363221 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:08.363221 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:08.363221 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 336/686] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:08.363221 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051099e7-c4cc-4f92-a365-da0a02eaf2ae None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:08.390281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3695c7-7520-46ae-9dcd-b671771b56db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:08.391202 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3695c7-7520-46ae-9dcd-b671771b56db None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:08.392129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3695c7-7520-46ae-9dcd-b671771b56db None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:08.392565 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3695c7-7520-46ae-9dcd-b671771b56db None admin] PATH_INFO: `/v3/users/swift` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:08.402566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3695c7-7520-46ae-9dcd-b671771b56db None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:08.404624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3695c7-7520-46ae-9dcd-b671771b56db None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7d3695c7-7520-46ae-9dcd-b671771b56db None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:08.420214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:08.421430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:08.422603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:08.422603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:08.422603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:08.422603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:08.422603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:08.422603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:08.422603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:08.422603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:08.422603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:57:08.422603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:08.425263 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 351/687] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:57:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:08.426553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3695c7-7520-46ae-9dcd-b671771b56db None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:08.495083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051099e7-c4cc-4f92-a365-da0a02eaf2ae None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:08.513265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:08.539683 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19d68c-8cbe-42c7-a738-8022bd8df506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:08.540617 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19d68c-8cbe-42c7-a738-8022bd8df506 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:08.541086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19d68c-8cbe-42c7-a738-8022bd8df506 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:08.541739 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19d68c-8cbe-42c7-a738-8022bd8df506 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:08.542568 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19d68c-8cbe-42c7-a738-8022bd8df506 None admin] RBAC: Adding query filter params (role.id=2381dab0bb194ddfaf31c2933c683b71, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=4398d5175c8c409789d62c277da35ed7) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:08.542968 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19d68c-8cbe-42c7-a738-8022bd8df506 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:08.544526 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19d68c-8cbe-42c7-a738-8022bd8df506 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:08.545037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:08.552851 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 337/688] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:57:08 2022] GET /identity/v3/role_assignments?user.id=4398d5175c8c409789d62c277da35ed7&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=2381dab0bb194ddfaf31c2933c683b71 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:08.554012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19d68c-8cbe-42c7-a738-8022bd8df506 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:08.562387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3695c7-7520-46ae-9dcd-b671771b56db None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:08.616898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96597f02-f5e3-41b0-b5f5-28797a9886d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:08.617808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96597f02-f5e3-41b0-b5f5-28797a9886d9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:08.618510 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96597f02-f5e3-41b0-b5f5-28797a9886d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:08.619488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96597f02-f5e3-41b0-b5f5-28797a9886d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:08.620750 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96597f02-f5e3-41b0-b5f5-28797a9886d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:08.621220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96597f02-f5e3-41b0-b5f5-28797a9886d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:08.622744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96597f02-f5e3-41b0-b5f5-28797a9886d9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:08.641893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 352/689] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:08.647201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96597f02-f5e3-41b0-b5f5-28797a9886d9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:08.708687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19d68c-8cbe-42c7-a738-8022bd8df506 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:08.793268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7701c-a8b9-49eb-b6e0-d3080dede2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:08.794392 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7701c-a8b9-49eb-b6e0-d3080dede2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:08.794844 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7701c-a8b9-49eb-b6e0-d3080dede2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:08.795260 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7701c-a8b9-49eb-b6e0-d3080dede2f5 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:08.796829 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7701c-a8b9-49eb-b6e0-d3080dede2f5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:08.797285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7701c-a8b9-49eb-b6e0-d3080dede2f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:08.799151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7701c-a8b9-49eb-b6e0-d3080dede2f5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:08.809785 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96597f02-f5e3-41b0-b5f5-28797a9886d9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:08.831421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 338/690] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Aug 30 04:57:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:08.836809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7701c-a8b9-49eb-b6e0-d3080dede2f5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:08.860824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e61eb-03da-4483-88ee-161b525d07b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:08.861138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e61eb-03da-4483-88ee-161b525d07b8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:08.861643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e61eb-03da-4483-88ee-161b525d07b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:08.862008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e61eb-03da-4483-88ee-161b525d07b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:08.872094 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e61eb-03da-4483-88ee-161b525d07b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:08.874445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e61eb-03da-4483-88ee-161b525d07b8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:08.887982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-715e61eb-03da-4483-88ee-161b525d07b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:08.897297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:08.898511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:08.899850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:08.899850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:08.899850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:08.899850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:08.899850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:08.899850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:08.899850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:08.899850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:08.899850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:57:08.899850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:08.904518 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 353/691] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Aug 30 04:57:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:08.906182 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e61eb-03da-4483-88ee-161b525d07b8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:08.926281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:08.986005 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7701c-a8b9-49eb-b6e0-d3080dede2f5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:09.030572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5011e8-1f41-455d-9b89-9bb0c811a800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:09.031180 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5011e8-1f41-455d-9b89-9bb0c811a800 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:09.031462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5011e8-1f41-455d-9b89-9bb0c811a800 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:09.031733 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5011e8-1f41-455d-9b89-9bb0c811a800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:09.061564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e61eb-03da-4483-88ee-161b525d07b8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:09.125511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606a5af-cb53-44ad-bf68-b4849a11dd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:09.126819 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606a5af-cb53-44ad-bf68-b4849a11dd7e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:09.132970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606a5af-cb53-44ad-bf68-b4849a11dd7e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:09.132970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606a5af-cb53-44ad-bf68-b4849a11dd7e None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:09.132970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606a5af-cb53-44ad-bf68-b4849a11dd7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:09.132970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606a5af-cb53-44ad-bf68-b4849a11dd7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:09.132970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606a5af-cb53-44ad-bf68-b4849a11dd7e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:09.164427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 354/692] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Aug 30 04:57:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:09.171928 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606a5af-cb53-44ad-bf68-b4849a11dd7e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:09.192136 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5011e8-1f41-455d-9b89-9bb0c811a800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:09.193602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5011e8-1f41-455d-9b89-9bb0c811a800 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:09.260395 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:09.285835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:09.354292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 339/693] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:09.362565 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606a5af-cb53-44ad-bf68-b4849a11dd7e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:09.369678 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5011e8-1f41-455d-9b89-9bb0c811a800 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:09.410230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d0ea0-b138-49e7-9fb6-4be35b5c0c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:09.410947 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d0ea0-b138-49e7-9fb6-4be35b5c0c3c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:09.411299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d0ea0-b138-49e7-9fb6-4be35b5c0c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:09.411635 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d0ea0-b138-49e7-9fb6-4be35b5c0c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:09.487598 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d0ea0-b138-49e7-9fb6-4be35b5c0c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:09.489218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d0ea0-b138-49e7-9fb6-4be35b5c0c3c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:09.497596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5011e8-1f41-455d-9b89-9bb0c811a800 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:09.544089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46aeeb-a180-4cd6-92c3-fade45ffd8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:09.545104 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46aeeb-a180-4cd6-92c3-fade45ffd8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:09.546130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46aeeb-a180-4cd6-92c3-fade45ffd8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:09.546469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46aeeb-a180-4cd6-92c3-fade45ffd8d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:09.549980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:09.560811 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46aeeb-a180-4cd6-92c3-fade45ffd8d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:09.562986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46aeeb-a180-4cd6-92c3-fade45ffd8d8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:09.565675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-fa46aeeb-a180-4cd6-92c3-fade45ffd8d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:09.584297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:09.585393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:09.586291 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:09.586291 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:09.586291 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:09.586291 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 340/694] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:09.591894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d032c-45b1-46a2-89a3-51f7f1122377 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:09.591894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d032c-45b1-46a2-89a3-51f7f1122377 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:09.591894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d032c-45b1-46a2-89a3-51f7f1122377 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:09.593169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 341/695] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:09.597143 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d032c-45b1-46a2-89a3-51f7f1122377 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:09.618998 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 355/696] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:09.620615 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155a9bf-ba09-4311-b2e1-1933d053ccd6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:09.621089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155a9bf-ba09-4311-b2e1-1933d053ccd6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:09.621524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155a9bf-ba09-4311-b2e1-1933d053ccd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:09.642558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4155a9bf-ba09-4311-b2e1-1933d053ccd6 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:09.644186 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4155a9bf-ba09-4311-b2e1-1933d053ccd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:09.715787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 356/697] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:09.716671 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155a9bf-ba09-4311-b2e1-1933d053ccd6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:09.733176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d032c-45b1-46a2-89a3-51f7f1122377 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:09.797656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe470bd-fe5c-48ad-916b-f6654916eccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:09.798278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe470bd-fe5c-48ad-916b-f6654916eccf None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:09.798559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe470bd-fe5c-48ad-916b-f6654916eccf None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:09.798832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe470bd-fe5c-48ad-916b-f6654916eccf None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:09.799490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe470bd-fe5c-48ad-916b-f6654916eccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:09.799792 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe470bd-fe5c-48ad-916b-f6654916eccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:09.801253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe470bd-fe5c-48ad-916b-f6654916eccf None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:09.813775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:09.819873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155a9bf-ba09-4311-b2e1-1933d053ccd6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:09.824605 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 342/698] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:09.830259 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe470bd-fe5c-48ad-916b-f6654916eccf None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:09.857325 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854ba9f-50a6-417e-814a-5293b3e758eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:09.857961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854ba9f-50a6-417e-814a-5293b3e758eb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:09.858238 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854ba9f-50a6-417e-814a-5293b3e758eb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:09.858516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854ba9f-50a6-417e-814a-5293b3e758eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:09.870103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854ba9f-50a6-417e-814a-5293b3e758eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:09.871467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854ba9f-50a6-417e-814a-5293b3e758eb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4854ba9f-50a6-417e-814a-5293b3e758eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:09.889091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:09.890336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:09.891417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:09.891417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:09.891417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:09.891417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 357/699] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:09.897230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854ba9f-50a6-417e-814a-5293b3e758eb None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:09.930927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:10.041052 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe470bd-fe5c-48ad-916b-f6654916eccf None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:10.066954 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854ba9f-50a6-417e-814a-5293b3e758eb None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:10.088586 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f5283-0001-4218-9fc1-841128f2ee7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:10.089442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f5283-0001-4218-9fc1-841128f2ee7c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:10.089563 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f5283-0001-4218-9fc1-841128f2ee7c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:10.089742 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f5283-0001-4218-9fc1-841128f2ee7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:10.096552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f5283-0001-4218-9fc1-841128f2ee7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:10.097981 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f5283-0001-4218-9fc1-841128f2ee7c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:10.104871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ddb2e-22c2-4965-a623-5279369bc9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:10.105577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ddb2e-22c2-4965-a623-5279369bc9ad None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:10.105953 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ddb2e-22c2-4965-a623-5279369bc9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:10.106322 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ddb2e-22c2-4965-a623-5279369bc9ad None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:10.107066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ddb2e-22c2-4965-a623-5279369bc9ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:10.107464 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ddb2e-22c2-4965-a623-5279369bc9ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:10.108948 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ddb2e-22c2-4965-a623-5279369bc9ad None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:10.109653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-930f5283-0001-4218-9fc1-841128f2ee7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:10.109653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:10.109653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:10.109653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:10.109653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:10.109653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:10.109653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:10.109653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:10.109653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:10.109653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:10.109653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:10.109653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:10.109653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:10.109653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:10.109653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:10.110606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:10.113172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:10.113172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:10.113172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:10.113172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:10.113172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:10.113172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:10.113172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:10.113172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:10.113172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 343/700] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:10.113172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816d802-46e6-486d-a4fa-f4918d3bfa17 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:10.113172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816d802-46e6-486d-a4fa-f4918d3bfa17 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:10.113795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816d802-46e6-486d-a4fa-f4918d3bfa17 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:10.114150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 344/701] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:10.114843 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816d802-46e6-486d-a4fa-f4918d3bfa17 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:10.130435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 358/702] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:10.131871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ddb2e-22c2-4965-a623-5279369bc9ad None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:10.144642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:10.233375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816d802-46e6-486d-a4fa-f4918d3bfa17 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:10.240738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ddb2e-22c2-4965-a623-5279369bc9ad None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:10.243786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:10.273126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54236f85-ffb7-4b17-9ca7-f5d6ce217ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:10.273616 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54236f85-ffb7-4b17-9ca7-f5d6ce217ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:10.273888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54236f85-ffb7-4b17-9ca7-f5d6ce217ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:10.274167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54236f85-ffb7-4b17-9ca7-f5d6ce217ec3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:10.279367 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd84d62-1b5f-464d-8cda-ee63743cc260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:10.280162 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd84d62-1b5f-464d-8cda-ee63743cc260 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:10.280564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd84d62-1b5f-464d-8cda-ee63743cc260 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:10.280957 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd84d62-1b5f-464d-8cda-ee63743cc260 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:10.282079 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd84d62-1b5f-464d-8cda-ee63743cc260 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:10.282518 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd84d62-1b5f-464d-8cda-ee63743cc260 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:10.284411 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd84d62-1b5f-464d-8cda-ee63743cc260 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:10.286029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54236f85-ffb7-4b17-9ca7-f5d6ce217ec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:10.287459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54236f85-ffb7-4b17-9ca7-f5d6ce217ec3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:10.302657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 359/703] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:10.302657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3960c-4c4d-4df3-84fc-31fd1d3e5194 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:10.302657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3960c-4c4d-4df3-84fc-31fd1d3e5194 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:10.302657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3960c-4c4d-4df3-84fc-31fd1d3e5194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-54236f85-ffb7-4b17-9ca7-f5d6ce217ec3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:10.303058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:10.303930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:10.304900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:10.304900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:10.304900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:10.304900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 345/704] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:10.304900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54236f85-ffb7-4b17-9ca7-f5d6ce217ec3 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:10.321816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-28c3960c-4c4d-4df3-84fc-31fd1d3e5194 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:10.323577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-28c3960c-4c4d-4df3-84fc-31fd1d3e5194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:10.391828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:10.398716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 360/705] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:10.400752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3960c-4c4d-4df3-84fc-31fd1d3e5194 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:10.421989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54236f85-ffb7-4b17-9ca7-f5d6ce217ec3 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:10.465778 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fda42-d8ee-4ec5-85df-13bcdfe882b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:10.466756 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fda42-d8ee-4ec5-85df-13bcdfe882b5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:10.467192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fda42-d8ee-4ec5-85df-13bcdfe882b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:10.467618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fda42-d8ee-4ec5-85df-13bcdfe882b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:10.477379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fda42-d8ee-4ec5-85df-13bcdfe882b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:10.480348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fda42-d8ee-4ec5-85df-13bcdfe882b5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:10.500360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-586fda42-d8ee-4ec5-85df-13bcdfe882b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:10.500360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:10.500360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:10.500360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:10.500360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:10.500360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:10.500360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:10.500360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:10.500360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:10.500360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:10.500360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:10.500360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:10.500360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:10.500360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:10.500360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:10.501556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:10.502669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:10.502669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:10.502669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:10.502669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:10.502669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:10.502669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:10.502669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:10.502669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:10.505680 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 346/706] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:10.506691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fda42-d8ee-4ec5-85df-13bcdfe882b5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:10.529453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3960c-4c4d-4df3-84fc-31fd1d3e5194 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:10.533381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:10.579545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39580efc-a518-4244-befa-736dc88bd53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:10.580760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39580efc-a518-4244-befa-736dc88bd53e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:10.581190 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39580efc-a518-4244-befa-736dc88bd53e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:10.582207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39580efc-a518-4244-befa-736dc88bd53e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:10.583209 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39580efc-a518-4244-befa-736dc88bd53e None admin] RBAC: Adding query filter params (role.id=2381dab0bb194ddfaf31c2933c683b71, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=a96ac878c106422ebf438a64ca618747) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:10.583783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39580efc-a518-4244-befa-736dc88bd53e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:10.586506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39580efc-a518-4244-befa-736dc88bd53e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:10.594335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 361/707] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:57:10 2022] GET /identity/v3/role_assignments?user.id=a96ac878c106422ebf438a64ca618747&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=2381dab0bb194ddfaf31c2933c683b71 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:10.596038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39580efc-a518-4244-befa-736dc88bd53e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:10.621319 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fda42-d8ee-4ec5-85df-13bcdfe882b5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:10.660246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04d3a3-4803-4433-82ae-1bbd28249af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:10.661142 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04d3a3-4803-4433-82ae-1bbd28249af0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:10.661273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04d3a3-4803-4433-82ae-1bbd28249af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:10.661644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04d3a3-4803-4433-82ae-1bbd28249af0 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:10.662385 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04d3a3-4803-4433-82ae-1bbd28249af0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:10.662832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04d3a3-4803-4433-82ae-1bbd28249af0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:10.664384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04d3a3-4803-4433-82ae-1bbd28249af0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:10.678301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 347/708] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:10.686161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:10.688725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04d3a3-4803-4433-82ae-1bbd28249af0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:10.735313 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39580efc-a518-4244-befa-736dc88bd53e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:10.774391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78631e21-2533-4c70-879f-49184d476e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:10.775660 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78631e21-2533-4c70-879f-49184d476e4e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:10.776032 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78631e21-2533-4c70-879f-49184d476e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:10.776370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78631e21-2533-4c70-879f-49184d476e4e None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:10.777152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78631e21-2533-4c70-879f-49184d476e4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:10.777525 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78631e21-2533-4c70-879f-49184d476e4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:10.779061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78631e21-2533-4c70-879f-49184d476e4e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:10.797131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 362/709] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:10.798633 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78631e21-2533-4c70-879f-49184d476e4e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:10.827890 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:10.857663 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04d3a3-4803-4433-82ae-1bbd28249af0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:10.906315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15daa35-3633-44f8-8124-1448c06724f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:10.907258 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15daa35-3633-44f8-8124-1448c06724f7 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:10.907531 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15daa35-3633-44f8-8124-1448c06724f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:10.907799 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15daa35-3633-44f8-8124-1448c06724f7 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:10.908482 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15daa35-3633-44f8-8124-1448c06724f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:10.909911 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15daa35-3633-44f8-8124-1448c06724f7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:10.928304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78631e21-2533-4c70-879f-49184d476e4e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:10.934548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 348/710] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:57:10 2022] POST /identity/v3/users => generated 254 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:10.935399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15daa35-3633-44f8-8124-1448c06724f7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:10.960394 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:10.975335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a181461-58b1-4521-b223-d794eb55e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:10.976370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a181461-58b1-4521-b223-d794eb55e84f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:10.976904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a181461-58b1-4521-b223-d794eb55e84f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:10.977429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a181461-58b1-4521-b223-d794eb55e84f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:10.978840 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a181461-58b1-4521-b223-d794eb55e84f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:10.986654 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a181461-58b1-4521-b223-d794eb55e84f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1a181461-58b1-4521-b223-d794eb55e84f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:10.999628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:11.001014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:11.002117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:11.002117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:11.002117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:11.002117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:11.002117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:11.002117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:11.002117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:11.002117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:11.002117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:11.002117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:11.002117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:11.002117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:11.002117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:57:11.002117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:11.004693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 363/711] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Aug 30 04:57:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:11.006355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2b832-ca2b-4502-bad5-655eb4109978 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:11.006808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2b832-ca2b-4502-bad5-655eb4109978 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:11.007230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2b832-ca2b-4502-bad5-655eb4109978 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:11.009119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 364/712] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:11.019030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2b832-ca2b-4502-bad5-655eb4109978 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:11.061097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15daa35-3633-44f8-8124-1448c06724f7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:11.116643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbc5ae-9727-4008-8624-04fc52ee7195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:11.117268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbc5ae-9727-4008-8624-04fc52ee7195 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:11.117540 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbc5ae-9727-4008-8624-04fc52ee7195 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:11.117808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbc5ae-9727-4008-8624-04fc52ee7195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:11.118752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbc5ae-9727-4008-8624-04fc52ee7195 None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=1aa002909502426b80c97dbf05dca008) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:11.119192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbc5ae-9727-4008-8624-04fc52ee7195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:11.120688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbc5ae-9727-4008-8624-04fc52ee7195 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:11.124449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:11.127702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 349/713] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:57:10 2022] GET /identity/v3/role_assignments?user.id=1aa002909502426b80c97dbf05dca008&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:11.129566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015627ce-1239-4c32-b28a-e8938c64ce13 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:11.129915 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015627ce-1239-4c32-b28a-e8938c64ce13 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:11.131001 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015627ce-1239-4c32-b28a-e8938c64ce13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:11.159929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-015627ce-1239-4c32-b28a-e8938c64ce13 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:11.161204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-015627ce-1239-4c32-b28a-e8938c64ce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:11.161468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2b832-ca2b-4502-bad5-655eb4109978 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:11.216164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a9fc2-5314-46f2-8469-d13ab8d2a4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:11.216711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a9fc2-5314-46f2-8469-d13ab8d2a4af None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:11.216987 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a9fc2-5314-46f2-8469-d13ab8d2a4af None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:11.217256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a9fc2-5314-46f2-8469-d13ab8d2a4af None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:11.217904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a9fc2-5314-46f2-8469-d13ab8d2a4af None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:11.218577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a9fc2-5314-46f2-8469-d13ab8d2a4af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:11.222085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a9fc2-5314-46f2-8469-d13ab8d2a4af None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:11.228602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 365/714] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Aug 30 04:57:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:11.237087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a9fc2-5314-46f2-8469-d13ab8d2a4af None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:11.265778 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 350/715] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:11.308236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:11.372682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a9fc2-5314-46f2-8469-d13ab8d2a4af None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:11.424142 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7f001-ea7a-4122-b547-b6ced8a502b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:11.424913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7f001-ea7a-4122-b547-b6ced8a502b6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:11.425282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7f001-ea7a-4122-b547-b6ced8a502b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:11.425643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7f001-ea7a-4122-b547-b6ced8a502b6 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:11.426363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7f001-ea7a-4122-b547-b6ced8a502b6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:11.426755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7f001-ea7a-4122-b547-b6ced8a502b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:11.428228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7f001-ea7a-4122-b547-b6ced8a502b6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:11.436955 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 366/716] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Aug 30 04:57:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:11.584333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015627ce-1239-4c32-b28a-e8938c64ce13 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:11.697511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015627ce-1239-4c32-b28a-e8938c64ce13 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:11.728929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:11.738149 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fc3f5-70cf-4923-abb0-922036f15e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:11.738838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fc3f5-70cf-4923-abb0-922036f15e9e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:11.739118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fc3f5-70cf-4923-abb0-922036f15e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:11.739386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fc3f5-70cf-4923-abb0-922036f15e9e None admin] PATH_INFO: `/v3/services/network` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:11.739986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fc3f5-70cf-4923-abb0-922036f15e9e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:11.741349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fc3f5-70cf-4923-abb0-922036f15e9e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f64fc3f5-70cf-4923-abb0-922036f15e9e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:11.752322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:11.753346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:11.754467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:11.754467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:11.754467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:11.754467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:11.754467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:11.754467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:11.754467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:11.754467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:11.754467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:11.754467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:11.754467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:11.754467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:11.754467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:57:11.754467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:11.754467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 351/717] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:11 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:11.759868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7f001-ea7a-4122-b547-b6ced8a502b6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:11.881200 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7f001-ea7a-4122-b547-b6ced8a502b6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:11.905057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:11.927618 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a751e2-ec4b-41b3-9206-8c11137c9c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:11.928264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a751e2-ec4b-41b3-9206-8c11137c9c1a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:11.928538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a751e2-ec4b-41b3-9206-8c11137c9c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:11.928806 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a751e2-ec4b-41b3-9206-8c11137c9c1a None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:11.929436 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a751e2-ec4b-41b3-9206-8c11137c9c1a None admin] RBAC: Adding query filter params (name=network) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:11.929735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a751e2-ec4b-41b3-9206-8c11137c9c1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:11.931096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a751e2-ec4b-41b3-9206-8c11137c9c1a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:11.936632 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 367/718] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Aug 30 04:57:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:11.942133 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fc3f5-70cf-4923-abb0-922036f15e9e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:12.064538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fc3f5-70cf-4923-abb0-922036f15e9e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:12.099400 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e2fb9-e93f-42fc-a122-888e1a353656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:12.099986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e2fb9-e93f-42fc-a122-888e1a353656 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:12.100266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e2fb9-e93f-42fc-a122-888e1a353656 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:12.100532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e2fb9-e93f-42fc-a122-888e1a353656 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:12.101165 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e2fb9-e93f-42fc-a122-888e1a353656 None admin] RBAC: Adding query filter params (type=network) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:12.101463 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e2fb9-e93f-42fc-a122-888e1a353656 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:12.103026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e2fb9-e93f-42fc-a122-888e1a353656 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:12.110031 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 352/719] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Aug 30 04:57:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:13.187564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab05e7-a1d8-42fe-946b-9db142c7f2b2 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:13.188126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab05e7-a1d8-42fe-946b-9db142c7f2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:13.188126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab05e7-a1d8-42fe-946b-9db142c7f2b2 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:13.189733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 368/720] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:13.195013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84b0a6-73d0-4eb6-b452-e5695e58c559 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:13.195421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84b0a6-73d0-4eb6-b452-e5695e58c559 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:13.195604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84b0a6-73d0-4eb6-b452-e5695e58c559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:13.216266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7a84b0a6-73d0-4eb6-b452-e5695e58c559 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:13.217469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7a84b0a6-73d0-4eb6-b452-e5695e58c559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:13.291119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:13.309608 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 353/721] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:13.480520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb165135-2d37-4825-a400-3983dac3bfcd None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:13.480852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb165135-2d37-4825-a400-3983dac3bfcd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:13.481065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb165135-2d37-4825-a400-3983dac3bfcd None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:13.482394 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 369/722] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:13.487695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa39e4c-7859-471f-9964-2cc18d7850c5 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:13.488001 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa39e4c-7859-471f-9964-2cc18d7850c5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:13.488279 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa39e4c-7859-471f-9964-2cc18d7850c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:13.511363 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4aa39e4c-7859-471f-9964-2cc18d7850c5 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:13.512571 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4aa39e4c-7859-471f-9964-2cc18d7850c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:13.600776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 354/723] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:13.648337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d1173-5c5f-4024-8e51-ed4b06660a76 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:13.648642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d1173-5c5f-4024-8e51-ed4b06660a76 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:13.648877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d1173-5c5f-4024-8e51-ed4b06660a76 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:13.650587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 370/724] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:13.655714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f643575-299b-4367-8894-67a2fee52a99 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:13.656011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f643575-299b-4367-8894-67a2fee52a99 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:13.656286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f643575-299b-4367-8894-67a2fee52a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:13.685007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5f643575-299b-4367-8894-67a2fee52a99 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:13.686440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5f643575-299b-4367-8894-67a2fee52a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:13.699364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d1173-5c5f-4024-8e51-ed4b06660a76 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:13.805942 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 355/725] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:13.843628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d1173-5c5f-4024-8e51-ed4b06660a76 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:13.884435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93161f-ee89-407b-9fb3-9a1dd6be1c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:13.885041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93161f-ee89-407b-9fb3-9a1dd6be1c63 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:13.885312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93161f-ee89-407b-9fb3-9a1dd6be1c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:13.885577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93161f-ee89-407b-9fb3-9a1dd6be1c63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:13.899317 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93161f-ee89-407b-9fb3-9a1dd6be1c63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-6f93161f-ee89-407b-9fb3-9a1dd6be1c63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:13.905369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:13.906296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:13.907208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:13.907208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:13.907208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:13.907208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:13.907208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:13.907208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:13.907208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:13.907208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:13.907208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:13.907208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:13.907208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:13.907208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:13.907208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 371/726] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:57:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:13.912708 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f643575-299b-4367-8894-67a2fee52a99 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:13.973837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:13.998662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93161f-ee89-407b-9fb3-9a1dd6be1c63 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:14.071183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:14.092386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f643575-299b-4367-8894-67a2fee52a99 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:14.167770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256321eb-36ca-413c-9134-afee682564dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:14.168362 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256321eb-36ca-413c-9134-afee682564dc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:14.168651 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256321eb-36ca-413c-9134-afee682564dc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:14.169035 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256321eb-36ca-413c-9134-afee682564dc None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:14.169595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256321eb-36ca-413c-9134-afee682564dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:14.169890 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256321eb-36ca-413c-9134-afee682564dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:14.171347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256321eb-36ca-413c-9134-afee682564dc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:14.181256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 356/727] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:57:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:14.187079 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256321eb-36ca-413c-9134-afee682564dc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:14.187233 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93161f-ee89-407b-9fb3-9a1dd6be1c63 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:14.221452 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365d9c1-392d-44c0-bd19-57522975a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:14.222088 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365d9c1-392d-44c0-bd19-57522975a934 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:14.222344 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365d9c1-392d-44c0-bd19-57522975a934 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:14.222614 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365d9c1-392d-44c0-bd19-57522975a934 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:14.233628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365d9c1-392d-44c0-bd19-57522975a934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-0365d9c1-392d-44c0-bd19-57522975a934 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:14.238404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:14.239318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:14.240191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:14.240191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:14.240191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:14.240191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:14.240191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:14.240191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:14.240191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:14.240191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:14.240191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:14.240191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:14.240191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:14.240191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:14.240191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 372/728] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:57:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:14.241604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2651acd-bb8c-492f-b750-1bc4c79e90d8 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:14.241892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2651acd-bb8c-492f-b750-1bc4c79e90d8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:14.242157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2651acd-bb8c-492f-b750-1bc4c79e90d8 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:14.248087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 373/729] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:14.248087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2651acd-bb8c-492f-b750-1bc4c79e90d8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:14.303497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256321eb-36ca-413c-9134-afee682564dc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:14.315169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:14.342072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65abd28-8a09-47a4-bf1a-8326dabe498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:14.342698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65abd28-8a09-47a4-bf1a-8326dabe498b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:14.342972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65abd28-8a09-47a4-bf1a-8326dabe498b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:14.343242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65abd28-8a09-47a4-bf1a-8326dabe498b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:14.352529 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:14.356161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65abd28-8a09-47a4-bf1a-8326dabe498b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:14.359016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2651acd-bb8c-492f-b750-1bc4c79e90d8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b65abd28-8a09-47a4-bf1a-8326dabe498b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:14.362176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:14.363166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:14.364038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:14.364038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:14.364038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:14.364038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:14.364038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:14.364038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:14.364038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:14.364038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:14.364038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:14.364038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:14.364038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:14.364038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:14.364038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 357/730] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:57:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:14.365270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65abd28-8a09-47a4-bf1a-8326dabe498b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:14.401903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ef257-cd5a-4ab5-a4ae-de81fba332b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:14.402535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ef257-cd5a-4ab5-a4ae-de81fba332b6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:14.402804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ef257-cd5a-4ab5-a4ae-de81fba332b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:14.403074 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ef257-cd5a-4ab5-a4ae-de81fba332b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:14.413487 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ef257-cd5a-4ab5-a4ae-de81fba332b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:14.414949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ef257-cd5a-4ab5-a4ae-de81fba332b6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-977ef257-cd5a-4ab5-a4ae-de81fba332b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:14.430504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:14.432144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:14.433060 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:14.433060 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:14.433060 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:14.433060 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 374/731] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:14.433765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a82197-1533-445c-a600-5472b7cd89cc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:14.433986 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a82197-1533-445c-a600-5472b7cd89cc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:14.434249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a82197-1533-445c-a600-5472b7cd89cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:14.451419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-74a82197-1533-445c-a600-5472b7cd89cc None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:14.452613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-74a82197-1533-445c-a600-5472b7cd89cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:14.472668 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65abd28-8a09-47a4-bf1a-8326dabe498b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:14.505840 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9dbc4-5c6c-4530-a351-3b4e8ad5b3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:14.506437 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9dbc4-5c6c-4530-a351-3b4e8ad5b3ca None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:14.506712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9dbc4-5c6c-4530-a351-3b4e8ad5b3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:14.506978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9dbc4-5c6c-4530-a351-3b4e8ad5b3ca None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:14.507631 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9dbc4-5c6c-4530-a351-3b4e8ad5b3ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:14.507925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9dbc4-5c6c-4530-a351-3b4e8ad5b3ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:14.509854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9dbc4-5c6c-4530-a351-3b4e8ad5b3ca None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:14.517716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 358/732] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:57:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:14.528195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 375/733] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:14.528372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9dbc4-5c6c-4530-a351-3b4e8ad5b3ca None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:14.528473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1b432-7dbf-4b2f-83df-9e5651b19b63 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:14.528473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1b432-7dbf-4b2f-83df-9e5651b19b63 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:14.528473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1b432-7dbf-4b2f-83df-9e5651b19b63 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:14.528473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 376/734] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:14.528473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1b432-7dbf-4b2f-83df-9e5651b19b63 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:14.562240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:14.626819 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:14.636736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9dbc4-5c6c-4530-a351-3b4e8ad5b3ca None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:14.650133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1b432-7dbf-4b2f-83df-9e5651b19b63 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:14.676676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc27a1-2f92-402a-8cca-59b277ffa35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:14.677446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc27a1-2f92-402a-8cca-59b277ffa35f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:14.677727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc27a1-2f92-402a-8cca-59b277ffa35f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:14.678323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc27a1-2f92-402a-8cca-59b277ffa35f None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:14.679437 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc27a1-2f92-402a-8cca-59b277ffa35f None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:14.679860 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc27a1-2f92-402a-8cca-59b277ffa35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:14.683441 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc27a1-2f92-402a-8cca-59b277ffa35f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:14.689956 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85579e83-ea10-46e7-9396-9a1b32ad021e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:14.690591 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85579e83-ea10-46e7-9396-9a1b32ad021e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:14.691024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85579e83-ea10-46e7-9396-9a1b32ad021e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:14.691383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85579e83-ea10-46e7-9396-9a1b32ad021e None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:14.691941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85579e83-ea10-46e7-9396-9a1b32ad021e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:14.692273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85579e83-ea10-46e7-9396-9a1b32ad021e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:14.698121 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 359/735] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:57:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:14.698121 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc27a1-2f92-402a-8cca-59b277ffa35f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:14.698329 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85579e83-ea10-46e7-9396-9a1b32ad021e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:14.706790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 377/736] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:14.712414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7bd32-c3ef-4084-bd4d-3eb6e2f3762e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:14.712706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7bd32-c3ef-4084-bd4d-3eb6e2f3762e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:14.712983 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7bd32-c3ef-4084-bd4d-3eb6e2f3762e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:14.731072 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e3a7bd32-c3ef-4084-bd4d-3eb6e2f3762e None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:14.732314 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e3a7bd32-c3ef-4084-bd4d-3eb6e2f3762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:14.801096 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:14.804189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 378/737] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:14.804772 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7bd32-c3ef-4084-bd4d-3eb6e2f3762e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:14.811752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc27a1-2f92-402a-8cca-59b277ffa35f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:14.847665 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362856e-30c4-4141-973f-b72e77a27408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:14.848380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362856e-30c4-4141-973f-b72e77a27408 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:14.848661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362856e-30c4-4141-973f-b72e77a27408 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:14.848937 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362856e-30c4-4141-973f-b72e77a27408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:14.860043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362856e-30c4-4141-973f-b72e77a27408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:14.861472 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362856e-30c4-4141-973f-b72e77a27408 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-d362856e-30c4-4141-973f-b72e77a27408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:14.876181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:14.877360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:14.878345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:14.878345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:14.878345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:14.878345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 360/738] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:14.878578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362856e-30c4-4141-973f-b72e77a27408 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:14.881294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:14.914744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7bd32-c3ef-4084-bd4d-3eb6e2f3762e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:14.952111 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2dd90-f3b8-47b2-8cd7-38e6de682448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:14.952663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2dd90-f3b8-47b2-8cd7-38e6de682448 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:14.952936 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2dd90-f3b8-47b2-8cd7-38e6de682448 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:14.953203 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2dd90-f3b8-47b2-8cd7-38e6de682448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:14.967615 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2dd90-f3b8-47b2-8cd7-38e6de682448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:14.969206 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2dd90-f3b8-47b2-8cd7-38e6de682448 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-5ca2dd90-f3b8-47b2-8cd7-38e6de682448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:14.984419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:14.985471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:14.986368 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:14.986368 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:14.986368 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:14.986368 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 379/739] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:14.986607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2dd90-f3b8-47b2-8cd7-38e6de682448 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:15.005102 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362856e-30c4-4141-973f-b72e77a27408 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:15.053354 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67270617-18c8-43ba-bcc2-748b85eb0abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:15.053986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67270617-18c8-43ba-bcc2-748b85eb0abb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:15.054259 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67270617-18c8-43ba-bcc2-748b85eb0abb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:15.054525 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67270617-18c8-43ba-bcc2-748b85eb0abb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:15.063413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67270617-18c8-43ba-bcc2-748b85eb0abb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:15.064881 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67270617-18c8-43ba-bcc2-748b85eb0abb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-67270617-18c8-43ba-bcc2-748b85eb0abb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:15.076320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:15.077369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:15.078307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:15.078307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:15.078307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:15.078307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:15.078307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:15.078307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:15.078307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:15.078307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:15.078307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:57:15.078307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:15.078307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 361/740] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:57:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:15.078307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67270617-18c8-43ba-bcc2-748b85eb0abb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:15.088543 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:15.098301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2dd90-f3b8-47b2-8cd7-38e6de682448 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:15.121585 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:15.134228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab56809-24c7-48d3-9ef6-7bff7eca347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:15.134830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab56809-24c7-48d3-9ef6-7bff7eca347a None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:15.135104 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab56809-24c7-48d3-9ef6-7bff7eca347a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:15.135372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab56809-24c7-48d3-9ef6-7bff7eca347a None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:15.136051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab56809-24c7-48d3-9ef6-7bff7eca347a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:15.137403 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab56809-24c7-48d3-9ef6-7bff7eca347a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:15.153787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 380/741] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Aug 30 04:57:14 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:15.154605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab56809-24c7-48d3-9ef6-7bff7eca347a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:15.194523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67270617-18c8-43ba-bcc2-748b85eb0abb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:15.238747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c03ef-2610-4eea-9dd3-08dfd67d145b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:15.239278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c03ef-2610-4eea-9dd3-08dfd67d145b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:15.239554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c03ef-2610-4eea-9dd3-08dfd67d145b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:15.239822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c03ef-2610-4eea-9dd3-08dfd67d145b None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:15.240508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c03ef-2610-4eea-9dd3-08dfd67d145b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:15.240833 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c03ef-2610-4eea-9dd3-08dfd67d145b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:15.242847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c03ef-2610-4eea-9dd3-08dfd67d145b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:15.262172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 362/742] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:15.262172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c03ef-2610-4eea-9dd3-08dfd67d145b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:15.275447 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab56809-24c7-48d3-9ef6-7bff7eca347a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:15.320425 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef679e-4200-4b44-8822-3948159ffd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:15.321055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef679e-4200-4b44-8822-3948159ffd41 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:15.322338 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef679e-4200-4b44-8822-3948159ffd41 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:15.322338 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef679e-4200-4b44-8822-3948159ffd41 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:15.322814 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef679e-4200-4b44-8822-3948159ffd41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:15.323603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef679e-4200-4b44-8822-3948159ffd41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:15.325054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef679e-4200-4b44-8822-3948159ffd41 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:15.334021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:15.338048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 381/743] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:15.339046 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef679e-4200-4b44-8822-3948159ffd41 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:15.378569 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c03ef-2610-4eea-9dd3-08dfd67d145b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:15.388195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:15.413340 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2236297-a88e-41f3-baed-9f334cebbe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:15.413942 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2236297-a88e-41f3-baed-9f334cebbe95 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:15.414215 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2236297-a88e-41f3-baed-9f334cebbe95 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:15.414485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2236297-a88e-41f3-baed-9f334cebbe95 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:15.415127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2236297-a88e-41f3-baed-9f334cebbe95 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:15.416547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2236297-a88e-41f3-baed-9f334cebbe95 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:15.432579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 363/744] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Aug 30 04:57:15 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:15.433435 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2236297-a88e-41f3-baed-9f334cebbe95 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:15.461886 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef679e-4200-4b44-8822-3948159ffd41 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:15.535456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10086630-ea41-4be1-9003-418cc4d65719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:15.536051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10086630-ea41-4be1-9003-418cc4d65719 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:15.536438 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10086630-ea41-4be1-9003-418cc4d65719 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:15.536713 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10086630-ea41-4be1-9003-418cc4d65719 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:15.537458 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10086630-ea41-4be1-9003-418cc4d65719 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:15.537758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10086630-ea41-4be1-9003-418cc4d65719 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:15.539225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10086630-ea41-4be1-9003-418cc4d65719 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:15.560581 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 382/745] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Aug 30 04:57:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:15.561466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10086630-ea41-4be1-9003-418cc4d65719 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:15.574728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2236297-a88e-41f3-baed-9f334cebbe95 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:15.600247 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:15.618189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ea74e-6aaa-4daa-b3bf-b9584f537bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:15.619422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ea74e-6aaa-4daa-b3bf-b9584f537bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:15.619697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ea74e-6aaa-4daa-b3bf-b9584f537bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:15.619987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ea74e-6aaa-4daa-b3bf-b9584f537bb1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:15.627934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ea74e-6aaa-4daa-b3bf-b9584f537bb1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:15.629759 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ea74e-6aaa-4daa-b3bf-b9584f537bb1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a11ea74e-6aaa-4daa-b3bf-b9584f537bb1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:15.649251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:15.650301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:15.651276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:15.651276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:15.651276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:15.651276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:15.651276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:15.651276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:15.651276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:15.651276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:15.651276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:57:15.651276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:15.654815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 364/746] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Aug 30 04:57:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:15.655837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ea74e-6aaa-4daa-b3bf-b9584f537bb1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:15.676133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:15.683764 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10086630-ea41-4be1-9003-418cc4d65719 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:15.721912 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7af53-1be4-4512-b453-d2194e8c2512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:15.722722 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7af53-1be4-4512-b453-d2194e8c2512 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:15.723112 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7af53-1be4-4512-b453-d2194e8c2512 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:15.723567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7af53-1be4-4512-b453-d2194e8c2512 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:15.731974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7af53-1be4-4512-b453-d2194e8c2512 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:15.733549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7af53-1be4-4512-b453-d2194e8c2512 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7bc7af53-1be4-4512-b453-d2194e8c2512 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:15.746553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:15.747820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:15.749008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:15.749008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:15.749008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:15.749008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:15.749008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:15.749008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:15.749008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:15.749008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:15.749008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:57:15.749008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:15.751133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 383/747] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Aug 30 04:57:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:15.751616 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7af53-1be4-4512-b453-d2194e8c2512 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:15.789470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ea74e-6aaa-4daa-b3bf-b9584f537bb1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:15.830388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba10ed-ee4b-4b4d-960e-06c08485e7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:15.831067 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba10ed-ee4b-4b4d-960e-06c08485e7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:15.831499 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba10ed-ee4b-4b4d-960e-06c08485e7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:15.831847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba10ed-ee4b-4b4d-960e-06c08485e7e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:15.884914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:15.900434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7af53-1be4-4512-b453-d2194e8c2512 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:15.912367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba10ed-ee4b-4b4d-960e-06c08485e7e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:15.914351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba10ed-ee4b-4b4d-960e-06c08485e7e9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:15.938972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161e3cb-7977-43fd-8749-8aad29ca304a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:15.939786 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161e3cb-7977-43fd-8749-8aad29ca304a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:15.940197 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161e3cb-7977-43fd-8749-8aad29ca304a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:15.940567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161e3cb-7977-43fd-8749-8aad29ca304a None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:15.941399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161e3cb-7977-43fd-8749-8aad29ca304a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:15.941801 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161e3cb-7977-43fd-8749-8aad29ca304a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:15.943382 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161e3cb-7977-43fd-8749-8aad29ca304a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:15.962633 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 384/748] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Aug 30 04:57:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:15.963650 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161e3cb-7977-43fd-8749-8aad29ca304a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:15.980245 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:16.047914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 365/749] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:57:16.049069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba10ed-ee4b-4b4d-960e-06c08485e7e9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:16.093098 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161e3cb-7977-43fd-8749-8aad29ca304a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:16.130118 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591834f4-2cf8-4374-bbde-ad60be714b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:16.131149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591834f4-2cf8-4374-bbde-ad60be714b29 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:16.131621 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591834f4-2cf8-4374-bbde-ad60be714b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:16.132114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591834f4-2cf8-4374-bbde-ad60be714b29 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:16.133050 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591834f4-2cf8-4374-bbde-ad60be714b29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:16.133593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591834f4-2cf8-4374-bbde-ad60be714b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:16.135245 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591834f4-2cf8-4374-bbde-ad60be714b29 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:16.135890 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:16.156013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 385/750] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Aug 30 04:57:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:16.157171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591834f4-2cf8-4374-bbde-ad60be714b29 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:16.158542 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba10ed-ee4b-4b4d-960e-06c08485e7e9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:16.196456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ceb85c-7822-43f0-9348-fdfce52c2ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:16.196850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ceb85c-7822-43f0-9348-fdfce52c2ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:16.197128 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ceb85c-7822-43f0-9348-fdfce52c2ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:16.197400 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ceb85c-7822-43f0-9348-fdfce52c2ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:16.208207 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ceb85c-7822-43f0-9348-fdfce52c2ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:16.209965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ceb85c-7822-43f0-9348-fdfce52c2ab0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-34ceb85c-7822-43f0-9348-fdfce52c2ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:16.226130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:16.227123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:16.228624 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:16.228624 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:16.228624 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:16.228624 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 366/751] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:16.229296 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ceb85c-7822-43f0-9348-fdfce52c2ab0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:16.238694 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:16.271829 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591834f4-2cf8-4374-bbde-ad60be714b29 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:16.311186 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c070e-41c0-41ca-8ac2-a66abd620fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:16.312732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c070e-41c0-41ca-8ac2-a66abd620fee None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:16.313249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c070e-41c0-41ca-8ac2-a66abd620fee None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:16.313714 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c070e-41c0-41ca-8ac2-a66abd620fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:16.325461 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c070e-41c0-41ca-8ac2-a66abd620fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:16.327202 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c070e-41c0-41ca-8ac2-a66abd620fee None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:16.340529 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ceb85c-7822-43f0-9348-fdfce52c2ab0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-252c070e-41c0-41ca-8ac2-a66abd620fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:16.343391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:16.344430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:16.345353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:16.345353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:16.345353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:16.347449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 386/752] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:16.348492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c070e-41c0-41ca-8ac2-a66abd620fee None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:16.378146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9573a1-b7fd-478b-bfde-85f14d998f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:16.379113 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9573a1-b7fd-478b-bfde-85f14d998f2d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:16.379345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9573a1-b7fd-478b-bfde-85f14d998f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:16.379626 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9573a1-b7fd-478b-bfde-85f14d998f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:16.382312 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:16.453549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9573a1-b7fd-478b-bfde-85f14d998f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:16.455224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9573a1-b7fd-478b-bfde-85f14d998f2d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:16.457237 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c070e-41c0-41ca-8ac2-a66abd620fee None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:16.482387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:16.495236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b12ad-9704-4cb6-868f-89d7406cc092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:16.496230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b12ad-9704-4cb6-868f-89d7406cc092 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:16.496704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b12ad-9704-4cb6-868f-89d7406cc092 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:16.497177 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b12ad-9704-4cb6-868f-89d7406cc092 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:16.497995 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b12ad-9704-4cb6-868f-89d7406cc092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:16.498494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b12ad-9704-4cb6-868f-89d7406cc092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:16.500079 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b12ad-9704-4cb6-868f-89d7406cc092 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:16.513608 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 387/753] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:16.514829 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b12ad-9704-4cb6-868f-89d7406cc092 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:16.563510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 367/754] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:57:16.564424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9573a1-b7fd-478b-bfde-85f14d998f2d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:16.601545 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:16.627281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b12ad-9704-4cb6-868f-89d7406cc092 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:16.664653 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350615f-a16a-4398-b202-ca2106abfe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:16.665938 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350615f-a16a-4398-b202-ca2106abfe77 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:16.666349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350615f-a16a-4398-b202-ca2106abfe77 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:16.666808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350615f-a16a-4398-b202-ca2106abfe77 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:16.667470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350615f-a16a-4398-b202-ca2106abfe77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:16.667975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350615f-a16a-4398-b202-ca2106abfe77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:16.669359 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350615f-a16a-4398-b202-ca2106abfe77 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:16.677454 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9573a1-b7fd-478b-bfde-85f14d998f2d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:16.686126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 388/755] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:16.686126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350615f-a16a-4398-b202-ca2106abfe77 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:16.721500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf7dea-3da5-4656-906b-37bcf88b2c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:16.722188 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf7dea-3da5-4656-906b-37bcf88b2c83 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:16.722476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf7dea-3da5-4656-906b-37bcf88b2c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:16.722751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf7dea-3da5-4656-906b-37bcf88b2c83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:16.730224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf7dea-3da5-4656-906b-37bcf88b2c83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:16.731708 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf7dea-3da5-4656-906b-37bcf88b2c83 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:16.744253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-eacf7dea-3da5-4656-906b-37bcf88b2c83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:16.744253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:16.744253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:16.744253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:16.744253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:16.744253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:16.744253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:16.744253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:16.744253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:16.744253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:16.744253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:16.744253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:16.744253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:16.744253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:16.744253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:16.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:16.746587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:16.746587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:16.746587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:16.746587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:16.746587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:16.746587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:16.746587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:16.746587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:16.746587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 368/756] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:16.746587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf7dea-3da5-4656-906b-37bcf88b2c83 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:16.747143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:16.815006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350615f-a16a-4398-b202-ca2106abfe77 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:16.853085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:16.856296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f0cae-63e8-4157-bf57-959b21b6d4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:16.857719 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f0cae-63e8-4157-bf57-959b21b6d4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:16.858468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f0cae-63e8-4157-bf57-959b21b6d4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:16.858942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f0cae-63e8-4157-bf57-959b21b6d4f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:16.860454 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf7dea-3da5-4656-906b-37bcf88b2c83 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:16.872666 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f0cae-63e8-4157-bf57-959b21b6d4f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:16.874191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f0cae-63e8-4157-bf57-959b21b6d4f8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-af7f0cae-63e8-4157-bf57-959b21b6d4f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:16.890937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:16.891975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:16.893380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:16.893380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:16.893380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:16.893380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 389/757] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:16.894236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f0cae-63e8-4157-bf57-959b21b6d4f8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:16.910422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc372f9-f8ed-45c3-a9e6-b91371fb76d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:16.911495 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc372f9-f8ed-45c3-a9e6-b91371fb76d2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:16.912386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc372f9-f8ed-45c3-a9e6-b91371fb76d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:16.912899 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc372f9-f8ed-45c3-a9e6-b91371fb76d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:16.922484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc372f9-f8ed-45c3-a9e6-b91371fb76d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:16.924997 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc372f9-f8ed-45c3-a9e6-b91371fb76d2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:16.940476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-7dc372f9-f8ed-45c3-a9e6-b91371fb76d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:16.940476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:16.940476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:16.940476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:16.940476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:16.940476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:16.940476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:16.940476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:16.940476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:16.940476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:16.940476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:16.940476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:16.940476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:16.940476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:16.940476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:16.941603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:16.942747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:16.942747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:16.942747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:16.942747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:16.942747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:16.942747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:16.942747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:16.942747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:16.945468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 369/758] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:16.946455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc372f9-f8ed-45c3-a9e6-b91371fb76d2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:17.016723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:17.026670 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f0cae-63e8-4157-bf57-959b21b6d4f8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:17.076068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc372f9-f8ed-45c3-a9e6-b91371fb76d2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:17.079519 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb746c-1caf-46a1-abf1-7db6e4b6dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:17.080449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb746c-1caf-46a1-abf1-7db6e4b6dee1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:17.080948 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb746c-1caf-46a1-abf1-7db6e4b6dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:17.081421 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb746c-1caf-46a1-abf1-7db6e4b6dee1 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:17.082318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb746c-1caf-46a1-abf1-7db6e4b6dee1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:17.082834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb746c-1caf-46a1-abf1-7db6e4b6dee1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:17.085008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb746c-1caf-46a1-abf1-7db6e4b6dee1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:17.103628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 390/759] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:17.104977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb746c-1caf-46a1-abf1-7db6e4b6dee1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:17.119384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39852ade-82e7-4c1a-9346-2d67bf2342fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:17.120032 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39852ade-82e7-4c1a-9346-2d67bf2342fc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:17.120361 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39852ade-82e7-4c1a-9346-2d67bf2342fc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:17.120629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39852ade-82e7-4c1a-9346-2d67bf2342fc None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:17.121339 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39852ade-82e7-4c1a-9346-2d67bf2342fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:17.121944 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39852ade-82e7-4c1a-9346-2d67bf2342fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:17.123135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39852ade-82e7-4c1a-9346-2d67bf2342fc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:17.137105 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 370/760] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:17.138153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39852ade-82e7-4c1a-9346-2d67bf2342fc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:17.157112 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:17.224508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb746c-1caf-46a1-abf1-7db6e4b6dee1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:17.249945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39852ade-82e7-4c1a-9346-2d67bf2342fc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:17.260021 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca048128-5b86-4ccf-935b-f3567d0073d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:17.260629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca048128-5b86-4ccf-935b-f3567d0073d3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:17.261195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca048128-5b86-4ccf-935b-f3567d0073d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:17.261195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca048128-5b86-4ccf-935b-f3567d0073d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:17.261846 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca048128-5b86-4ccf-935b-f3567d0073d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:17.262145 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca048128-5b86-4ccf-935b-f3567d0073d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:17.263549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca048128-5b86-4ccf-935b-f3567d0073d3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:17.276723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 391/761] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:17.277572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca048128-5b86-4ccf-935b-f3567d0073d3 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:17.292856 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a559a-f8b2-4753-a83e-5141a1397f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:17.293570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a559a-f8b2-4753-a83e-5141a1397f26 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:17.293857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a559a-f8b2-4753-a83e-5141a1397f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:17.294132 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a559a-f8b2-4753-a83e-5141a1397f26 None admin] PATH_INFO: `/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/1aa002909502426b80c97dbf05dca008/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:17.296085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a559a-f8b2-4753-a83e-5141a1397f26 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8aae17def04cf48190ede4bffefe70, user_id=1aa002909502426b80c97dbf05dca008, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:17.297044 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:17.297822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a559a-f8b2-4753-a83e-5141a1397f26 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:17.314497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 371/762] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:57:17 2022] PUT /identity/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/1aa002909502426b80c97dbf05dca008/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:17.316000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f168811-a289-4630-abc4-9f50096923a3 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:17.316290 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f168811-a289-4630-abc4-9f50096923a3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:17.317520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f168811-a289-4630-abc4-9f50096923a3 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:17.319032 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 372/763] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:17.325214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f168811-a289-4630-abc4-9f50096923a3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:17.403891 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca048128-5b86-4ccf-935b-f3567d0073d3 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:17.436603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:17.446691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f0295-c3a1-49f7-b2e9-0baebb37b054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:17.447333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f0295-c3a1-49f7-b2e9-0baebb37b054 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:17.447611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f0295-c3a1-49f7-b2e9-0baebb37b054 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:17.447883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f0295-c3a1-49f7-b2e9-0baebb37b054 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:17.455387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f0295-c3a1-49f7-b2e9-0baebb37b054 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:17.457012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f0295-c3a1-49f7-b2e9-0baebb37b054 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:17.470610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4b6f0295-c3a1-49f7-b2e9-0baebb37b054 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:17.470610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:17.470610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:17.470610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:17.470610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:17.470610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:17.470610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:17.470610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:17.470610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:17.470610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:17.470610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:17.470610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:17.470610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:17.470610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:17.470610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:17.471568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:17.472893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:17.472893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:17.472893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:17.472893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:17.472893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:17.472893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:17.472893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:17.472893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:17.473533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f168811-a289-4630-abc4-9f50096923a3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:17.473613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 392/764] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:17.473613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea5b4d-3853-4782-add9-fb05c4f8e6dd None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:17.473613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea5b4d-3853-4782-add9-fb05c4f8e6dd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:17.473613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea5b4d-3853-4782-add9-fb05c4f8e6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:17.494606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ebea5b4d-3853-4782-add9-fb05c4f8e6dd None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:17.495810 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ebea5b4d-3853-4782-add9-fb05c4f8e6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:17.516009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2d4de-e980-4264-b390-850aa7821534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:17.516644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2d4de-e980-4264-b390-850aa7821534 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:17.516934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2d4de-e980-4264-b390-850aa7821534 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:17.517201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2d4de-e980-4264-b390-850aa7821534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:17.517932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2d4de-e980-4264-b390-850aa7821534 None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=a96ac878c106422ebf438a64ca618747) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:17.518233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2d4de-e980-4264-b390-850aa7821534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:17.519663 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2d4de-e980-4264-b390-850aa7821534 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:17.526313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 373/765] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:57:17 2022] GET /identity/v3/role_assignments?user.id=a96ac878c106422ebf438a64ca618747&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:17.529454 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92eb9b-76e1-4b45-b655-974e233d3fb5 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:17.530430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92eb9b-76e1-4b45-b655-974e233d3fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:17.531192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92eb9b-76e1-4b45-b655-974e233d3fb5 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:17.533306 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 374/766] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:17.534391 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92eb9b-76e1-4b45-b655-974e233d3fb5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:17.583409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 393/767] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:17.584880 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60776138-ecde-4d04-91a8-c748d7a78741 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:17.585236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60776138-ecde-4d04-91a8-c748d7a78741 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:17.585567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60776138-ecde-4d04-91a8-c748d7a78741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:17.601352 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:17.613909 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-60776138-ecde-4d04-91a8-c748d7a78741 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:17.616396 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-60776138-ecde-4d04-91a8-c748d7a78741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:17.725600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92eb9b-76e1-4b45-b655-974e233d3fb5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:17.755301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 394/768] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:17.765206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c965c-9532-46d7-8f9a-4ec122f8d4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:17.765884 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c965c-9532-46d7-8f9a-4ec122f8d4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:17.766157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c965c-9532-46d7-8f9a-4ec122f8d4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:17.766427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c965c-9532-46d7-8f9a-4ec122f8d4d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:17.767311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c965c-9532-46d7-8f9a-4ec122f8d4d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:17.767682 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c965c-9532-46d7-8f9a-4ec122f8d4d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:17.769191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c965c-9532-46d7-8f9a-4ec122f8d4d8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:17.784477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:17.801600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 375/769] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:17.807889 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60776138-ecde-4d04-91a8-c748d7a78741 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:17.952216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60776138-ecde-4d04-91a8-c748d7a78741 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:17.991924 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f357d6-0ddf-4b32-80a6-58b3b2017a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:17.992854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f357d6-0ddf-4b32-80a6-58b3b2017a43 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:17.993386 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f357d6-0ddf-4b32-80a6-58b3b2017a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:17.994388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f357d6-0ddf-4b32-80a6-58b3b2017a43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:17.995419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f357d6-0ddf-4b32-80a6-58b3b2017a43 None admin] RBAC: Adding query filter params (role.id=2381dab0bb194ddfaf31c2933c683b71, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=487fc3d8ac924be0a1d66ae8ca49f76c) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:17.995936 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f357d6-0ddf-4b32-80a6-58b3b2017a43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:17.997639 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f357d6-0ddf-4b32-80a6-58b3b2017a43 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:18.001127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:18.005444 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 395/770] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:57:17 2022] GET /identity/v3/role_assignments?user.id=487fc3d8ac924be0a1d66ae8ca49f76c&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=2381dab0bb194ddfaf31c2933c683b71 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:18.076100 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c965c-9532-46d7-8f9a-4ec122f8d4d8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:18.194908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f357d6-0ddf-4b32-80a6-58b3b2017a43 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:18.201220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c965c-9532-46d7-8f9a-4ec122f8d4d8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:18.248865 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a214a-e73f-43e3-95a7-92825a6651ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:18.249421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a214a-e73f-43e3-95a7-92825a6651ff None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:18.249697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a214a-e73f-43e3-95a7-92825a6651ff None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:18.249967 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a214a-e73f-43e3-95a7-92825a6651ff None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:18.250555 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a214a-e73f-43e3-95a7-92825a6651ff None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:18.255042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a214a-e73f-43e3-95a7-92825a6651ff None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-559a214a-e73f-43e3-95a7-92825a6651ff None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:18.269089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:18.270124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:18.270963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:18.270963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:18.270963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:18.270963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:18.270963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:18.270963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:18.270963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:18.270963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:18.270963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:18.270963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:18.270963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:18.270963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:18.270963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:57:18.270963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:18.271708 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 376/771] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Aug 30 04:57:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:18.279638 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a214a-e73f-43e3-95a7-92825a6651ff None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:18.413486 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f357d6-0ddf-4b32-80a6-58b3b2017a43 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:18.428581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:18.503139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8ecf6-28b7-4cae-b7cf-232894f9f987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:18.504345 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8ecf6-28b7-4cae-b7cf-232894f9f987 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:18.504778 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8ecf6-28b7-4cae-b7cf-232894f9f987 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:18.505121 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8ecf6-28b7-4cae-b7cf-232894f9f987 None admin] PATH_INFO: `/v3/services/network` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:18.506101 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8ecf6-28b7-4cae-b7cf-232894f9f987 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:18.509774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8ecf6-28b7-4cae-b7cf-232894f9f987 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:18.521066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a214a-e73f-43e3-95a7-92825a6651ff None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-0fe8ecf6-28b7-4cae-b7cf-232894f9f987 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:18.523613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:18.525169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:18.526010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:18.526010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:18.526010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:18.526010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:18.526010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:18.526010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:18.526010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:18.526010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:18.526010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:18.526010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:18.526010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:18.526010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:18.526010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:57:18.526010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:18.529895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 396/772] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:18 2022] GET /identity/v3/services/network => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:18.531139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8ecf6-28b7-4cae-b7cf-232894f9f987 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:18.562353 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8ee7f-3749-4050-89db-7369c987cbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:18.562968 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8ee7f-3749-4050-89db-7369c987cbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:18.563246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8ee7f-3749-4050-89db-7369c987cbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:18.563517 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8ee7f-3749-4050-89db-7369c987cbf8 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:18.564173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8ee7f-3749-4050-89db-7369c987cbf8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:18.564467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8ee7f-3749-4050-89db-7369c987cbf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:18.565834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8ee7f-3749-4050-89db-7369c987cbf8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:18.574536 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 377/773] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Aug 30 04:57:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:18.578758 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8ee7f-3749-4050-89db-7369c987cbf8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:18.686042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8ee7f-3749-4050-89db-7369c987cbf8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:18.719745 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:18.724187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da43213-1601-4cf3-8372-73f56dae145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:18.724804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da43213-1601-4cf3-8372-73f56dae145d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:18.725118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da43213-1601-4cf3-8372-73f56dae145d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:18.725388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da43213-1601-4cf3-8372-73f56dae145d None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:18.726017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da43213-1601-4cf3-8372-73f56dae145d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:18.726317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da43213-1601-4cf3-8372-73f56dae145d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:18.728227 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da43213-1601-4cf3-8372-73f56dae145d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:18.734495 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 378/774] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Aug 30 04:57:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:18.739773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:18.741345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da43213-1601-4cf3-8372-73f56dae145d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:18.814038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8ecf6-28b7-4cae-b7cf-232894f9f987 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:18.850898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6ded1-841e-4bca-b567-ccceaceee230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:18.851511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6ded1-841e-4bca-b567-ccceaceee230 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:18.851791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6ded1-841e-4bca-b567-ccceaceee230 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:18.852109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6ded1-841e-4bca-b567-ccceaceee230 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:18.852779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6ded1-841e-4bca-b567-ccceaceee230 None admin] RBAC: Adding query filter params (name=network) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:18.853084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6ded1-841e-4bca-b567-ccceaceee230 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:18.854474 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6ded1-841e-4bca-b567-ccceaceee230 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:18.859855 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da43213-1601-4cf3-8372-73f56dae145d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:18.860078 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 397/775] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Aug 30 04:57:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:18.865133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6ded1-841e-4bca-b567-ccceaceee230 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:18.940771 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cda840-ea8d-4fbb-ad5d-18bec59946ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:18.941762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cda840-ea8d-4fbb-ad5d-18bec59946ec None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:18.942217 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cda840-ea8d-4fbb-ad5d-18bec59946ec None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:18.942672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cda840-ea8d-4fbb-ad5d-18bec59946ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:18.943608 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cda840-ea8d-4fbb-ad5d-18bec59946ec None admin] RBAC: Adding query filter params (interface=public, service_id=834002396bf84388b54740dcffd2f7f5, region_id=RegionOne) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:18.944124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cda840-ea8d-4fbb-ad5d-18bec59946ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:18.945719 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cda840-ea8d-4fbb-ad5d-18bec59946ec None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:18.966123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 379/776] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Aug 30 04:57:18 2022] GET /identity/v3/endpoints?service_id=834002396bf84388b54740dcffd2f7f5&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:18.971383 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cda840-ea8d-4fbb-ad5d-18bec59946ec None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:18.975125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6ded1-841e-4bca-b567-ccceaceee230 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:19.012316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:19.020532 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2770d-7682-479c-85c5-752deea37f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:19.021690 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2770d-7682-479c-85c5-752deea37f09 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:19.022063 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2770d-7682-479c-85c5-752deea37f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:19.022428 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2770d-7682-479c-85c5-752deea37f09 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:19.023157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2770d-7682-479c-85c5-752deea37f09 None admin] RBAC: Adding query filter params (type=network) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:19.023612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2770d-7682-479c-85c5-752deea37f09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:19.025750 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2770d-7682-479c-85c5-752deea37f09 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:19.031878 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 398/777] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Aug 30 04:57:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:19.040429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2770d-7682-479c-85c5-752deea37f09 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:19.101284 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:19.154637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2770d-7682-479c-85c5-752deea37f09 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:19.204655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cda840-ea8d-4fbb-ad5d-18bec59946ec None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:19.231013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f23a5d-bcd1-410c-bfad-e70581cbde50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:19.233139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f23a5d-bcd1-410c-bfad-e70581cbde50 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:19.233622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f23a5d-bcd1-410c-bfad-e70581cbde50 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:19.234904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f23a5d-bcd1-410c-bfad-e70581cbde50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:19.235823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f23a5d-bcd1-410c-bfad-e70581cbde50 None admin] RBAC: Adding query filter params (interface=public, service_id=6457b439e02342408a03c7c0e985d454, region_id=RegionOne) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:19.236507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f23a5d-bcd1-410c-bfad-e70581cbde50 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:19.239430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f23a5d-bcd1-410c-bfad-e70581cbde50 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:19.255208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 399/778] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Aug 30 04:57:19 2022] GET /identity/v3/endpoints?service_id=6457b439e02342408a03c7c0e985d454&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:19.263296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f23a5d-bcd1-410c-bfad-e70581cbde50 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:19.282081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862b205-16f2-4dc5-9fae-f8876debf143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:19.282676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862b205-16f2-4dc5-9fae-f8876debf143 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:19.282952 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862b205-16f2-4dc5-9fae-f8876debf143 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:19.283220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862b205-16f2-4dc5-9fae-f8876debf143 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:19.283831 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862b205-16f2-4dc5-9fae-f8876debf143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:19.285417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862b205-16f2-4dc5-9fae-f8876debf143 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:19.302856 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 380/779] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Aug 30 04:57:18 2022] GET /identity/v3/services => generated 772 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:19.328473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:19.381904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f23a5d-bcd1-410c-bfad-e70581cbde50 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:19.421405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf16e7-0701-4885-9d57-37cd8aa37805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:19.422923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf16e7-0701-4885-9d57-37cd8aa37805 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:19.423402 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf16e7-0701-4885-9d57-37cd8aa37805 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:19.423880 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf16e7-0701-4885-9d57-37cd8aa37805 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:19.424792 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf16e7-0701-4885-9d57-37cd8aa37805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:19.426434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf16e7-0701-4885-9d57-37cd8aa37805 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:19.433684 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 400/780] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Aug 30 04:57:19 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:19.598863 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031a254-1827-45e0-b02f-b768cb4059ab None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:19.599621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031a254-1827-45e0-b02f-b768cb4059ab None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:19.599621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031a254-1827-45e0-b02f-b768cb4059ab None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:19.600949 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 381/781] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:19.607422 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dbd9f-5c5a-4431-af34-5edc92e125e2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:19.608083 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dbd9f-5c5a-4431-af34-5edc92e125e2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:19.608562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dbd9f-5c5a-4431-af34-5edc92e125e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:19.630599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-762dbd9f-5c5a-4431-af34-5edc92e125e2 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:19.632281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-762dbd9f-5c5a-4431-af34-5edc92e125e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:19.728268 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 401/782] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:19.990109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8d84d-de4a-49b3-90da-6586cd952419 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:19.990794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8d84d-de4a-49b3-90da-6586cd952419 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:19.991272 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8d84d-de4a-49b3-90da-6586cd952419 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:19.992895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 382/783] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:19.998556 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f381cb2-05a1-4f9f-a079-97a5ba5b02c3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:19.999252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f381cb2-05a1-4f9f-a079-97a5ba5b02c3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:19.999772 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f381cb2-05a1-4f9f-a079-97a5ba5b02c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:20.024328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7f381cb2-05a1-4f9f-a079-97a5ba5b02c3 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:20.026409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7f381cb2-05a1-4f9f-a079-97a5ba5b02c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:20.059483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8d84d-de4a-49b3-90da-6586cd952419 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:20.096621 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:20.121752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 402/784] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:20.252941 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8d84d-de4a-49b3-90da-6586cd952419 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:20.281318 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:20.285817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c67295-2657-4aef-ac27-0f5e24f0f1a5 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:20.286124 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c67295-2657-4aef-ac27-0f5e24f0f1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:20.286527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c67295-2657-4aef-ac27-0f5e24f0f1a5 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:20.288812 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 403/785] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:20.295131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbe3f5-b013-4426-ac10-efbf2ff9951c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:20.295412 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbe3f5-b013-4426-ac10-efbf2ff9951c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:20.295678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbe3f5-b013-4426-ac10-efbf2ff9951c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:20.314818 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05eeabe-99df-493b-9992-7fb8599c0496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:20.315035 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ddbbe3f5-b013-4426-ac10-efbf2ff9951c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:20.315466 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eeabe-99df-493b-9992-7fb8599c0496 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:20.315743 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eeabe-99df-493b-9992-7fb8599c0496 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:20.316034 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eeabe-99df-493b-9992-7fb8599c0496 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:20.316151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ddbbe3f5-b013-4426-ac10-efbf2ff9951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:20.340165 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05eeabe-99df-493b-9992-7fb8599c0496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e05eeabe-99df-493b-9992-7fb8599c0496 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:20.345118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:20.346098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:20.346975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:20.346975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:20.346975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:20.346975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:20.346975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:20.346975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:20.346975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:20.346975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:20.346975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:20.346975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:20.346975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:20.346975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:20.346975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 383/786] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:57:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:20.353444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05eeabe-99df-493b-9992-7fb8599c0496 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:20.432729 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 404/787] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:20.534971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbe3f5-b013-4426-ac10-efbf2ff9951c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:20.550674 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05eeabe-99df-493b-9992-7fb8599c0496 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:20.610718 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e3d5f-97bb-498e-b1de-6a1ffbe0174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:20.611362 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e3d5f-97bb-498e-b1de-6a1ffbe0174e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:20.611610 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e3d5f-97bb-498e-b1de-6a1ffbe0174e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:20.611846 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e3d5f-97bb-498e-b1de-6a1ffbe0174e None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:20.617893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e3d5f-97bb-498e-b1de-6a1ffbe0174e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:20.617893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e3d5f-97bb-498e-b1de-6a1ffbe0174e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:20.617893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e3d5f-97bb-498e-b1de-6a1ffbe0174e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:20.623618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 384/788] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:57:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:20.633336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e3d5f-97bb-498e-b1de-6a1ffbe0174e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:20.676346 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbe3f5-b013-4426-ac10-efbf2ff9951c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:20.690657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:20.733050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:20.740709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bcc42-62e6-48ff-beea-eb1f817ed612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:20.741366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bcc42-62e6-48ff-beea-eb1f817ed612 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:20.741645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bcc42-62e6-48ff-beea-eb1f817ed612 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:20.741917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bcc42-62e6-48ff-beea-eb1f817ed612 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:20.753407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bcc42-62e6-48ff-beea-eb1f817ed612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-8e9bcc42-62e6-48ff-beea-eb1f817ed612 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:20.764016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:20.765027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:20.765871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:20.765871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:20.765871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:20.765871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:20.765871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:20.765871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:20.765871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:20.765871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:20.765871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:20.765871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:20.765871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:20.765871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:20.765871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 405/789] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:57:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:20.765871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bcc42-62e6-48ff-beea-eb1f817ed612 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:20.785178 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e3d5f-97bb-498e-b1de-6a1ffbe0174e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:20.823250 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5123b-878d-44a6-a973-eedb3823b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:20.823968 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5123b-878d-44a6-a973-eedb3823b09d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:20.824264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5123b-878d-44a6-a973-eedb3823b09d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:20.824530 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5123b-878d-44a6-a973-eedb3823b09d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:20.836477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5123b-878d-44a6-a973-eedb3823b09d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:20.838644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5123b-878d-44a6-a973-eedb3823b09d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-70d5123b-878d-44a6-a973-eedb3823b09d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:20.853623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:20.854613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:20.855489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:20.855489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:20.855489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:20.855489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 385/790] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:20.856031 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5123b-878d-44a6-a973-eedb3823b09d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:20.900086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bcc42-62e6-48ff-beea-eb1f817ed612 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:20.936666 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ee399-5a11-4424-88e6-24b2dfa6233f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:20.937584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ee399-5a11-4424-88e6-24b2dfa6233f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:20.937856 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ee399-5a11-4424-88e6-24b2dfa6233f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:20.938130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ee399-5a11-4424-88e6-24b2dfa6233f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:20.949259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ee399-5a11-4424-88e6-24b2dfa6233f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-570ee399-5a11-4424-88e6-24b2dfa6233f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:20.954089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:20.955108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:20.956020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:20.956020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:20.956020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:20.956020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:20.956020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:20.956020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:20.956020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:20.956020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:20.956020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:20.956020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:20.956020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:20.956020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:20.960085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 406/791] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:57:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:20.960938 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ee399-5a11-4424-88e6-24b2dfa6233f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:20.973397 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:20.991692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5123b-878d-44a6-a973-eedb3823b09d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:21.005234 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:21.029822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15398256-ce30-4e6a-9763-8cbe1e7a4bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:21.030422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15398256-ce30-4e6a-9763-8cbe1e7a4bbc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:21.030696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15398256-ce30-4e6a-9763-8cbe1e7a4bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:21.030964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15398256-ce30-4e6a-9763-8cbe1e7a4bbc None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:21.031621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15398256-ce30-4e6a-9763-8cbe1e7a4bbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:21.031925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15398256-ce30-4e6a-9763-8cbe1e7a4bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:21.033314 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15398256-ce30-4e6a-9763-8cbe1e7a4bbc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:21.045942 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 386/792] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:57:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:21.046456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15398256-ce30-4e6a-9763-8cbe1e7a4bbc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:21.104511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ee399-5a11-4424-88e6-24b2dfa6233f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:21.152545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c43b5c-2953-40cc-9fd2-2808dc722c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:21.154053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c43b5c-2953-40cc-9fd2-2808dc722c92 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:21.154523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c43b5c-2953-40cc-9fd2-2808dc722c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:21.155219 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c43b5c-2953-40cc-9fd2-2808dc722c92 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:21.156319 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c43b5c-2953-40cc-9fd2-2808dc722c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:21.156841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c43b5c-2953-40cc-9fd2-2808dc722c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:21.159056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c43b5c-2953-40cc-9fd2-2808dc722c92 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:21.160050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15398256-ce30-4e6a-9763-8cbe1e7a4bbc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:21.176685 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 407/793] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:21.178076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c43b5c-2953-40cc-9fd2-2808dc722c92 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:21.205353 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2cba4-dcab-4212-8906-b40b96188370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:21.206093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2cba4-dcab-4212-8906-b40b96188370 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:21.206436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2cba4-dcab-4212-8906-b40b96188370 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:21.206771 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2cba4-dcab-4212-8906-b40b96188370 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:21.207550 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2cba4-dcab-4212-8906-b40b96188370 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:21.207918 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2cba4-dcab-4212-8906-b40b96188370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:21.209442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2cba4-dcab-4212-8906-b40b96188370 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:21.225362 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 387/794] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:57:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:21.225362 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2cba4-dcab-4212-8906-b40b96188370 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:21.249862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:21.294882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:21.312422 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c43b5c-2953-40cc-9fd2-2808dc722c92 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:21.356982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2cba4-dcab-4212-8906-b40b96188370 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:21.362215 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf653e-e6e2-49f7-a0b4-8311eaa29d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:21.363092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf653e-e6e2-49f7-a0b4-8311eaa29d91 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:21.363578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf653e-e6e2-49f7-a0b4-8311eaa29d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:21.364108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf653e-e6e2-49f7-a0b4-8311eaa29d91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:21.379989 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf653e-e6e2-49f7-a0b4-8311eaa29d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:21.382544 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf653e-e6e2-49f7-a0b4-8311eaa29d91 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:21.401456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76315a-e425-4333-91dd-014238e839ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-0daf653e-e6e2-49f7-a0b4-8311eaa29d91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:21.402307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:21.403227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:21.404239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:21.404239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:21.404239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:21.404239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 408/795] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:21.404753 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76315a-e425-4333-91dd-014238e839ef None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:21.405216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf653e-e6e2-49f7-a0b4-8311eaa29d91 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:21.405395 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76315a-e425-4333-91dd-014238e839ef None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:21.405833 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76315a-e425-4333-91dd-014238e839ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:21.416439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76315a-e425-4333-91dd-014238e839ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:21.418638 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76315a-e425-4333-91dd-014238e839ef None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-3f76315a-e425-4333-91dd-014238e839ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:21.435837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:21.436853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:21.437815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:21.437815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:21.437815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:21.437815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:21.437815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:21.437815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:21.437815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:21.437815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:21.437815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:57:21.437815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:21.440669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 388/796] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Aug 30 04:57:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:21.441640 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76315a-e425-4333-91dd-014238e839ef None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:21.533055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:21.540247 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf653e-e6e2-49f7-a0b4-8311eaa29d91 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:21.563578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76315a-e425-4333-91dd-014238e839ef None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:21.587100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc86c4-4d27-4d3c-afd4-ae2a347979b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:21.588380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc86c4-4d27-4d3c-afd4-ae2a347979b3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:21.589273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc86c4-4d27-4d3c-afd4-ae2a347979b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:21.589942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc86c4-4d27-4d3c-afd4-ae2a347979b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:21.600613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fc1b0-3164-4480-a818-c02ff6897cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:21.601448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fc1b0-3164-4480-a818-c02ff6897cba None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:21.602069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fc1b0-3164-4480-a818-c02ff6897cba None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:21.602069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fc1b0-3164-4480-a818-c02ff6897cba None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:21.603316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fc1b0-3164-4480-a818-c02ff6897cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:21.603682 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fc1b0-3164-4480-a818-c02ff6897cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:21.605162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fc1b0-3164-4480-a818-c02ff6897cba None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:21.605466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc86c4-4d27-4d3c-afd4-ae2a347979b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:21.607385 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc86c4-4d27-4d3c-afd4-ae2a347979b3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:21.614078 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:21.620114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 389/797] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:21.621117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fc1b0-3164-4480-a818-c02ff6897cba None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-67dc86c4-4d27-4d3c-afd4-ae2a347979b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:21.632390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:21.633389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:21.634334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:21.634334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:21.634334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:21.641418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 409/798] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:21.641418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc86c4-4d27-4d3c-afd4-ae2a347979b3 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:21.758181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fc1b0-3164-4480-a818-c02ff6897cba None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:21.758852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc86c4-4d27-4d3c-afd4-ae2a347979b3 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:21.794995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb85f3-249e-4061-a1c8-edcec0fcbd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:21.795598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb85f3-249e-4061-a1c8-edcec0fcbd55 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:21.795876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb85f3-249e-4061-a1c8-edcec0fcbd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:21.796167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb85f3-249e-4061-a1c8-edcec0fcbd55 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:21.796906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb85f3-249e-4061-a1c8-edcec0fcbd55 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:21.797193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb85f3-249e-4061-a1c8-edcec0fcbd55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:21.798614 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb85f3-249e-4061-a1c8-edcec0fcbd55 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:21.799114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76ead2-cd56-435d-94ab-27d04b73e5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:21.799756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76ead2-cd56-435d-94ab-27d04b73e5ee None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:21.800067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76ead2-cd56-435d-94ab-27d04b73e5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:21.800339 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76ead2-cd56-435d-94ab-27d04b73e5ee None admin] PATH_INFO: `/v3/users/swift` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:21.803452 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:21.810460 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76ead2-cd56-435d-94ab-27d04b73e5ee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:21.811919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76ead2-cd56-435d-94ab-27d04b73e5ee None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:21.820105 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 390/799] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Aug 30 04:57:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:21.820870 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb85f3-249e-4061-a1c8-edcec0fcbd55 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-8f76ead2-cd56-435d-94ab-27d04b73e5ee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:21.823244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:21.824191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:21.825157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:21.825157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:21.825157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:21.825157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:21.825157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:21.825157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:21.825157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:21.825157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:21.825157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:57:21.825157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:21.825157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 410/800] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:57:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:21.825763 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8ffb2-5acb-42fe-8d2a-354ef56f2520 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:21.825763 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8ffb2-5acb-42fe-8d2a-354ef56f2520 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:21.826124 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8ffb2-5acb-42fe-8d2a-354ef56f2520 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:21.827298 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 411/801] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:21.828177 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9513-7136-4d16-a059-28091c420ca4 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:21.828459 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9513-7136-4d16-a059-28091c420ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:21.828776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9513-7136-4d16-a059-28091c420ca4 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:21.830361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 412/802] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:21.832224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9513-7136-4d16-a059-28091c420ca4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:21.888228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:21.926272 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb85f3-249e-4061-a1c8-edcec0fcbd55 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:21.935449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9513-7136-4d16-a059-28091c420ca4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:21.960171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724319e9-3b5c-4474-aead-99d91d357e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:21.960764 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724319e9-3b5c-4474-aead-99d91d357e17 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:21.961035 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724319e9-3b5c-4474-aead-99d91d357e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:21.961302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724319e9-3b5c-4474-aead-99d91d357e17 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:21.962468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724319e9-3b5c-4474-aead-99d91d357e17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:21.962760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724319e9-3b5c-4474-aead-99d91d357e17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:21.964138 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724319e9-3b5c-4474-aead-99d91d357e17 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:21.968377 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495b587-2a27-4253-87d1-783bee72f7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:21.969275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495b587-2a27-4253-87d1-783bee72f7dc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:21.969556 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495b587-2a27-4253-87d1-783bee72f7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:21.969826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495b587-2a27-4253-87d1-783bee72f7dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:21.978083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 391/803] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:21.978083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724319e9-3b5c-4474-aead-99d91d357e17 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:22.035097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:22.049846 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495b587-2a27-4253-87d1-783bee72f7dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:22.051293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495b587-2a27-4253-87d1-783bee72f7dc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:22.081692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724319e9-3b5c-4474-aead-99d91d357e17 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:22.111590 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:22.117428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad15e1-df59-449b-bd31-39a6ae38d3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:22.118196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad15e1-df59-449b-bd31-39a6ae38d3eb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:22.118469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad15e1-df59-449b-bd31-39a6ae38d3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:22.118733 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad15e1-df59-449b-bd31-39a6ae38d3eb None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:22.119456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad15e1-df59-449b-bd31-39a6ae38d3eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:22.119751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad15e1-df59-449b-bd31-39a6ae38d3eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:22.121201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad15e1-df59-449b-bd31-39a6ae38d3eb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:22.138572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 392/804] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Aug 30 04:57:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:22.139877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e34ee-3050-4b90-94ba-65c5cbe939c6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:22.140193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e34ee-3050-4b90-94ba-65c5cbe939c6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:22.140537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e34ee-3050-4b90-94ba-65c5cbe939c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:22.160680 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-703e34ee-3050-4b90-94ba-65c5cbe939c6 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:22.161570 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 413/805] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:57:22.162583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-703e34ee-3050-4b90-94ba-65c5cbe939c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:22.162838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92624b38-03fd-4bca-85f5-5d670c03060c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:22.163126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92624b38-03fd-4bca-85f5-5d670c03060c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:22.163488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92624b38-03fd-4bca-85f5-5d670c03060c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:22.184847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-92624b38-03fd-4bca-85f5-5d670c03060c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:22.186032 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-92624b38-03fd-4bca-85f5-5d670c03060c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:22.232839 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 393/806] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:22.233511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e34ee-3050-4b90-94ba-65c5cbe939c6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:22.276800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 414/807] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:22.277999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92624b38-03fd-4bca-85f5-5d670c03060c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:22.300601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:22.372155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e34ee-3050-4b90-94ba-65c5cbe939c6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:22.390433 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:22.412996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92624b38-03fd-4bca-85f5-5d670c03060c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:22.414731 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb617c60-0d58-4638-af4a-7f94e1eb467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:22.415760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb617c60-0d58-4638-af4a-7f94e1eb467f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:22.416271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb617c60-0d58-4638-af4a-7f94e1eb467f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:22.416735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb617c60-0d58-4638-af4a-7f94e1eb467f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:22.426355 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb617c60-0d58-4638-af4a-7f94e1eb467f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:22.428304 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb617c60-0d58-4638-af4a-7f94e1eb467f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-fb617c60-0d58-4638-af4a-7f94e1eb467f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:22.444572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:22.445691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:22.447174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:22.447174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:22.447174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:22.447174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:22.447174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:22.447174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:22.447174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:22.447174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:22.447174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:57:22.447174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:22.447174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 394/808] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Aug 30 04:57:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:22.448484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb617c60-0d58-4638-af4a-7f94e1eb467f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:22.457866 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbefe06-8c9c-4cae-9be2-8cf9179e7582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:22.458727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbefe06-8c9c-4cae-9be2-8cf9179e7582 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:22.459198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbefe06-8c9c-4cae-9be2-8cf9179e7582 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:22.459663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbefe06-8c9c-4cae-9be2-8cf9179e7582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:22.470858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbefe06-8c9c-4cae-9be2-8cf9179e7582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:22.472572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbefe06-8c9c-4cae-9be2-8cf9179e7582 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ffbefe06-8c9c-4cae-9be2-8cf9179e7582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:22.488414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:22.489398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:22.490324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:22.490324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:22.490324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:22.492619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 415/809] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:22.493858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbefe06-8c9c-4cae-9be2-8cf9179e7582 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:22.573258 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb617c60-0d58-4638-af4a-7f94e1eb467f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:22.574999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:22.621486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1277cb-7884-4b35-8563-8525afdf6fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:22.622223 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1277cb-7884-4b35-8563-8525afdf6fec None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:22.622373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1277cb-7884-4b35-8563-8525afdf6fec None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:22.622997 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1277cb-7884-4b35-8563-8525afdf6fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:22.634962 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1277cb-7884-4b35-8563-8525afdf6fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:22.636431 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1277cb-7884-4b35-8563-8525afdf6fec None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-df1277cb-7884-4b35-8563-8525afdf6fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:22.651481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:22.652709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:22.653686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:22.653686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:22.653686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:22.653686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 395/810] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:22.653919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1277cb-7884-4b35-8563-8525afdf6fec None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:22.721324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbefe06-8c9c-4cae-9be2-8cf9179e7582 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:22.755870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb6bd7-3746-4f78-a6a3-7fc58d5a58d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:22.756505 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb6bd7-3746-4f78-a6a3-7fc58d5a58d7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:22.756781 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb6bd7-3746-4f78-a6a3-7fc58d5a58d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:22.757077 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb6bd7-3746-4f78-a6a3-7fc58d5a58d7 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:22.757806 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb6bd7-3746-4f78-a6a3-7fc58d5a58d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:22.758106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb6bd7-3746-4f78-a6a3-7fc58d5a58d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:22.759582 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1277cb-7884-4b35-8563-8525afdf6fec None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:22.760138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb6bd7-3746-4f78-a6a3-7fc58d5a58d7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:22.762691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:22.778692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 416/811] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Aug 30 04:57:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:22.779375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb6bd7-3746-4f78-a6a3-7fc58d5a58d7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:22.798415 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aee8b6-bab1-4191-8d63-10c29ce7afd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:22.799208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee8b6-bab1-4191-8d63-10c29ce7afd6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:22.799579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee8b6-bab1-4191-8d63-10c29ce7afd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:22.800151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee8b6-bab1-4191-8d63-10c29ce7afd6 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:22.800839 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aee8b6-bab1-4191-8d63-10c29ce7afd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:22.801223 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aee8b6-bab1-4191-8d63-10c29ce7afd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:22.802678 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aee8b6-bab1-4191-8d63-10c29ce7afd6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:22.815637 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 396/812] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:22.816504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aee8b6-bab1-4191-8d63-10c29ce7afd6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:22.837002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:22.901098 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb6bd7-3746-4f78-a6a3-7fc58d5a58d7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:22.931235 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aee8b6-bab1-4191-8d63-10c29ce7afd6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:22.939241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76246ee-f44f-4249-8bb3-cd1ad2ccb92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:22.939873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76246ee-f44f-4249-8bb3-cd1ad2ccb92b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:22.940187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76246ee-f44f-4249-8bb3-cd1ad2ccb92b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:22.940454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76246ee-f44f-4249-8bb3-cd1ad2ccb92b None admin] PATH_INFO: `/v3/services/network` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:22.941041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76246ee-f44f-4249-8bb3-cd1ad2ccb92b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:22.942394 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76246ee-f44f-4249-8bb3-cd1ad2ccb92b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-a76246ee-f44f-4249-8bb3-cd1ad2ccb92b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:22.951841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:22.952941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:22.953780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:22.953780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:22.953780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:22.953780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:22.953780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:22.953780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:22.953780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:22.953780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:22.953780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:22.953780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:22.953780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:22.953780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:22.953780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:57:22.953780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:22.953780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 417/813] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:22 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:22.954624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76246ee-f44f-4249-8bb3-cd1ad2ccb92b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:22.969137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867caf8-6b84-45ad-8544-e287cd1b2d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:22.969772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867caf8-6b84-45ad-8544-e287cd1b2d3d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:22.970049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867caf8-6b84-45ad-8544-e287cd1b2d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:22.970320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867caf8-6b84-45ad-8544-e287cd1b2d3d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:22.970906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867caf8-6b84-45ad-8544-e287cd1b2d3d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:22.972558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867caf8-6b84-45ad-8544-e287cd1b2d3d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-9867caf8-6b84-45ad-8544-e287cd1b2d3d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:22.981507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:22.982572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:22.983413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:22.983413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:22.983413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:22.983413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:22.983413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:22.983413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:22.983413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:22.983413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:22.983413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:22.983413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:22.983413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:22.983413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:22.983413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:57:22.983413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:22.983413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 397/814] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Aug 30 04:57:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:22.984356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867caf8-6b84-45ad-8544-e287cd1b2d3d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:23.026752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:23.075074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:23.086664 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76246ee-f44f-4249-8bb3-cd1ad2ccb92b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:23.098620 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867caf8-6b84-45ad-8544-e287cd1b2d3d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:23.122334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65d0d1-9c2a-44fb-9dd2-d9d1dc60910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:23.123033 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65d0d1-9c2a-44fb-9dd2-d9d1dc60910f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:23.123380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65d0d1-9c2a-44fb-9dd2-d9d1dc60910f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:23.123704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65d0d1-9c2a-44fb-9dd2-d9d1dc60910f None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:23.124314 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65d0d1-9c2a-44fb-9dd2-d9d1dc60910f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:23.124610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65d0d1-9c2a-44fb-9dd2-d9d1dc60910f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:23.125966 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65d0d1-9c2a-44fb-9dd2-d9d1dc60910f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:23.139339 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d93563-46bb-430b-a37f-5969a9d334a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:23.140392 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d93563-46bb-430b-a37f-5969a9d334a9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:23.140507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 418/815] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:23.140782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d93563-46bb-430b-a37f-5969a9d334a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:23.141217 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d93563-46bb-430b-a37f-5969a9d334a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:23.141777 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65d0d1-9c2a-44fb-9dd2-d9d1dc60910f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:23.158690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d93563-46bb-430b-a37f-5969a9d334a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:23.160997 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d93563-46bb-430b-a37f-5969a9d334a9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-73d93563-46bb-430b-a37f-5969a9d334a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:23.179556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:23.181448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:23.182537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:23.182537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:23.182537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:23.182537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 398/816] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:23.182537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d93563-46bb-430b-a37f-5969a9d334a9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:23.271057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65d0d1-9c2a-44fb-9dd2-d9d1dc60910f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:23.291164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:23.303376 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d93563-46bb-430b-a37f-5969a9d334a9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:23.311477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4f542-7a3c-4c0e-98d4-d8f4e9c72e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:23.312141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4f542-7a3c-4c0e-98d4-d8f4e9c72e92 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:23.312557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4f542-7a3c-4c0e-98d4-d8f4e9c72e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:23.312849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4f542-7a3c-4c0e-98d4-d8f4e9c72e92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:23.319900 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4f542-7a3c-4c0e-98d4-d8f4e9c72e92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:23.321897 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4f542-7a3c-4c0e-98d4-d8f4e9c72e92 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:23.333137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-5fa4f542-7a3c-4c0e-98d4-d8f4e9c72e92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:23.333137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:23.333137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:23.333137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:23.333137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:23.333137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:23.333137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:23.333137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:23.333137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:23.333137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:23.333137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:23.333137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:23.333137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:23.333137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:23.333137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:23.334149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:23.335027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:23.335027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:23.335027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:23.335027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:23.335027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:23.335027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:23.335027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:23.335027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:23.335027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 419/817] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:23.335027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4f542-7a3c-4c0e-98d4-d8f4e9c72e92 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:23.339297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:23.345625 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba0d89-87fa-4a8a-a8ad-d97d4f0c0d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:23.346238 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba0d89-87fa-4a8a-a8ad-d97d4f0c0d18 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:23.346514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba0d89-87fa-4a8a-a8ad-d97d4f0c0d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:23.346784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba0d89-87fa-4a8a-a8ad-d97d4f0c0d18 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:23.347420 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba0d89-87fa-4a8a-a8ad-d97d4f0c0d18 None admin] RBAC: Adding query filter params (name=network) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:23.347723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba0d89-87fa-4a8a-a8ad-d97d4f0c0d18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:23.349171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba0d89-87fa-4a8a-a8ad-d97d4f0c0d18 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:23.354450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 399/818] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Aug 30 04:57:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:23.355274 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba0d89-87fa-4a8a-a8ad-d97d4f0c0d18 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:23.448507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4f542-7a3c-4c0e-98d4-d8f4e9c72e92 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:23.459627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba0d89-87fa-4a8a-a8ad-d97d4f0c0d18 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:23.483301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91b77b-e79d-44d5-8490-4674e3f0855a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:23.483908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91b77b-e79d-44d5-8490-4674e3f0855a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:23.484233 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91b77b-e79d-44d5-8490-4674e3f0855a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:23.484501 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91b77b-e79d-44d5-8490-4674e3f0855a None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:23.485121 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91b77b-e79d-44d5-8490-4674e3f0855a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:23.485415 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91b77b-e79d-44d5-8490-4674e3f0855a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:23.486760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91b77b-e79d-44d5-8490-4674e3f0855a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:23.491301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 420/819] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Aug 30 04:57:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:23.492130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91b77b-e79d-44d5-8490-4674e3f0855a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:23.495347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a586341-8079-40b6-8b98-247a31799677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:23.496008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a586341-8079-40b6-8b98-247a31799677 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:23.496292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a586341-8079-40b6-8b98-247a31799677 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:23.496565 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a586341-8079-40b6-8b98-247a31799677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:23.503881 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a586341-8079-40b6-8b98-247a31799677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:23.505398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a586341-8079-40b6-8b98-247a31799677 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:23.517816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1a586341-8079-40b6-8b98-247a31799677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:23.517816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:23.517816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:23.517816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:23.517816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:23.517816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:23.517816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:23.517816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:23.517816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:23.517816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:23.517816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:23.517816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:23.517816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:23.517816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:23.517816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:23.518878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:23.524647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:23.524647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:23.524647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:23.524647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:23.524647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:23.524647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:23.524647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:23.524647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:23.524647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 400/820] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:23.524647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a586341-8079-40b6-8b98-247a31799677 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:23.537535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:23.584900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:23.599606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91b77b-e79d-44d5-8490-4674e3f0855a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:23.629683 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a586341-8079-40b6-8b98-247a31799677 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:23.632865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb851c-5e16-4fcd-9ce7-22f5af0e1a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:23.633460 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb851c-5e16-4fcd-9ce7-22f5af0e1a09 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:23.634347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb851c-5e16-4fcd-9ce7-22f5af0e1a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:23.634617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb851c-5e16-4fcd-9ce7-22f5af0e1a09 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:23.635248 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb851c-5e16-4fcd-9ce7-22f5af0e1a09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:23.635542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb851c-5e16-4fcd-9ce7-22f5af0e1a09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:23.636931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb851c-5e16-4fcd-9ce7-22f5af0e1a09 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:23.648309 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 421/821] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:23.649099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb851c-5e16-4fcd-9ce7-22f5af0e1a09 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:23.666716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f508d4-2cc8-46e5-94c6-2406d195bbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:23.667358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f508d4-2cc8-46e5-94c6-2406d195bbfc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:23.667639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f508d4-2cc8-46e5-94c6-2406d195bbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:23.667903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f508d4-2cc8-46e5-94c6-2406d195bbfc None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:23.668633 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f508d4-2cc8-46e5-94c6-2406d195bbfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:23.668930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f508d4-2cc8-46e5-94c6-2406d195bbfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:23.670336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f508d4-2cc8-46e5-94c6-2406d195bbfc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:23.682820 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 401/822] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:23.683612 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f508d4-2cc8-46e5-94c6-2406d195bbfc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:23.745562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb851c-5e16-4fcd-9ce7-22f5af0e1a09 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:23.746994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:23.780044 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d8710-2a00-49c4-aa5e-c341c609c51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:23.780640 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d8710-2a00-49c4-aa5e-c341c609c51d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:23.780915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d8710-2a00-49c4-aa5e-c341c609c51d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:23.781183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d8710-2a00-49c4-aa5e-c341c609c51d None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:23.781804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d8710-2a00-49c4-aa5e-c341c609c51d None admin] RBAC: Adding query filter params (type=network) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:23.782100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d8710-2a00-49c4-aa5e-c341c609c51d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:23.783451 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d8710-2a00-49c4-aa5e-c341c609c51d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:23.788138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 422/823] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Aug 30 04:57:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:23.788268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f508d4-2cc8-46e5-94c6-2406d195bbfc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:23.788901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d8710-2a00-49c4-aa5e-c341c609c51d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:23.806522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:23.828909 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3df96c-5494-45d4-88fb-117a866349b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:23.829516 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3df96c-5494-45d4-88fb-117a866349b8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:23.829802 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3df96c-5494-45d4-88fb-117a866349b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:23.830077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3df96c-5494-45d4-88fb-117a866349b8 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:23.830709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3df96c-5494-45d4-88fb-117a866349b8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:23.831011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3df96c-5494-45d4-88fb-117a866349b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:23.832428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3df96c-5494-45d4-88fb-117a866349b8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:23.837273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 402/824] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Aug 30 04:57:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:23.838046 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3df96c-5494-45d4-88fb-117a866349b8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:23.889312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d8710-2a00-49c4-aa5e-c341c609c51d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:23.922677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b077f6b-e425-474a-aba7-13b758d9248b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:23.923272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b077f6b-e425-474a-aba7-13b758d9248b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:23.923547 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b077f6b-e425-474a-aba7-13b758d9248b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:23.923814 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b077f6b-e425-474a-aba7-13b758d9248b None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:23.924521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b077f6b-e425-474a-aba7-13b758d9248b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:23.924819 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b077f6b-e425-474a-aba7-13b758d9248b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:23.926224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b077f6b-e425-474a-aba7-13b758d9248b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:23.938326 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 423/825] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:23.938876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b077f6b-e425-474a-aba7-13b758d9248b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:23.949127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3df96c-5494-45d4-88fb-117a866349b8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:23.971441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:23.987418 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ab9e0-ba57-4f2d-a761-fa7e746d0cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:23.988087 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ab9e0-ba57-4f2d-a761-fa7e746d0cec None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:23.988375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ab9e0-ba57-4f2d-a761-fa7e746d0cec None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:23.988647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ab9e0-ba57-4f2d-a761-fa7e746d0cec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:23.996144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ab9e0-ba57-4f2d-a761-fa7e746d0cec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:23.997522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ab9e0-ba57-4f2d-a761-fa7e746d0cec None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:24.009315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-0e6ab9e0-ba57-4f2d-a761-fa7e746d0cec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:24.009315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:24.009315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:24.009315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:24.009315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:24.009315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:24.009315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:24.009315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:24.009315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:24.009315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:24.009315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:24.009315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:24.009315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:24.009315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:24.009315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:24.010357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:24.011436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:24.011436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:24.011436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:24.011436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:24.011436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:24.011436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:24.011436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:24.011436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:24.011436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 403/826] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:24.011970 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ab9e0-ba57-4f2d-a761-fa7e746d0cec None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:24.048859 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b077f6b-e425-474a-aba7-13b758d9248b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:24.050874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:24.083011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e92c4-f5dd-4111-8fe6-da6d9152d0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:24.083657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e92c4-f5dd-4111-8fe6-da6d9152d0b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:24.083932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e92c4-f5dd-4111-8fe6-da6d9152d0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:24.084234 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e92c4-f5dd-4111-8fe6-da6d9152d0b6 None admin] PATH_INFO: `/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/a96ac878c106422ebf438a64ca618747/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:24.086249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e92c4-f5dd-4111-8fe6-da6d9152d0b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8aae17def04cf48190ede4bffefe70, user_id=a96ac878c106422ebf438a64ca618747, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:24.087579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e92c4-f5dd-4111-8fe6-da6d9152d0b6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:24.099665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 424/827] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:57:23 2022] PUT /identity/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/a96ac878c106422ebf438a64ca618747/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:24.100455 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e92c4-f5dd-4111-8fe6-da6d9152d0b6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:24.111803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ab9e0-ba57-4f2d-a761-fa7e746d0cec None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:24.151073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee390bf-05e4-47ef-9102-b54ea6fdca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:24.151869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee390bf-05e4-47ef-9102-b54ea6fdca64 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:24.152261 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee390bf-05e4-47ef-9102-b54ea6fdca64 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:24.152625 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee390bf-05e4-47ef-9102-b54ea6fdca64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:24.153422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee390bf-05e4-47ef-9102-b54ea6fdca64 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:24.154931 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee390bf-05e4-47ef-9102-b54ea6fdca64 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:24.181608 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 404/828] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 04:57:24 2022] POST /identity/v3/endpoints => generated 337 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:24.182336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee390bf-05e4-47ef-9102-b54ea6fdca64 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:24.229133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:24.254492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e92c4-f5dd-4111-8fe6-da6d9152d0b6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:24.308439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd21c4-a15e-41e0-bab5-024697d8ea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:24.309442 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd21c4-a15e-41e0-bab5-024697d8ea00 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:24.309923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd21c4-a15e-41e0-bab5-024697d8ea00 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:24.310387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd21c4-a15e-41e0-bab5-024697d8ea00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:24.311478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd21c4-a15e-41e0-bab5-024697d8ea00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:24.313256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd21c4-a15e-41e0-bab5-024697d8ea00 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:24.317439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:24.325500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee390bf-05e4-47ef-9102-b54ea6fdca64 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:24.348042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 425/829] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 04:57:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:24.349230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd21c4-a15e-41e0-bab5-024697d8ea00 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:24.375610 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1e06b-ad9c-488f-8a67-df1f1bcf511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:24.376267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1e06b-ad9c-488f-8a67-df1f1bcf511c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:24.376547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1e06b-ad9c-488f-8a67-df1f1bcf511c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:24.376815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1e06b-ad9c-488f-8a67-df1f1bcf511c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:24.377561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1e06b-ad9c-488f-8a67-df1f1bcf511c None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=1aa002909502426b80c97dbf05dca008) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:24.377869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1e06b-ad9c-488f-8a67-df1f1bcf511c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:24.379797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1e06b-ad9c-488f-8a67-df1f1bcf511c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:24.387234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 405/830] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:57:24 2022] GET /identity/v3/role_assignments?user.id=1aa002909502426b80c97dbf05dca008&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:24.501404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd21c4-a15e-41e0-bab5-024697d8ea00 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:24.550551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c44ab-958f-44c0-9441-a4ea2f5f52ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:24.551103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c44ab-958f-44c0-9441-a4ea2f5f52ee None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:24.551376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c44ab-958f-44c0-9441-a4ea2f5f52ee None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:24.551645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c44ab-958f-44c0-9441-a4ea2f5f52ee None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:24.552390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c44ab-958f-44c0-9441-a4ea2f5f52ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:24.552696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c44ab-958f-44c0-9441-a4ea2f5f52ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:24.554224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c44ab-958f-44c0-9441-a4ea2f5f52ee None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:24.564113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:24.572550 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 426/831] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:24.579177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1e06b-ad9c-488f-8a67-df1f1bcf511c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:24.807068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1e06b-ad9c-488f-8a67-df1f1bcf511c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:24.844822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125f34b-efca-4f6c-94a8-c491f94e419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:24.845671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f34b-efca-4f6c-94a8-c491f94e419d None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:24.846047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f34b-efca-4f6c-94a8-c491f94e419d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:24.846522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f34b-efca-4f6c-94a8-c491f94e419d None admin] PATH_INFO: `/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/487fc3d8ac924be0a1d66ae8ca49f76c/roles/2381dab0bb194ddfaf31c2933c683b71` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:24.861535 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125f34b-efca-4f6c-94a8-c491f94e419d None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8aae17def04cf48190ede4bffefe70, user_id=487fc3d8ac924be0a1d66ae8ca49f76c, role_id=2381dab0bb194ddfaf31c2933c683b71)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:24.863170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125f34b-efca-4f6c-94a8-c491f94e419d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:24.877167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 406/832] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:57:24 2022] PUT /identity/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/487fc3d8ac924be0a1d66ae8ca49f76c/roles/2381dab0bb194ddfaf31c2933c683b71 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:26.055032 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554765f-0091-4857-9386-8d28741b6c74 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:26.056302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554765f-0091-4857-9386-8d28741b6c74 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:26.056302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554765f-0091-4857-9386-8d28741b6c74 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:26.057595 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 427/833] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:26.063061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffee6ce-ea9b-4a5a-ae95-91cb12148a53 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:26.063899 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffee6ce-ea9b-4a5a-ae95-91cb12148a53 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:26.064415 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffee6ce-ea9b-4a5a-ae95-91cb12148a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:26.072034 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:26.083439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5ffee6ce-ea9b-4a5a-ae95-91cb12148a53 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:26.084650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5ffee6ce-ea9b-4a5a-ae95-91cb12148a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:26.160318 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 407/834] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:26.406224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c4e0a-d37e-4f03-bd08-bc39ca580457 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:26.406599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c4e0a-d37e-4f03-bd08-bc39ca580457 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:26.406800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c4e0a-d37e-4f03-bd08-bc39ca580457 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:26.408450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 428/835] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:26.413713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d4c73-a638-4acb-9743-74a074f63587 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:26.413999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d4c73-a638-4acb-9743-74a074f63587 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:26.414270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d4c73-a638-4acb-9743-74a074f63587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:26.429566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c4e0a-d37e-4f03-bd08-bc39ca580457 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:26.434231 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3d6d4c73-a638-4acb-9743-74a074f63587 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:26.435439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3d6d4c73-a638-4acb-9743-74a074f63587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:26.520436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 408/836] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:26.521790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403603e-7316-4d51-83c1-0925ec939869 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:26.522075 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403603e-7316-4d51-83c1-0925ec939869 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:26.522342 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403603e-7316-4d51-83c1-0925ec939869 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:26.523709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 409/837] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:26.529178 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782464d-55dc-48ab-9220-5c95fa5fba83 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:26.529462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782464d-55dc-48ab-9220-5c95fa5fba83 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:26.529736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782464d-55dc-48ab-9220-5c95fa5fba83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:26.542593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c4e0a-d37e-4f03-bd08-bc39ca580457 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:26.549615 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3782464d-55dc-48ab-9220-5c95fa5fba83 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:26.551223 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3782464d-55dc-48ab-9220-5c95fa5fba83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:26.580978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b94c7c-d363-432b-b984-2c21ef90e501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:26.582077 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b94c7c-d363-432b-b984-2c21ef90e501 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:26.582668 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b94c7c-d363-432b-b984-2c21ef90e501 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:26.583029 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b94c7c-d363-432b-b984-2c21ef90e501 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:26.594354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b94c7c-d363-432b-b984-2c21ef90e501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-d8b94c7c-d363-432b-b984-2c21ef90e501 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:26.599602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:26.600747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:26.601800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:26.601800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:26.601800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:26.601800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:26.601800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:26.601800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:26.601800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:26.601800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:26.601800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:26.601800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:26.601800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:26.601800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:26.608261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 429/838] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:57:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:26.609396 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b94c7c-d363-432b-b984-2c21ef90e501 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:26.629869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:26.648416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 410/839] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:26.687559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:26.731925 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b94c7c-d363-432b-b984-2c21ef90e501 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:26.768669 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66982aca-468c-4881-8372-26462b202808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:26.769274 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66982aca-468c-4881-8372-26462b202808 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:26.769551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66982aca-468c-4881-8372-26462b202808 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:26.769878 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66982aca-468c-4881-8372-26462b202808 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:26.770540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66982aca-468c-4881-8372-26462b202808 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:26.770840 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66982aca-468c-4881-8372-26462b202808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:26.772232 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66982aca-468c-4881-8372-26462b202808 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:26.780773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 430/840] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:57:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:26.786507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782464d-55dc-48ab-9220-5c95fa5fba83 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:26.819718 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66982aca-468c-4881-8372-26462b202808 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:26.903519 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782464d-55dc-48ab-9220-5c95fa5fba83 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:26.932234 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66982aca-468c-4881-8372-26462b202808 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:26.949583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd777c-4055-4d41-925d-6959ff10b269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:26.950882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd777c-4055-4d41-925d-6959ff10b269 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:26.951547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd777c-4055-4d41-925d-6959ff10b269 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:26.952069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd777c-4055-4d41-925d-6959ff10b269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:26.953572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:26.964370 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd777c-4055-4d41-925d-6959ff10b269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:26.965796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd777c-4055-4d41-925d-6959ff10b269 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:26.968015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdad7ef-30ef-498b-a637-35a2f2d5a66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:26.968651 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdad7ef-30ef-498b-a637-35a2f2d5a66e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:26.968927 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdad7ef-30ef-498b-a637-35a2f2d5a66e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:26.969196 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdad7ef-30ef-498b-a637-35a2f2d5a66e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:26.969769 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdad7ef-30ef-498b-a637-35a2f2d5a66e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:26.971111 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdad7ef-30ef-498b-a637-35a2f2d5a66e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4bdad7ef-30ef-498b-a637-35a2f2d5a66e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:26.980407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:26.981390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:26.982675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:26.982675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:26.982675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:26.982675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:26.982675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:26.982675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:26.982675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:26.982675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:26.982675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:26.982675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:26.982675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:26.982675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:26.982675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:57:26.982675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-9cbd777c-4055-4d41-925d-6959ff10b269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:26.983440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:26.984311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:26.986154 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:26.986154 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:26.986154 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:26.986467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 431/841] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:57:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:26.986467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cf2af-609a-4cde-bcbd-7ce1709f25e4 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:26.986467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cf2af-609a-4cde-bcbd-7ce1709f25e4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:26.986467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cf2af-609a-4cde-bcbd-7ce1709f25e4 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:26.986467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 432/842] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:26.986467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cf2af-609a-4cde-bcbd-7ce1709f25e4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:26.987509 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 411/843] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:26.988472 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd777c-4055-4d41-925d-6959ff10b269 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:27.038361 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:27.092358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd777c-4055-4d41-925d-6959ff10b269 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:27.094320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cf2af-609a-4cde-bcbd-7ce1709f25e4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:27.125268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1ddcd-ea89-48d4-b456-74d7b62dff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:27.125868 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ddcd-ea89-48d4-b456-74d7b62dff6e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:27.126144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ddcd-ea89-48d4-b456-74d7b62dff6e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:27.126411 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ddcd-ea89-48d4-b456-74d7b62dff6e None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:27.127037 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1ddcd-ea89-48d4-b456-74d7b62dff6e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:27.127334 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1ddcd-ea89-48d4-b456-74d7b62dff6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:27.129057 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1ddcd-ea89-48d4-b456-74d7b62dff6e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:27.129667 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f018bc-9434-477e-84af-224fe83f447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:27.130293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f018bc-9434-477e-84af-224fe83f447b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:27.130568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f018bc-9434-477e-84af-224fe83f447b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:27.130840 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f018bc-9434-477e-84af-224fe83f447b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:27.131409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f018bc-9434-477e-84af-224fe83f447b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:27.132772 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f018bc-9434-477e-84af-224fe83f447b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:27.134320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 412/844] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:57:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:27.135518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b000b-de53-4478-85ff-833f17a27fdb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:27.135792 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b000b-de53-4478-85ff-833f17a27fdb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:27.136399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b000b-de53-4478-85ff-833f17a27fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-57f018bc-9434-477e-84af-224fe83f447b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:27.142378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:27.143285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:27.144201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:27.144201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:27.144201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:27.144201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:27.144201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:27.144201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:27.144201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:27.144201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:27.144201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:27.144201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:27.144201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:27.144201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:27.144201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:57:27.144201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:27.144201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 433/845] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Aug 30 04:57:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:27.145001 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f018bc-9434-477e-84af-224fe83f447b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:27.156031 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-802b000b-de53-4478-85ff-833f17a27fdb None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:27.157234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-802b000b-de53-4478-85ff-833f17a27fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:27.196404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:27.225345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 413/846] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:27.226099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b000b-de53-4478-85ff-833f17a27fdb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:27.261586 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f018bc-9434-477e-84af-224fe83f447b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:27.277861 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:27.297241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311b8e5-f9d5-4f51-a218-a8117f136f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:27.297845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311b8e5-f9d5-4f51-a218-a8117f136f41 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:27.298113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311b8e5-f9d5-4f51-a218-a8117f136f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:27.298385 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311b8e5-f9d5-4f51-a218-a8117f136f41 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:27.299042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311b8e5-f9d5-4f51-a218-a8117f136f41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:27.299310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311b8e5-f9d5-4f51-a218-a8117f136f41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:27.300679 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311b8e5-f9d5-4f51-a218-a8117f136f41 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:27.313152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 434/847] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:27.313940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311b8e5-f9d5-4f51-a218-a8117f136f41 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:27.345529 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b000b-de53-4478-85ff-833f17a27fdb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:27.381715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd47c69-3dc6-436b-943a-b46d17fb3a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:27.382411 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd47c69-3dc6-436b-943a-b46d17fb3a61 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:27.382758 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd47c69-3dc6-436b-943a-b46d17fb3a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:27.383088 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd47c69-3dc6-436b-943a-b46d17fb3a61 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:27.383729 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd47c69-3dc6-436b-943a-b46d17fb3a61 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:27.384076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd47c69-3dc6-436b-943a-b46d17fb3a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:27.385466 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd47c69-3dc6-436b-943a-b46d17fb3a61 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:27.390089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 414/848] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:57:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:27.390848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd47c69-3dc6-436b-943a-b46d17fb3a61 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:27.442882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311b8e5-f9d5-4f51-a218-a8117f136f41 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:27.455591 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:27.485751 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4babfc9-5cc3-416b-a2a1-9ef5d4cb94cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:27.486282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4babfc9-5cc3-416b-a2a1-9ef5d4cb94cb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:27.486615 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4babfc9-5cc3-416b-a2a1-9ef5d4cb94cb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:27.486887 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4babfc9-5cc3-416b-a2a1-9ef5d4cb94cb None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:27.487528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4babfc9-5cc3-416b-a2a1-9ef5d4cb94cb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:27.487827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4babfc9-5cc3-416b-a2a1-9ef5d4cb94cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:27.489403 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4babfc9-5cc3-416b-a2a1-9ef5d4cb94cb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:27.499426 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 435/849] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Aug 30 04:57:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:27.500659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4babfc9-5cc3-416b-a2a1-9ef5d4cb94cb None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:27.530229 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd47c69-3dc6-436b-943a-b46d17fb3a61 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:27.531890 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:27.572921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a470f8-b085-4f7f-8be8-83f9eba3f4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:27.573648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a470f8-b085-4f7f-8be8-83f9eba3f4ed None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:27.573822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a470f8-b085-4f7f-8be8-83f9eba3f4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:27.574090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a470f8-b085-4f7f-8be8-83f9eba3f4ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:27.581426 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a470f8-b085-4f7f-8be8-83f9eba3f4ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:27.582855 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a470f8-b085-4f7f-8be8-83f9eba3f4ed None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e1a470f8-b085-4f7f-8be8-83f9eba3f4ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:27.595155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:27.596145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:27.597125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:27.597125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:27.597125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:27.597125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:27.597125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:27.597125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:27.597125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:27.597125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:27.597125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:57:27.597125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:27.600088 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 415/850] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:57:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:27.601410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a470f8-b085-4f7f-8be8-83f9eba3f4ed None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:27.611311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4babfc9-5cc3-416b-a2a1-9ef5d4cb94cb None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:27.649667 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062eee0-6786-44a5-b76c-e4f7183c8863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:27.650280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062eee0-6786-44a5-b76c-e4f7183c8863 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:27.650561 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062eee0-6786-44a5-b76c-e4f7183c8863 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:27.650833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062eee0-6786-44a5-b76c-e4f7183c8863 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:27.651494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062eee0-6786-44a5-b76c-e4f7183c8863 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:27.651793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062eee0-6786-44a5-b76c-e4f7183c8863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:27.653184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062eee0-6786-44a5-b76c-e4f7183c8863 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:27.657737 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 436/851] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Aug 30 04:57:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:27.658511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062eee0-6786-44a5-b76c-e4f7183c8863 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:27.710890 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a470f8-b085-4f7f-8be8-83f9eba3f4ed None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:27.719914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:27.757010 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e386e0-da78-4964-83e0-f0c0275a0849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:27.757571 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e386e0-da78-4964-83e0-f0c0275a0849 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:27.757850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e386e0-da78-4964-83e0-f0c0275a0849 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:27.758125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e386e0-da78-4964-83e0-f0c0275a0849 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:27.774390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e386e0-da78-4964-83e0-f0c0275a0849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b9e386e0-da78-4964-83e0-f0c0275a0849 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:27.783153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:27.784242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:27.785082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:27.785082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:27.785082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:27.785082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:27.785082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:27.785082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:27.785082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:27.785082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:27.785082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:27.785082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:27.785082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:57:27.785082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:27.785082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 416/852] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:57:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:27.795417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e386e0-da78-4964-83e0-f0c0275a0849 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:27.811599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062eee0-6786-44a5-b76c-e4f7183c8863 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:27.829433 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:27.871901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc933c-e5d5-4538-b7d2-521791d3dc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:27.872919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc933c-e5d5-4538-b7d2-521791d3dc80 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:27.873423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc933c-e5d5-4538-b7d2-521791d3dc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:27.873932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc933c-e5d5-4538-b7d2-521791d3dc80 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:27.875012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc933c-e5d5-4538-b7d2-521791d3dc80 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:27.876169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc933c-e5d5-4538-b7d2-521791d3dc80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:27.878045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc933c-e5d5-4538-b7d2-521791d3dc80 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:27.907514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 437/853] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Aug 30 04:57:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:27.908630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc933c-e5d5-4538-b7d2-521791d3dc80 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:27.951738 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e386e0-da78-4964-83e0-f0c0275a0849 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:27.992277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923717a-d4d9-46a1-ae63-9a6078f8ce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:27.993372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923717a-d4d9-46a1-ae63-9a6078f8ce4a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:27.993648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923717a-d4d9-46a1-ae63-9a6078f8ce4a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:27.993914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923717a-d4d9-46a1-ae63-9a6078f8ce4a None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:27.994579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923717a-d4d9-46a1-ae63-9a6078f8ce4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:27.994930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923717a-d4d9-46a1-ae63-9a6078f8ce4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:27.996256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923717a-d4d9-46a1-ae63-9a6078f8ce4a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:28.005891 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 417/854] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:57:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:28.021698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923717a-d4d9-46a1-ae63-9a6078f8ce4a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:28.050623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:28.061239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc933c-e5d5-4538-b7d2-521791d3dc80 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:28.099505 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a2907-ccde-4e9e-a0e1-d5ece1f8178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:28.100192 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a2907-ccde-4e9e-a0e1-d5ece1f8178c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:28.100418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a2907-ccde-4e9e-a0e1-d5ece1f8178c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:28.100687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a2907-ccde-4e9e-a0e1-d5ece1f8178c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:28.134154 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:28.152871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923717a-d4d9-46a1-ae63-9a6078f8ce4a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:28.178414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a2907-ccde-4e9e-a0e1-d5ece1f8178c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:28.180097 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a2907-ccde-4e9e-a0e1-d5ece1f8178c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:28.198532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af5242-a7d3-49e6-a2e7-09d7189cf53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:28.199318 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af5242-a7d3-49e6-a2e7-09d7189cf53c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:28.199595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af5242-a7d3-49e6-a2e7-09d7189cf53c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:28.199861 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af5242-a7d3-49e6-a2e7-09d7189cf53c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:28.213834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af5242-a7d3-49e6-a2e7-09d7189cf53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:28.215809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af5242-a7d3-49e6-a2e7-09d7189cf53c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-78af5242-a7d3-49e6-a2e7-09d7189cf53c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:28.234493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:28.235690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:28.236774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:28.236774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:28.236774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:28.236774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 418/855] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:28.244059 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af5242-a7d3-49e6-a2e7-09d7189cf53c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:28.299612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:28.310300 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 438/856] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:57:28.318687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a2907-ccde-4e9e-a0e1-d5ece1f8178c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:28.378256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af5242-a7d3-49e6-a2e7-09d7189cf53c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:28.417822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e075a7-44f8-41d9-a3f7-6b23d14fcf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:28.418427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e075a7-44f8-41d9-a3f7-6b23d14fcf21 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:28.418701 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e075a7-44f8-41d9-a3f7-6b23d14fcf21 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:28.418974 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e075a7-44f8-41d9-a3f7-6b23d14fcf21 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:28.419605 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e075a7-44f8-41d9-a3f7-6b23d14fcf21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:28.419900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e075a7-44f8-41d9-a3f7-6b23d14fcf21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:28.421348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e075a7-44f8-41d9-a3f7-6b23d14fcf21 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:28.428984 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:28.436588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 419/857] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:28.445123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e075a7-44f8-41d9-a3f7-6b23d14fcf21 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:28.454114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a2907-ccde-4e9e-a0e1-d5ece1f8178c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:28.497132 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151da4bb-e931-4650-a5cf-2254a95a1e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:28.497797 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151da4bb-e931-4650-a5cf-2254a95a1e74 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:28.498070 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151da4bb-e931-4650-a5cf-2254a95a1e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:28.498337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151da4bb-e931-4650-a5cf-2254a95a1e74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:28.511630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151da4bb-e931-4650-a5cf-2254a95a1e74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:28.512989 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151da4bb-e931-4650-a5cf-2254a95a1e74 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-151da4bb-e931-4650-a5cf-2254a95a1e74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:28.533867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:28.535109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:28.536506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:28.536506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:28.536506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:28.540219 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 439/858] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:28.541097 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151da4bb-e931-4650-a5cf-2254a95a1e74 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:28.599917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:28.604899 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e075a7-44f8-41d9-a3f7-6b23d14fcf21 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:28.669771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151da4bb-e931-4650-a5cf-2254a95a1e74 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:28.683029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce297693-0073-4284-bae0-569c38d56cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:28.684026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce297693-0073-4284-bae0-569c38d56cfd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:28.684763 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce297693-0073-4284-bae0-569c38d56cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:28.685727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce297693-0073-4284-bae0-569c38d56cfd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:28.696611 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce297693-0073-4284-bae0-569c38d56cfd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:28.698108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce297693-0073-4284-bae0-569c38d56cfd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-ce297693-0073-4284-bae0-569c38d56cfd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:28.711990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:28.712980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:28.713921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:28.713921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:28.713921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:28.713921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:28.713921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:28.713921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:28.713921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:28.713921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:28.713921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:57:28.713921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:28.715014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa389c-e61a-4d6f-b140-1894de89937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:28.715931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa389c-e61a-4d6f-b140-1894de89937a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:28.716437 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa389c-e61a-4d6f-b140-1894de89937a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:28.716935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa389c-e61a-4d6f-b140-1894de89937a None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:28.717777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 420/859] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Aug 30 04:57:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:28.717963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa389c-e61a-4d6f-b140-1894de89937a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:28.718486 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa389c-e61a-4d6f-b140-1894de89937a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:28.718996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce297693-0073-4284-bae0-569c38d56cfd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:28.720502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa389c-e61a-4d6f-b140-1894de89937a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:28.737937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 440/860] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:28.744934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa389c-e61a-4d6f-b140-1894de89937a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:28.792189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:28.847002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce297693-0073-4284-bae0-569c38d56cfd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:28.869714 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa389c-e61a-4d6f-b140-1894de89937a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:28.878809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:28.890259 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911426f-42ae-4429-a1f1-62b60704f4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:28.891407 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911426f-42ae-4429-a1f1-62b60704f4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:28.892287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911426f-42ae-4429-a1f1-62b60704f4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:28.892780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911426f-42ae-4429-a1f1-62b60704f4a8 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:28.893713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911426f-42ae-4429-a1f1-62b60704f4a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:28.894260 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911426f-42ae-4429-a1f1-62b60704f4a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:28.896735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911426f-42ae-4429-a1f1-62b60704f4a8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:28.910121 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7232c43-837c-42b9-be22-f61be4f870b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:28.910928 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7232c43-837c-42b9-be22-f61be4f870b9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:28.911208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7232c43-837c-42b9-be22-f61be4f870b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:28.911541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7232c43-837c-42b9-be22-f61be4f870b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:28.920362 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7232c43-837c-42b9-be22-f61be4f870b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:28.921945 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7232c43-837c-42b9-be22-f61be4f870b9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:28.925591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 421/861] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Aug 30 04:57:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:28.932319 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911426f-42ae-4429-a1f1-62b60704f4a8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:28.940917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c7232c43-837c-42b9-be22-f61be4f870b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:28.940917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:28.940917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:28.940917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:28.940917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:28.940917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:28.940917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:28.940917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:28.940917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:28.940917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:28.940917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:28.940917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:28.940917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:28.940917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:28.940917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:28.942038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:28.943008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:28.943008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:28.943008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:28.943008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:28.943008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:28.943008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:28.943008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:28.943008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:28.947474 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 441/862] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:28.948800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7232c43-837c-42b9-be22-f61be4f870b9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:29.065616 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7232c43-837c-42b9-be22-f61be4f870b9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:29.069355 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911426f-42ae-4429-a1f1-62b60704f4a8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:29.090524 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:29.105327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42240c0-c892-43cf-b5c1-a535293ba449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:29.106019 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42240c0-c892-43cf-b5c1-a535293ba449 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:29.106369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42240c0-c892-43cf-b5c1-a535293ba449 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:29.106711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42240c0-c892-43cf-b5c1-a535293ba449 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:29.107588 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42240c0-c892-43cf-b5c1-a535293ba449 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:29.107982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42240c0-c892-43cf-b5c1-a535293ba449 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:29.109511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42240c0-c892-43cf-b5c1-a535293ba449 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:29.118257 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f78e33-ccf1-4ac0-bde0-e2d009ee4c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:29.120436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f78e33-ccf1-4ac0-bde0-e2d009ee4c1c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:29.121135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f78e33-ccf1-4ac0-bde0-e2d009ee4c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:29.122150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f78e33-ccf1-4ac0-bde0-e2d009ee4c1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:29.129216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 442/863] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:29.131376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42240c0-c892-43cf-b5c1-a535293ba449 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:29.163373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:29.224144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f78e33-ccf1-4ac0-bde0-e2d009ee4c1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:29.225765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f78e33-ccf1-4ac0-bde0-e2d009ee4c1c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:29.256514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42240c0-c892-43cf-b5c1-a535293ba449 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:29.301989 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a450100-884c-483b-9f18-18be754623aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:29.302878 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a450100-884c-483b-9f18-18be754623aa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:29.303293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a450100-884c-483b-9f18-18be754623aa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:29.303698 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a450100-884c-483b-9f18-18be754623aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:29.304587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a450100-884c-483b-9f18-18be754623aa None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=a96ac878c106422ebf438a64ca618747) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:29.306007 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a450100-884c-483b-9f18-18be754623aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:29.307984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a450100-884c-483b-9f18-18be754623aa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:29.316426 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 443/864] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:57:29 2022] GET /identity/v3/role_assignments?user.id=a96ac878c106422ebf438a64ca618747&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:29.335692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 422/865] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:57:29.349155 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a450100-884c-483b-9f18-18be754623aa None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:29.377306 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9cc11-0d61-42ad-a71e-168d8d3e7862 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:29.377877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9cc11-0d61-42ad-a71e-168d8d3e7862 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:29.378581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9cc11-0d61-42ad-a71e-168d8d3e7862 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:29.381025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 423/866] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:29.387730 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47739b-4bd0-45d4-a84f-627a4d088a5c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:29.388331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47739b-4bd0-45d4-a84f-627a4d088a5c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:29.388806 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47739b-4bd0-45d4-a84f-627a4d088a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:29.408240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5d47739b-4bd0-45d4-a84f-627a4d088a5c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:29.410054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5d47739b-4bd0-45d4-a84f-627a4d088a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:29.424393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:29.459786 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:29.471998 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a450100-884c-483b-9f18-18be754623aa None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:29.497082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 424/867] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:29.514805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e63bc-1095-4c7a-9d69-cf06df467a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:29.515548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e63bc-1095-4c7a-9d69-cf06df467a4f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:29.515900 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e63bc-1095-4c7a-9d69-cf06df467a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:29.516278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e63bc-1095-4c7a-9d69-cf06df467a4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:29.527758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e63bc-1095-4c7a-9d69-cf06df467a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:29.529442 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e63bc-1095-4c7a-9d69-cf06df467a4f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7d9e63bc-1095-4c7a-9d69-cf06df467a4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:29.545919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:29.547280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:29.548213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:29.548213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:29.548213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:29.548213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 444/868] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:29.553350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47739b-4bd0-45d4-a84f-627a4d088a5c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:29.657714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47739b-4bd0-45d4-a84f-627a4d088a5c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:29.693741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f8c95-7dc1-4287-a225-e88305cbf98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:29.694769 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f8c95-7dc1-4287-a225-e88305cbf98d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:29.695267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f8c95-7dc1-4287-a225-e88305cbf98d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:29.695780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f8c95-7dc1-4287-a225-e88305cbf98d None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:29.695885 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd70ef-0a6a-45d8-bd8a-de947c5e373f None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:29.696196 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd70ef-0a6a-45d8-bd8a-de947c5e373f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:29.696471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd70ef-0a6a-45d8-bd8a-de947c5e373f None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:29.697151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f8c95-7dc1-4287-a225-e88305cbf98d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:29.697639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f8c95-7dc1-4287-a225-e88305cbf98d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:29.697817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 445/869] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:57:29.699442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f8c95-7dc1-4287-a225-e88305cbf98d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:29.702638 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e899f-fcea-43fa-8a66-16c8b5b45cae None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:29.702921 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e899f-fcea-43fa-8a66-16c8b5b45cae None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:29.703191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e899f-fcea-43fa-8a66-16c8b5b45cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:29.714995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 425/870] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:29.720511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f8c95-7dc1-4287-a225-e88305cbf98d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:29.725430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-458e899f-fcea-43fa-8a66-16c8b5b45cae None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:29.726624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-458e899f-fcea-43fa-8a66-16c8b5b45cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:29.732139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:29.799681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 446/871] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:29.812389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e899f-fcea-43fa-8a66-16c8b5b45cae None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:29.844395 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f8c95-7dc1-4287-a225-e88305cbf98d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:29.889788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bc205-48d7-480a-bb7c-2b0080ee8718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:29.890453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bc205-48d7-480a-bb7c-2b0080ee8718 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:29.890728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bc205-48d7-480a-bb7c-2b0080ee8718 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:29.891006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bc205-48d7-480a-bb7c-2b0080ee8718 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:29.900413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bc205-48d7-480a-bb7c-2b0080ee8718 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:29.902484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bc205-48d7-480a-bb7c-2b0080ee8718 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:29.906310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:29.915817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-ba9bc205-48d7-480a-bb7c-2b0080ee8718 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:29.915817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:29.915817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:29.915817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:29.915817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:29.915817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:29.915817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:29.915817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:29.915817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:29.915817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:29.915817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:29.915817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:29.915817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:29.915817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:29.915817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:29.916965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:29.918093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:29.918093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:29.918093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:29.918093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:29.918093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:29.918093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:29.918093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:29.918093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:29.920103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 426/872] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:29.925263 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bc205-48d7-480a-bb7c-2b0080ee8718 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:29.940707 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e899f-fcea-43fa-8a66-16c8b5b45cae None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:29.977991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be8735-e667-49f4-99b5-d4a06ff732da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:29.978602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be8735-e667-49f4-99b5-d4a06ff732da None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:29.979006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be8735-e667-49f4-99b5-d4a06ff732da None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:29.979304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be8735-e667-49f4-99b5-d4a06ff732da None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:29.979972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be8735-e667-49f4-99b5-d4a06ff732da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:29.981830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be8735-e667-49f4-99b5-d4a06ff732da None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:30.011077 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 447/873] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Aug 30 04:57:29 2022] POST /identity/v3/services => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:30.017446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:30.061652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bc205-48d7-480a-bb7c-2b0080ee8718 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:30.077462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be8735-e667-49f4-99b5-d4a06ff732da None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:30.109792 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2e272-cb29-49ea-9276-9ef96b6bf682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:30.110841 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2e272-cb29-49ea-9276-9ef96b6bf682 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:30.111316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2e272-cb29-49ea-9276-9ef96b6bf682 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:30.111778 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2e272-cb29-49ea-9276-9ef96b6bf682 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:30.112712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2e272-cb29-49ea-9276-9ef96b6bf682 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:30.113214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2e272-cb29-49ea-9276-9ef96b6bf682 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:30.114967 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2e272-cb29-49ea-9276-9ef96b6bf682 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:30.129517 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 427/874] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:30.139999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2e272-cb29-49ea-9276-9ef96b6bf682 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:30.223125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be8735-e667-49f4-99b5-d4a06ff732da None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:30.259480 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:30.265898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8857ace-bc18-49ea-96b6-779512b44f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:30.266657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8857ace-bc18-49ea-96b6-779512b44f10 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:30.267271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8857ace-bc18-49ea-96b6-779512b44f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:30.267856 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8857ace-bc18-49ea-96b6-779512b44f10 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:30.269124 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8857ace-bc18-49ea-96b6-779512b44f10 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:30.271113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8857ace-bc18-49ea-96b6-779512b44f10 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:30.287164 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2e272-cb29-49ea-9276-9ef96b6bf682 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:30.293609 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 448/875] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Aug 30 04:57:30 2022] POST /identity/v3/services => generated 269 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:30.321023 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:30.344715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6ea65-0df0-4633-aaec-742a8f6de3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:30.345394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6ea65-0df0-4633-aaec-742a8f6de3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:30.345673 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6ea65-0df0-4633-aaec-742a8f6de3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:30.345960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6ea65-0df0-4633-aaec-742a8f6de3e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:30.346782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6ea65-0df0-4633-aaec-742a8f6de3e2 None admin] RBAC: Adding query filter params (role.id=2381dab0bb194ddfaf31c2933c683b71, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=487fc3d8ac924be0a1d66ae8ca49f76c) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:30.347146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6ea65-0df0-4633-aaec-742a8f6de3e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:30.348743 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6ea65-0df0-4633-aaec-742a8f6de3e2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:30.356806 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 428/876] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:57:30 2022] GET /identity/v3/role_assignments?user.id=487fc3d8ac924be0a1d66ae8ca49f76c&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=2381dab0bb194ddfaf31c2933c683b71 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:31.455355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287a2d1-dd9c-4946-b8bb-8ee9ef4422af None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:31.455875 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287a2d1-dd9c-4946-b8bb-8ee9ef4422af None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:31.455875 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287a2d1-dd9c-4946-b8bb-8ee9ef4422af None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:31.457656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 449/877] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:31.463686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b20dc-786d-4a75-bf99-67c3e5332aaf None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:31.464128 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b20dc-786d-4a75-bf99-67c3e5332aaf None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:31.464307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b20dc-786d-4a75-bf99-67c3e5332aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:31.482670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0d5b20dc-786d-4a75-bf99-67c3e5332aaf None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:31.483859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0d5b20dc-786d-4a75-bf99-67c3e5332aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:31.560135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 429/878] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:31.823308 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287a2d1-dd9c-4946-b8bb-8ee9ef4422af None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:31.929491 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287a2d1-dd9c-4946-b8bb-8ee9ef4422af None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:31.966446 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8e3fc-c0bf-4404-8315-87031b49662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:31.967073 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8e3fc-c0bf-4404-8315-87031b49662a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:31.967350 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8e3fc-c0bf-4404-8315-87031b49662a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:31.967628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8e3fc-c0bf-4404-8315-87031b49662a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:31.968232 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8e3fc-c0bf-4404-8315-87031b49662a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:31.969595 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8e3fc-c0bf-4404-8315-87031b49662a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-05a8e3fc-c0bf-4404-8315-87031b49662a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:31.978597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:31.980363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:31.982042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:31.982042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:31.982042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:31.982042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:31.982042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:31.982042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:31.982042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:31.982042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:31.982042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:31.982042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:31.982042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:31.982042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:31.982042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:57:31.982042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:31.990474 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 450/879] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Aug 30 04:57:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:31.991358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b20dc-786d-4a75-bf99-67c3e5332aaf None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:32.048293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e715c8e-db18-4ca7-b4a5-17f228ac238d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:32.049031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e715c8e-db18-4ca7-b4a5-17f228ac238d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:32.049307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e715c8e-db18-4ca7-b4a5-17f228ac238d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:32.051337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 451/880] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:32.056100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fc44c-60dd-44f8-9cfb-2691ef46f959 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:32.056505 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fc44c-60dd-44f8-9cfb-2691ef46f959 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:32.056876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fc44c-60dd-44f8-9cfb-2691ef46f959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:32.080393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b46fc44c-60dd-44f8-9cfb-2691ef46f959 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:32.082087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b46fc44c-60dd-44f8-9cfb-2691ef46f959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:32.108137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b20dc-786d-4a75-bf99-67c3e5332aaf None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:32.122303 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:32.147213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275b8f1-b35e-4c98-999e-3b945aeb13c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:32.147940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275b8f1-b35e-4c98-999e-3b945aeb13c7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:32.148246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275b8f1-b35e-4c98-999e-3b945aeb13c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:32.148520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275b8f1-b35e-4c98-999e-3b945aeb13c7 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:32.149533 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:32.149785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275b8f1-b35e-4c98-999e-3b945aeb13c7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:32.150093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275b8f1-b35e-4c98-999e-3b945aeb13c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:32.151467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275b8f1-b35e-4c98-999e-3b945aeb13c7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:32.156758 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 430/881] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Aug 30 04:57:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:32.163089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275b8f1-b35e-4c98-999e-3b945aeb13c7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:32.172895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 452/882] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:32.273220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275b8f1-b35e-4c98-999e-3b945aeb13c7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:32.287592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ee6d9-c124-498c-a473-a31794eb1581 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:32.287891 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ee6d9-c124-498c-a473-a31794eb1581 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:32.288185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ee6d9-c124-498c-a473-a31794eb1581 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:32.290671 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 453/883] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:57:32.297465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365f291-843a-4b0f-a8d3-713eb04d4e3d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:32.297465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365f291-843a-4b0f-a8d3-713eb04d4e3d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:32.297465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365f291-843a-4b0f-a8d3-713eb04d4e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:32.315390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34e014-e58c-4aea-9a04-ff9babd50e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:32.316022 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34e014-e58c-4aea-9a04-ff9babd50e29 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:32.316303 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34e014-e58c-4aea-9a04-ff9babd50e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:32.316569 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34e014-e58c-4aea-9a04-ff9babd50e29 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:32.317209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34e014-e58c-4aea-9a04-ff9babd50e29 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:32.317491 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34e014-e58c-4aea-9a04-ff9babd50e29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:32.318536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3365f291-843a-4b0f-a8d3-713eb04d4e3d None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:32.318851 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34e014-e58c-4aea-9a04-ff9babd50e29 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:32.320256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3365f291-843a-4b0f-a8d3-713eb04d4e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:32.324456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 431/884] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Aug 30 04:57:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:32.403199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 454/885] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:32.459830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f263f-2857-425b-9821-e9fc8002c8d8 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:32.460517 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f263f-2857-425b-9821-e9fc8002c8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:32.461014 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f263f-2857-425b-9821-e9fc8002c8d8 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:32.462735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 432/886] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:32.468973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02c6c3-8125-4b73-9772-e0171cc64647 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:32.470292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02c6c3-8125-4b73-9772-e0171cc64647 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:32.470847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02c6c3-8125-4b73-9772-e0171cc64647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:32.480502 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f263f-2857-425b-9821-e9fc8002c8d8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:32.491677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bf02c6c3-8125-4b73-9772-e0171cc64647 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:32.493503 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bf02c6c3-8125-4b73-9772-e0171cc64647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:32.551772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:32.573044 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 455/887] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:32.621411 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f263f-2857-425b-9821-e9fc8002c8d8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:32.657644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aef1e8-6a6c-4b8a-8afd-3f761d481812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:32.658204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aef1e8-6a6c-4b8a-8afd-3f761d481812 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:32.658479 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aef1e8-6a6c-4b8a-8afd-3f761d481812 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:32.658747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aef1e8-6a6c-4b8a-8afd-3f761d481812 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:32.659328 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aef1e8-6a6c-4b8a-8afd-3f761d481812 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:32.660716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aef1e8-6a6c-4b8a-8afd-3f761d481812 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-80aef1e8-6a6c-4b8a-8afd-3f761d481812 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:32.671251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:32.672309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:32.673175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:32.673175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:32.673175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:32.673175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:32.673175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:32.673175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:32.673175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:32.673175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:32.673175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:32.673175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:32.673175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:32.673175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:32.673175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:57:32.673175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:32.673175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 433/888] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:57:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:32.678508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02c6c3-8125-4b73-9772-e0171cc64647 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:32.685128 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aef1e8-6a6c-4b8a-8afd-3f761d481812 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:32.741413 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:32.795692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aef1e8-6a6c-4b8a-8afd-3f761d481812 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:32.799136 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:32.826743 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02c6c3-8125-4b73-9772-e0171cc64647 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:32.835406 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c075-5807-406d-9797-22eefe0de0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:32.836402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c075-5807-406d-9797-22eefe0de0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:32.836880 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c075-5807-406d-9797-22eefe0de0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:32.837375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c075-5807-406d-9797-22eefe0de0f7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:32.838150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3c075-5807-406d-9797-22eefe0de0f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:32.839706 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3c075-5807-406d-9797-22eefe0de0f7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-aff3c075-5807-406d-9797-22eefe0de0f7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:32.849283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:32.850233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:32.851126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:32.851126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:32.851126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:32.851126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:32.851126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:32.851126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:32.851126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:32.851126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:32.851126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:32.851126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:32.851126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:32.851126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:32.851126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:57:32.851126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:32.859056 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 434/889] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Aug 30 04:57:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:32.860192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c075-5807-406d-9797-22eefe0de0f7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:32.867471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f4949-ff3f-4fba-94c4-61d35d784228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:32.868115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f4949-ff3f-4fba-94c4-61d35d784228 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:32.868395 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f4949-ff3f-4fba-94c4-61d35d784228 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:32.868668 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f4949-ff3f-4fba-94c4-61d35d784228 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:32.869346 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f4949-ff3f-4fba-94c4-61d35d784228 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:32.869695 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f4949-ff3f-4fba-94c4-61d35d784228 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:32.871517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f4949-ff3f-4fba-94c4-61d35d784228 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:32.877230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 456/890] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:57:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:32.883631 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f4949-ff3f-4fba-94c4-61d35d784228 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:32.971794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c075-5807-406d-9797-22eefe0de0f7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:32.998324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f4949-ff3f-4fba-94c4-61d35d784228 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:33.011327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:33.015903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fe965-c807-4c35-bf4b-edfac59cd48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:33.016474 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe965-c807-4c35-bf4b-edfac59cd48f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:33.016746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe965-c807-4c35-bf4b-edfac59cd48f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:33.017124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe965-c807-4c35-bf4b-edfac59cd48f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:33.029712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fe965-c807-4c35-bf4b-edfac59cd48f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1f2fe965-c807-4c35-bf4b-edfac59cd48f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:33.036903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:33.040867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:33.041693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:33.041693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:33.041693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:33.041693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:33.041693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:33.041693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:33.041693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:33.041693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:33.041693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:33.041693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:33.041693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:57:33.041693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:33.041693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 435/891] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Aug 30 04:57:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:33.041693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fe965-c807-4c35-bf4b-edfac59cd48f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:33.042440 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a4a83-ac7d-4909-a518-bb6097480a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:33.042440 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4a83-ac7d-4909-a518-bb6097480a32 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:33.042440 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4a83-ac7d-4909-a518-bb6097480a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:33.042440 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4a83-ac7d-4909-a518-bb6097480a32 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:33.042705 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a4a83-ac7d-4909-a518-bb6097480a32 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:33.042705 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a4a83-ac7d-4909-a518-bb6097480a32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:33.043923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a4a83-ac7d-4909-a518-bb6097480a32 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:33.055148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 457/892] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Aug 30 04:57:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:33.055148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a4a83-ac7d-4909-a518-bb6097480a32 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:33.074106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:33.161872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fe965-c807-4c35-bf4b-edfac59cd48f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:33.162374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a4a83-ac7d-4909-a518-bb6097480a32 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:33.198669 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f8953-7ffe-4c7d-9a83-f27a8d8549c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:33.199279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f8953-7ffe-4c7d-9a83-f27a8d8549c8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:33.199549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f8953-7ffe-4c7d-9a83-f27a8d8549c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:33.199796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2157c-2406-48aa-a13c-ec07f4b9f09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:33.199908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f8953-7ffe-4c7d-9a83-f27a8d8549c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:33.200486 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f8953-7ffe-4c7d-9a83-f27a8d8549c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:33.200611 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2157c-2406-48aa-a13c-ec07f4b9f09d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:33.200784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f8953-7ffe-4c7d-9a83-f27a8d8549c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:33.200879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2157c-2406-48aa-a13c-ec07f4b9f09d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:33.201204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2157c-2406-48aa-a13c-ec07f4b9f09d None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:33.201908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2157c-2406-48aa-a13c-ec07f4b9f09d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:33.202126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f8953-7ffe-4c7d-9a83-f27a8d8549c8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:33.202314 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2157c-2406-48aa-a13c-ec07f4b9f09d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:33.203745 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2157c-2406-48aa-a13c-ec07f4b9f09d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:33.209195 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 436/893] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:57:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:33.210103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2157c-2406-48aa-a13c-ec07f4b9f09d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:33.220709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 458/894] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Aug 30 04:57:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:33.221774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f8953-7ffe-4c7d-9a83-f27a8d8549c8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:33.262161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:33.323812 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:33.333499 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f8953-7ffe-4c7d-9a83-f27a8d8549c8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:33.338423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2157c-2406-48aa-a13c-ec07f4b9f09d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:33.371166 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6670e9-4892-4981-9f2c-119795a02dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:33.371786 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6670e9-4892-4981-9f2c-119795a02dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:33.372066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6670e9-4892-4981-9f2c-119795a02dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:33.372337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6670e9-4892-4981-9f2c-119795a02dd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:33.373031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6670e9-4892-4981-9f2c-119795a02dd7 None admin] RBAC: Adding query filter params (interface=public, service_id=45dcafbbb0794f539af514d4826bc44a, region_id=RegionOne) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:33.373333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6670e9-4892-4981-9f2c-119795a02dd7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:33.374879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6670e9-4892-4981-9f2c-119795a02dd7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:33.385050 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 459/895] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Aug 30 04:57:33 2022] GET /identity/v3/endpoints?service_id=45dcafbbb0794f539af514d4826bc44a&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:33.385050 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6670e9-4892-4981-9f2c-119795a02dd7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:33.387513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b009aad-464d-403f-af2a-c98f206f810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:33.388379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b009aad-464d-403f-af2a-c98f206f810a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:33.388737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b009aad-464d-403f-af2a-c98f206f810a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:33.389123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b009aad-464d-403f-af2a-c98f206f810a None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:33.390010 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b009aad-464d-403f-af2a-c98f206f810a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:33.390450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b009aad-464d-403f-af2a-c98f206f810a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:33.392531 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b009aad-464d-403f-af2a-c98f206f810a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:33.400191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 437/896] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Aug 30 04:57:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:33.401345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b009aad-464d-403f-af2a-c98f206f810a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:33.507450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:33.511126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6670e9-4892-4981-9f2c-119795a02dd7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:33.520884 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b009aad-464d-403f-af2a-c98f206f810a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:33.548362 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c782e-ec3f-4715-97aa-4c88ae2e7f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:33.549246 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c782e-ec3f-4715-97aa-4c88ae2e7f94 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:33.549535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c782e-ec3f-4715-97aa-4c88ae2e7f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:33.549805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c782e-ec3f-4715-97aa-4c88ae2e7f94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:33.561858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c782e-ec3f-4715-97aa-4c88ae2e7f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:33.564016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c782e-ec3f-4715-97aa-4c88ae2e7f94 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:33.568128 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860505fd-556c-41f2-878f-1d5c3759d4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:33.568869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860505fd-556c-41f2-878f-1d5c3759d4ae None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:33.569295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860505fd-556c-41f2-878f-1d5c3759d4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:33.569622 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860505fd-556c-41f2-878f-1d5c3759d4ae None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:33.570504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860505fd-556c-41f2-878f-1d5c3759d4ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:33.572810 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860505fd-556c-41f2-878f-1d5c3759d4ae None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:33.588760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 438/897] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Aug 30 04:57:33 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:57:33.588760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860505fd-556c-41f2-878f-1d5c3759d4ae None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-281c782e-ec3f-4715-97aa-4c88ae2e7f94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:33.589086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:33.590011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:33.591826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:33.591826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:33.591826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:33.591826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 460/898] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:33.598229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c782e-ec3f-4715-97aa-4c88ae2e7f94 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:33.626693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:33.729208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860505fd-556c-41f2-878f-1d5c3759d4ae None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:33.734666 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c782e-ec3f-4715-97aa-4c88ae2e7f94 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:33.775172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ca9d9-d02c-49af-8a35-3996869bc66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:33.775172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ca9d9-d02c-49af-8a35-3996869bc66c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:33.775172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ca9d9-d02c-49af-8a35-3996869bc66c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:33.775610 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ca9d9-d02c-49af-8a35-3996869bc66c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:33.776174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ca9d9-d02c-49af-8a35-3996869bc66c None admin] RBAC: Adding query filter params (interface=public, service_id=bfb19c31023a46b0afb31e658aff529d, region_id=RegionOne) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:33.778677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ca9d9-d02c-49af-8a35-3996869bc66c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:33.778677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ca9d9-d02c-49af-8a35-3996869bc66c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:33.783562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d3f1d-1d62-47e6-b542-4dd683794755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:33.784210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d3f1d-1d62-47e6-b542-4dd683794755 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:33.784486 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d3f1d-1d62-47e6-b542-4dd683794755 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:33.784755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d3f1d-1d62-47e6-b542-4dd683794755 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:33.785393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d3f1d-1d62-47e6-b542-4dd683794755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:33.785691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d3f1d-1d62-47e6-b542-4dd683794755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:33.785912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 439/899] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Aug 30 04:57:33 2022] GET /identity/v3/endpoints?service_id=bfb19c31023a46b0afb31e658aff529d&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:33.787058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d3f1d-1d62-47e6-b542-4dd683794755 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:33.794021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ca9d9-d02c-49af-8a35-3996869bc66c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:33.805987 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 461/900] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:33.811915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d3f1d-1d62-47e6-b542-4dd683794755 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:33.829095 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:33.901483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:33.921685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ca9d9-d02c-49af-8a35-3996869bc66c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:33.959462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d3f1d-1d62-47e6-b542-4dd683794755 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:33.965279 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf3722-9eb5-4ee2-8954-222e275754a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:33.966167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf3722-9eb5-4ee2-8954-222e275754a0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:33.966642 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf3722-9eb5-4ee2-8954-222e275754a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:33.967051 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf3722-9eb5-4ee2-8954-222e275754a0 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:33.967850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf3722-9eb5-4ee2-8954-222e275754a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:33.969627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf3722-9eb5-4ee2-8954-222e275754a0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:33.984116 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 440/901] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Aug 30 04:57:33 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:57:34.011332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47079f32-ff4f-4d42-a75a-0ebcea7f2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:34.012016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079f32-ff4f-4d42-a75a-0ebcea7f2da6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:34.012297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079f32-ff4f-4d42-a75a-0ebcea7f2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:34.012567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079f32-ff4f-4d42-a75a-0ebcea7f2da6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:34.021144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47079f32-ff4f-4d42-a75a-0ebcea7f2da6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:34.022613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47079f32-ff4f-4d42-a75a-0ebcea7f2da6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-47079f32-ff4f-4d42-a75a-0ebcea7f2da6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:34.036904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:34.037883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:34.038809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:34.038809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:34.038809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:34.038809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:34.038809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:34.038809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:34.038809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:34.038809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:34.038809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:57:34.038809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:34.038809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 462/902] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Aug 30 04:57:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:34.046275 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf3722-9eb5-4ee2-8954-222e275754a0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:34.163644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf3722-9eb5-4ee2-8954-222e275754a0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:34.199550 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd228d2-2e41-456e-a065-471d0c6460f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:34.200177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd228d2-2e41-456e-a065-471d0c6460f5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:34.200450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd228d2-2e41-456e-a065-471d0c6460f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:34.200717 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd228d2-2e41-456e-a065-471d0c6460f5 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:34.201444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd228d2-2e41-456e-a065-471d0c6460f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:34.201744 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd228d2-2e41-456e-a065-471d0c6460f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:34.203274 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd228d2-2e41-456e-a065-471d0c6460f5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:34.223559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 441/903] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Aug 30 04:57:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:34.229888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47079f32-ff4f-4d42-a75a-0ebcea7f2da6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:34.310549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:34.344968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47079f32-ff4f-4d42-a75a-0ebcea7f2da6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:34.383575 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88545fbd-650d-47e7-bd0b-a11d7f323218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:34.384662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88545fbd-650d-47e7-bd0b-a11d7f323218 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:34.385172 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88545fbd-650d-47e7-bd0b-a11d7f323218 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:34.385701 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88545fbd-650d-47e7-bd0b-a11d7f323218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:34.404284 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddb666-bb9c-4bd2-9336-c90680db89c5 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:34.404630 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddb666-bb9c-4bd2-9336-c90680db89c5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:34.404839 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddb666-bb9c-4bd2-9336-c90680db89c5 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:34.406525 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 442/904] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:34.412037 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ab6ff-2987-40ea-a236-e4bf880c5194 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:34.412323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ab6ff-2987-40ea-a236-e4bf880c5194 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:34.412597 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ab6ff-2987-40ea-a236-e4bf880c5194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:34.431415 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:34.438726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-783ab6ff-2987-40ea-a236-e4bf880c5194 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:34.439931 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-783ab6ff-2987-40ea-a236-e4bf880c5194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:34.465271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88545fbd-650d-47e7-bd0b-a11d7f323218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:34.466796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88545fbd-650d-47e7-bd0b-a11d7f323218 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:34.518719 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 443/905] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:34.546877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:34.581308 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 463/906] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:34 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:57:34.587170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ab6ff-2987-40ea-a236-e4bf880c5194 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:34.691294 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ab6ff-2987-40ea-a236-e4bf880c5194 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:34.727632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fcc79-d843-429c-89b5-07064e3e17e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:34.728585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fcc79-d843-429c-89b5-07064e3e17e1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:34.729074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fcc79-d843-429c-89b5-07064e3e17e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:34.729523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fcc79-d843-429c-89b5-07064e3e17e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:34.732532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:34.740996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fcc79-d843-429c-89b5-07064e3e17e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:34.743020 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fcc79-d843-429c-89b5-07064e3e17e1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-c53fcc79-d843-429c-89b5-07064e3e17e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:34.759027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:34.760044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:34.760969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:34.760969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:34.760969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:34.760969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 444/907] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:34.767187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88545fbd-650d-47e7-bd0b-a11d7f323218 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:34.813617 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fcc79-d843-429c-89b5-07064e3e17e1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:34.875836 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88545fbd-650d-47e7-bd0b-a11d7f323218 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:34.917393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce53c0-35a1-43f8-8a3e-f95421ec7bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:34.918506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce53c0-35a1-43f8-8a3e-f95421ec7bcb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:34.918782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce53c0-35a1-43f8-8a3e-f95421ec7bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:34.919180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce53c0-35a1-43f8-8a3e-f95421ec7bcb None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:34.919975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce53c0-35a1-43f8-8a3e-f95421ec7bcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:34.920293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce53c0-35a1-43f8-8a3e-f95421ec7bcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:34.922348 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce53c0-35a1-43f8-8a3e-f95421ec7bcb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:34.936230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fcc79-d843-429c-89b5-07064e3e17e1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:34.940045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 464/908] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:34.942858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce53c0-35a1-43f8-8a3e-f95421ec7bcb None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:35.001150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:35.013014 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e72eb3-5189-4717-a12b-52db4313d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:35.013014 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e72eb3-5189-4717-a12b-52db4313d421 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:35.013312 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e72eb3-5189-4717-a12b-52db4313d421 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:35.013594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e72eb3-5189-4717-a12b-52db4313d421 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:35.017443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e72eb3-5189-4717-a12b-52db4313d421 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:35.017443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e72eb3-5189-4717-a12b-52db4313d421 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:35.043977 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 445/909] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Aug 30 04:57:34 2022] POST /identity/v3/services => generated 241 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:57:35.145083 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce53c0-35a1-43f8-8a3e-f95421ec7bcb None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:35.192245 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2933f12-87ea-4747-8076-735e538466b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:35.192889 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2933f12-87ea-4747-8076-735e538466b6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:35.193164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2933f12-87ea-4747-8076-735e538466b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:35.193434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2933f12-87ea-4747-8076-735e538466b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:35.201953 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2933f12-87ea-4747-8076-735e538466b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:35.203484 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2933f12-87ea-4747-8076-735e538466b6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:35.216971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-e2933f12-87ea-4747-8076-735e538466b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:35.216971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:35.216971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:35.216971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:35.216971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:35.216971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:35.216971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:35.216971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:35.216971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:35.216971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:35.216971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:35.216971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:35.216971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:35.216971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:35.216971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:35.217977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:35.218892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:35.218892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:35.218892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:35.218892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:35.218892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:35.218892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:35.218892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:35.218892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:35.218892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 465/910] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:35.224488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e72eb3-5189-4717-a12b-52db4313d421 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:35.285055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:35.343081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e72eb3-5189-4717-a12b-52db4313d421 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:35.380121 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b7fb0-e29d-47ad-ac25-6f24e0af1111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:35.380819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b7fb0-e29d-47ad-ac25-6f24e0af1111 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:35.381212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b7fb0-e29d-47ad-ac25-6f24e0af1111 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:35.381549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b7fb0-e29d-47ad-ac25-6f24e0af1111 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:35.382268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b7fb0-e29d-47ad-ac25-6f24e0af1111 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:35.382682 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b7fb0-e29d-47ad-ac25-6f24e0af1111 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:35.384207 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b7fb0-e29d-47ad-ac25-6f24e0af1111 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:35.397534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 446/911] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:35.403417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2933f12-87ea-4747-8076-735e538466b6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:35.512082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:35.527136 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2933f12-87ea-4747-8076-735e538466b6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:35.565024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f918ef7-d509-4c17-9dc6-0fba65919e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:35.566455 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f918ef7-d509-4c17-9dc6-0fba65919e4a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:35.566940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f918ef7-d509-4c17-9dc6-0fba65919e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:35.567409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f918ef7-d509-4c17-9dc6-0fba65919e4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:35.568418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f918ef7-d509-4c17-9dc6-0fba65919e4a None admin] RBAC: Adding query filter params (role.id=4c2f9308c8fb42598460286c6520acb7, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=487fc3d8ac924be0a1d66ae8ca49f76c) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:35.568929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f918ef7-d509-4c17-9dc6-0fba65919e4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:35.570607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f918ef7-d509-4c17-9dc6-0fba65919e4a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:35.578409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 466/912] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:57:35 2022] GET /identity/v3/role_assignments?user.id=487fc3d8ac924be0a1d66ae8ca49f76c&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=4c2f9308c8fb42598460286c6520acb7 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:35.698427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651ab0-6d22-45c4-8f84-ae730189cccf None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:35.698943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651ab0-6d22-45c4-8f84-ae730189cccf None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:35.698943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651ab0-6d22-45c4-8f84-ae730189cccf None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:35.700620 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 447/913] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:35.706378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c89f4-0ec5-4fa4-8b85-9ff705562e0d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:35.706683 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c89f4-0ec5-4fa4-8b85-9ff705562e0d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:35.706941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c89f4-0ec5-4fa4-8b85-9ff705562e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:35.727129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0c5c89f4-0ec5-4fa4-8b85-9ff705562e0d None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:35.728401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0c5c89f4-0ec5-4fa4-8b85-9ff705562e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:35.802587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 467/914] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:36.079268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef651ab0-6d22-45c4-8f84-ae730189cccf None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:36.081647 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf6d9c-c999-4446-8370-3e671f2edded None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:36.081935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf6d9c-c999-4446-8370-3e671f2edded None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:36.082331 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf6d9c-c999-4446-8370-3e671f2edded None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:36.083824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 468/915] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:57:36.089096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20848a7f-ab21-4b4f-b17c-5d75becad188 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:36.089385 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20848a7f-ab21-4b4f-b17c-5d75becad188 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:36.089663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20848a7f-ab21-4b4f-b17c-5d75becad188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:36.108783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-20848a7f-ab21-4b4f-b17c-5d75becad188 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:36.109998 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-20848a7f-ab21-4b4f-b17c-5d75becad188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:36.184575 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 469/916] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:36.195040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef651ab0-6d22-45c4-8f84-ae730189cccf None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:36.206262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:36.235544 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edb028-b8d7-4f30-b4ca-59ddc8b9fc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:36.236135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edb028-b8d7-4f30-b4ca-59ddc8b9fc17 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:36.236417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edb028-b8d7-4f30-b4ca-59ddc8b9fc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:36.236689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edb028-b8d7-4f30-b4ca-59ddc8b9fc17 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:36.237278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edb028-b8d7-4f30-b4ca-59ddc8b9fc17 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:36.238698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edb028-b8d7-4f30-b4ca-59ddc8b9fc17 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-59edb028-b8d7-4f30-b4ca-59ddc8b9fc17 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:36.252416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:36.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:36.254655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:36.254655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:36.254655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:36.254655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:36.254655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:36.254655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:36.254655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:36.254655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:36.254655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:36.254655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:36.254655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:36.254655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:36.254655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:57:36.254655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:36.255400 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 448/917] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:57:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:36.265062 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20848a7f-ab21-4b4f-b17c-5d75becad188 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:36.281558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:36.380604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20848a7f-ab21-4b4f-b17c-5d75becad188 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:36.416447 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc44dd4-370e-4259-8198-5cdbf409214a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:36.417047 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc44dd4-370e-4259-8198-5cdbf409214a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:36.417324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc44dd4-370e-4259-8198-5cdbf409214a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:36.417593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc44dd4-370e-4259-8198-5cdbf409214a None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:36.418213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc44dd4-370e-4259-8198-5cdbf409214a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:36.418507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc44dd4-370e-4259-8198-5cdbf409214a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:36.419854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc44dd4-370e-4259-8198-5cdbf409214a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:36.425125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 470/918] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:57:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:36.431139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edb028-b8d7-4f30-b4ca-59ddc8b9fc17 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:36.512046 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc44dd4-370e-4259-8198-5cdbf409214a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:36.559331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edb028-b8d7-4f30-b4ca-59ddc8b9fc17 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:36.598776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cd0e7-b2ea-47d3-80bd-c44038b4e252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:36.599762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cd0e7-b2ea-47d3-80bd-c44038b4e252 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:36.600269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cd0e7-b2ea-47d3-80bd-c44038b4e252 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:36.600742 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cd0e7-b2ea-47d3-80bd-c44038b4e252 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:36.602264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cd0e7-b2ea-47d3-80bd-c44038b4e252 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:36.602774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cd0e7-b2ea-47d3-80bd-c44038b4e252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:36.604457 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cd0e7-b2ea-47d3-80bd-c44038b4e252 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:36.610158 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:36.610649 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 449/919] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Aug 30 04:57:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:36.616181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cd0e7-b2ea-47d3-80bd-c44038b4e252 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:36.641169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc44dd4-370e-4259-8198-5cdbf409214a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:36.660254 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:36.698195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283fadf-34f1-4528-a391-814da1106e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:36.699337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283fadf-34f1-4528-a391-814da1106e52 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:36.699736 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283fadf-34f1-4528-a391-814da1106e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:36.700238 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283fadf-34f1-4528-a391-814da1106e52 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:36.701269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283fadf-34f1-4528-a391-814da1106e52 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:36.703825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283fadf-34f1-4528-a391-814da1106e52 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-d283fadf-34f1-4528-a391-814da1106e52 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:36.720251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:36.721260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:36.722144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:36.722144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:36.722144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:36.722144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:36.722144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:36.722144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:36.722144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:36.722144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:36.722144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:36.722144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:36.722144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:36.722144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:36.722144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:57:36.722144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:36.728263 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 471/920] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Aug 30 04:57:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:36.732207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283fadf-34f1-4528-a391-814da1106e52 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:36.756014 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cd0e7-b2ea-47d3-80bd-c44038b4e252 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:36.800344 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4ffb7-cd1e-4c4b-9aba-de4c296fb0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:36.801298 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4ffb7-cd1e-4c4b-9aba-de4c296fb0c6 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:36.801777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4ffb7-cd1e-4c4b-9aba-de4c296fb0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:36.802246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4ffb7-cd1e-4c4b-9aba-de4c296fb0c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:36.803568 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4ffb7-cd1e-4c4b-9aba-de4c296fb0c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:36.805623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4ffb7-cd1e-4c4b-9aba-de4c296fb0c6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:36.830660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 450/921] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 04:57:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:36.903928 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283fadf-34f1-4528-a391-814da1106e52 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:36.973846 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1a990-f4e2-41a7-b61c-7c702b22667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:36.973846 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1a990-f4e2-41a7-b61c-7c702b22667b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:36.974154 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1a990-f4e2-41a7-b61c-7c702b22667b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:36.974415 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1a990-f4e2-41a7-b61c-7c702b22667b None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:36.975039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1a990-f4e2-41a7-b61c-7c702b22667b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:36.975340 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1a990-f4e2-41a7-b61c-7c702b22667b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:36.977310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1a990-f4e2-41a7-b61c-7c702b22667b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:36.988081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:36.993090 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 472/922] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Aug 30 04:57:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:36.999447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4ffb7-cd1e-4c4b-9aba-de4c296fb0c6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:37.105518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:37.116316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4ffb7-cd1e-4c4b-9aba-de4c296fb0c6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:37.153360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d4fdc-985a-45ef-8114-a984634e9da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:37.153962 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d4fdc-985a-45ef-8114-a984634e9da4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:37.154237 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d4fdc-985a-45ef-8114-a984634e9da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:37.154507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d4fdc-985a-45ef-8114-a984634e9da4 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:37.155135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d4fdc-985a-45ef-8114-a984634e9da4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:37.155432 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d4fdc-985a-45ef-8114-a984634e9da4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:37.156816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d4fdc-985a-45ef-8114-a984634e9da4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:37.162277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 451/923] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Aug 30 04:57:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:37.168914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1a990-f4e2-41a7-b61c-7c702b22667b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:37.230307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a06c7-6524-4b34-bcdb-d898bc09ece5 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:37.230664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a06c7-6524-4b34-bcdb-d898bc09ece5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:37.230852 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a06c7-6524-4b34-bcdb-d898bc09ece5 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:37.232479 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 452/924] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:57:37.237387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e748b9b-6c3f-4069-8f6c-e2124aee7d85 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:37.237662 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e748b9b-6c3f-4069-8f6c-e2124aee7d85 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:37.237932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e748b9b-6c3f-4069-8f6c-e2124aee7d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:37.256505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8e748b9b-6c3f-4069-8f6c-e2124aee7d85 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:37.257733 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8e748b9b-6c3f-4069-8f6c-e2124aee7d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:37.280650 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1a990-f4e2-41a7-b61c-7c702b22667b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:37.317133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a942479-ff93-440f-983e-5e8c82a69cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:37.318135 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a942479-ff93-440f-983e-5e8c82a69cf5 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:37.318615 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a942479-ff93-440f-983e-5e8c82a69cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:37.319085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a942479-ff93-440f-983e-5e8c82a69cf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:37.319967 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a942479-ff93-440f-983e-5e8c82a69cf5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:37.325945 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a942479-ff93-440f-983e-5e8c82a69cf5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:37.336225 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 453/925] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:37.355289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 473/926] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 04:57:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:37.539509 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b195b-2c43-4f4b-9fd2-50acb04ff284 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:37.539775 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b195b-2c43-4f4b-9fd2-50acb04ff284 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:37.539989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b195b-2c43-4f4b-9fd2-50acb04ff284 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:37.541578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 454/927] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:37.546449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fe7f1-ab58-4e7a-833b-65f6895f7229 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:37.546741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fe7f1-ab58-4e7a-833b-65f6895f7229 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:37.547018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fe7f1-ab58-4e7a-833b-65f6895f7229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:37.577080 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-651fe7f1-ab58-4e7a-833b-65f6895f7229 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:37.578393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-651fe7f1-ab58-4e7a-833b-65f6895f7229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:37.619275 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b195b-2c43-4f4b-9fd2-50acb04ff284 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:37.634475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:37.663995 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 474/928] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:37.717942 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:37.734829 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b195b-2c43-4f4b-9fd2-50acb04ff284 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:37.772368 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd8041-b007-4727-8774-4222585adb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:37.773844 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd8041-b007-4727-8774-4222585adb97 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:37.774332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd8041-b007-4727-8774-4222585adb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:37.774808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd8041-b007-4727-8774-4222585adb97 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:37.775618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd8041-b007-4727-8774-4222585adb97 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:37.777304 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd8041-b007-4727-8774-4222585adb97 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-bfdd8041-b007-4727-8774-4222585adb97 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:37.787006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:37.788156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:37.789106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:37.789106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:37.789106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:37.789106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:37.789106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:37.789106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:37.789106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:37.789106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:37.789106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:37.789106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:37.789106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:37.789106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:37.789106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:57:37.789106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:37.792016 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 455/929] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Aug 30 04:57:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:37.799675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fe7f1-ab58-4e7a-833b-65f6895f7229 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:37.913381 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fe7f1-ab58-4e7a-833b-65f6895f7229 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:37.949923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b898677-b22d-4c93-9c5d-493c2a1fa1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:37.951040 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b898677-b22d-4c93-9c5d-493c2a1fa1db None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:37.951587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b898677-b22d-4c93-9c5d-493c2a1fa1db None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:37.952097 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b898677-b22d-4c93-9c5d-493c2a1fa1db None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:37.952933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b898677-b22d-4c93-9c5d-493c2a1fa1db None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:37.953458 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b898677-b22d-4c93-9c5d-493c2a1fa1db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:37.955034 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b898677-b22d-4c93-9c5d-493c2a1fa1db None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:37.960561 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 475/930] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Aug 30 04:57:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:37.969106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd8041-b007-4727-8774-4222585adb97 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:37.990792 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b898677-b22d-4c93-9c5d-493c2a1fa1db None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:38.070091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:38.120854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd8041-b007-4727-8774-4222585adb97 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:38.144253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b898677-b22d-4c93-9c5d-493c2a1fa1db None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:38.168515 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafb088-f3d9-4090-8efa-8724f5ce26ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:38.169193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafb088-f3d9-4090-8efa-8724f5ce26ab None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:38.169477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafb088-f3d9-4090-8efa-8724f5ce26ab None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:38.169750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafb088-f3d9-4090-8efa-8724f5ce26ab None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:38.170384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafb088-f3d9-4090-8efa-8724f5ce26ab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:38.170687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafb088-f3d9-4090-8efa-8724f5ce26ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:38.172713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafb088-f3d9-4090-8efa-8724f5ce26ab None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:38.184111 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 456/931] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Aug 30 04:57:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:38.185766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafb088-f3d9-4090-8efa-8724f5ce26ab None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:38.194377 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780d4a9-4ff0-421a-ab5c-8a56b3b37e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:38.195061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780d4a9-4ff0-421a-ab5c-8a56b3b37e19 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:38.195873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780d4a9-4ff0-421a-ab5c-8a56b3b37e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:38.196205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780d4a9-4ff0-421a-ab5c-8a56b3b37e19 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:38.207415 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:38.208506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780d4a9-4ff0-421a-ab5c-8a56b3b37e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b780d4a9-4ff0-421a-ab5c-8a56b3b37e19 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:38.214081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:38.215043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:38.216271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:38.216271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:38.216271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:38.216271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:38.216271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:38.216271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:38.216271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:38.216271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:38.216271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:38.216271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:38.216271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:57:38.216271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:38.220136 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 476/932] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Aug 30 04:57:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:38.221489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780d4a9-4ff0-421a-ab5c-8a56b3b37e19 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:38.333634 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafb088-f3d9-4090-8efa-8724f5ce26ab None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:38.344002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780d4a9-4ff0-421a-ab5c-8a56b3b37e19 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:38.352286 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:38.381922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1e9d7-8f35-4776-ae5f-0fa3f0cb6231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:38.383416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69637c01-53c3-444b-a81f-0db73875f1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:38.383774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1e9d7-8f35-4776-ae5f-0fa3f0cb6231 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:38.384058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69637c01-53c3-444b-a81f-0db73875f1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:38.384333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69637c01-53c3-444b-a81f-0db73875f1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:38.384600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69637c01-53c3-444b-a81f-0db73875f1e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:38.384926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1e9d7-8f35-4776-ae5f-0fa3f0cb6231 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:38.385259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69637c01-53c3-444b-a81f-0db73875f1e8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:38.385558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69637c01-53c3-444b-a81f-0db73875f1e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:38.385803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1e9d7-8f35-4776-ae5f-0fa3f0cb6231 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:38.386713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1e9d7-8f35-4776-ae5f-0fa3f0cb6231 None admin] RBAC: Adding query filter params (interface=public, service_id=09e349d0be5044bc8f82da4147e3fc63, region_id=RegionOne) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:38.386922 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69637c01-53c3-444b-a81f-0db73875f1e8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:38.387419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1e9d7-8f35-4776-ae5f-0fa3f0cb6231 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:38.389946 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1e9d7-8f35-4776-ae5f-0fa3f0cb6231 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:38.401840 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 477/934] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Aug 30 04:57:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:38.402164 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 457/934] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Aug 30 04:57:38 2022] GET /identity/v3/endpoints?service_id=09e349d0be5044bc8f82da4147e3fc63&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:38.403076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69637c01-53c3-444b-a81f-0db73875f1e8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:38.403483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1e9d7-8f35-4776-ae5f-0fa3f0cb6231 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:38.519242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:38.523176 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69637c01-53c3-444b-a81f-0db73875f1e8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:38.556205 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1e9d7-8f35-4776-ae5f-0fa3f0cb6231 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:38.576557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21309982-a183-4298-bd33-616eb1e9d4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:38.577784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21309982-a183-4298-bd33-616eb1e9d4ba None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:38.578399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21309982-a183-4298-bd33-616eb1e9d4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:38.579038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21309982-a183-4298-bd33-616eb1e9d4ba None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:38.580219 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21309982-a183-4298-bd33-616eb1e9d4ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:38.582183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21309982-a183-4298-bd33-616eb1e9d4ba None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:38.589561 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 478/935] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Aug 30 04:57:38 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:57:38.609035 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa33a6-161c-4ecd-a6e8-61c5525bfe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:38.610096 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa33a6-161c-4ecd-a6e8-61c5525bfe27 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:38.610588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa33a6-161c-4ecd-a6e8-61c5525bfe27 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:38.611097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa33a6-161c-4ecd-a6e8-61c5525bfe27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:38.624193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa33a6-161c-4ecd-a6e8-61c5525bfe27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:38.626197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa33a6-161c-4ecd-a6e8-61c5525bfe27 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-92aa33a6-161c-4ecd-a6e8-61c5525bfe27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:38.643201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:38.644374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:38.645554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:38.645554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:38.645554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:38.648032 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 458/936] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:38.654371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21309982-a183-4298-bd33-616eb1e9d4ba None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:38.691497 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:38.778942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21309982-a183-4298-bd33-616eb1e9d4ba None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:38.815402 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e26d4-f612-42d4-a9fa-868faf8278fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:38.816047 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e26d4-f612-42d4-a9fa-868faf8278fa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:38.816327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e26d4-f612-42d4-a9fa-868faf8278fa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:38.816594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e26d4-f612-42d4-a9fa-868faf8278fa None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:38.817239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e26d4-f612-42d4-a9fa-868faf8278fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:38.817538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e26d4-f612-42d4-a9fa-868faf8278fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:38.818903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e26d4-f612-42d4-a9fa-868faf8278fa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:38.836754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 479/937] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:38.838606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa33a6-161c-4ecd-a6e8-61c5525bfe27 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:38.925552 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90d09c-a081-4b8c-a9bd-7b529092d0fa None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:38.925920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90d09c-a081-4b8c-a9bd-7b529092d0fa None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:38.926089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90d09c-a081-4b8c-a9bd-7b529092d0fa None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:38.928758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 480/938] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:38.933789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e51026-3695-452e-8d4f-342a34c9f03c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:38.934066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e51026-3695-452e-8d4f-342a34c9f03c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:38.934336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e51026-3695-452e-8d4f-342a34c9f03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:38.953686 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-54e51026-3695-452e-8d4f-342a34c9f03c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:38.954935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-54e51026-3695-452e-8d4f-342a34c9f03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:38.955334 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa33a6-161c-4ecd-a6e8-61c5525bfe27 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:38.998909 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:39.006474 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f8c9d-5745-4138-a87e-2d8cefb06d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:39.007121 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f8c9d-5745-4138-a87e-2d8cefb06d9e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:39.007401 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f8c9d-5745-4138-a87e-2d8cefb06d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:39.007709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f8c9d-5745-4138-a87e-2d8cefb06d9e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:39.017127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f8c9d-5745-4138-a87e-2d8cefb06d9e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:39.018877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f8c9d-5745-4138-a87e-2d8cefb06d9e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-5a9f8c9d-5745-4138-a87e-2d8cefb06d9e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:39.030815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:39.031859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:39.033127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:39.033127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:39.033127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:39.033127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:39.033127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:39.033127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:39.033127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:39.033127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:39.033127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:57:39.033127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:39.033127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 459/939] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Aug 30 04:57:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:39.038531 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f8c9d-5745-4138-a87e-2d8cefb06d9e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:39.050830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 481/940] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:39.149020 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f8c9d-5745-4138-a87e-2d8cefb06d9e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:39.186487 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d781d23-cf58-45d3-a43c-9fbcab6e35ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:39.187400 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d781d23-cf58-45d3-a43c-9fbcab6e35ba None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:39.187929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d781d23-cf58-45d3-a43c-9fbcab6e35ba None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:39.188441 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d781d23-cf58-45d3-a43c-9fbcab6e35ba None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:39.189369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d781d23-cf58-45d3-a43c-9fbcab6e35ba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:39.189922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d781d23-cf58-45d3-a43c-9fbcab6e35ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:39.191628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d781d23-cf58-45d3-a43c-9fbcab6e35ba None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:39.211631 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 460/941] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Aug 30 04:57:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:39.220048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e51026-3695-452e-8d4f-342a34c9f03c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:39.259914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:39.336265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d781d23-cf58-45d3-a43c-9fbcab6e35ba None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:39.341498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e51026-3695-452e-8d4f-342a34c9f03c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:39.382880 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce688c-0081-4083-ae9a-bbec2f9430b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:39.384161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce688c-0081-4083-ae9a-bbec2f9430b2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:39.384682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce688c-0081-4083-ae9a-bbec2f9430b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:39.385220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce688c-0081-4083-ae9a-bbec2f9430b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:39.393091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:39.398030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce688c-0081-4083-ae9a-bbec2f9430b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:39.400747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce688c-0081-4083-ae9a-bbec2f9430b2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-24ce688c-0081-4083-ae9a-bbec2f9430b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:39.420630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:39.421630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:39.422578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:39.422578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:39.422578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:39.422578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 482/942] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:39.427321 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce688c-0081-4083-ae9a-bbec2f9430b2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:39.455509 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d781d23-cf58-45d3-a43c-9fbcab6e35ba None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:39.493062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc6443-c655-45da-965d-6b1e7e114718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:39.493664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc6443-c655-45da-965d-6b1e7e114718 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:39.493939 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc6443-c655-45da-965d-6b1e7e114718 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:39.494199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc6443-c655-45da-965d-6b1e7e114718 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:39.494858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc6443-c655-45da-965d-6b1e7e114718 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:39.496310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc6443-c655-45da-965d-6b1e7e114718 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:39.498893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: WARNING keystone.server.flask.common [None req-f9fc6443-c655-45da-965d-6b1e7e114718 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 04:57:39.516703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.sql.core [None req-f9fc6443-c655-45da-965d-6b1e7e114718 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 04:57:39.516703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 04:57:39.516703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [parameters: {'id': '38fb925bc5b949488a45c60e7427cd3c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 04:57:39.516703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81675) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 04:57:39.518425 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:39.536373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f9fc6443-c655-45da-965d-6b1e7e114718 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 38fb925bc5b949488a45c60e7427cd3c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 38fb925bc5b949488a45c60e7427cd3c. Aug 30 04:57:39.536373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:39.536373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:57:39.536373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:57:39.536373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:57:39.536373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:57:39.536373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:57:39.536373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:57:39.536373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:57:39.536373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:57:39.536373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:57:39.536373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:57:39.536373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application result.read() Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 04:57:39.537266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application yield resource Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise self.value Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application session.commit() Aug 30 04:57:39.538276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self.session.flush() Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application compat.raise_( Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 04:57:39.539243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 04:57:39.541518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 04:57:39.541518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 04:57:39.541518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 04:57:39.541518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 04:57:39.541518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 04:57:39.541518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 04:57:39.541518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 04:57:39.541518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 04:57:39.541518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 04:57:39.541518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 04:57:39.541518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 04:57:39.541518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 04:57:39.541518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 04:57:39.541518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 04:57:39.541518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application result.read() Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:57:39.543768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:57:39.546566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:57:39.546566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:57:39.546566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:57:39.546566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:57:39.546566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:57:39.546566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:57:39.546566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 04:57:39.546566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 04:57:39.546566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [parameters: {'id': '38fb925bc5b949488a45c60e7427cd3c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 04:57:39.546566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 04:57:39.546566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:39.546566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:39.546566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:39.546566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:39.546566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:39.549337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:39.552021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:39.552021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 04:57:39.552021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 04:57:39.552021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:39.552021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:39.552021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 04:57:39.552021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 04:57:39.552021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 38fb925bc5b949488a45c60e7427cd3c. Aug 30 04:57:39.552021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:39.552021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 461/943] 10.222.0.48 () {60 vars in 1140 bytes} [Tue Aug 30 04:57:39 2022] POST /identity/v3/projects => generated 262 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:39.552021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2644f6e-95bf-4700-894c-d927897e1f99 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:39.552021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2644f6e-95bf-4700-894c-d927897e1f99 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:39.556070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2644f6e-95bf-4700-894c-d927897e1f99 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:39.556070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 462/944] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:39.556070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2644f6e-95bf-4700-894c-d927897e1f99 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:39.556544 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce688c-0081-4083-ae9a-bbec2f9430b2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:39.599059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288e03e-a386-44a7-ae26-04083d3d592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:39.599722 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288e03e-a386-44a7-ae26-04083d3d592b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:39.600031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288e03e-a386-44a7-ae26-04083d3d592b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:39.600307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288e03e-a386-44a7-ae26-04083d3d592b None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:39.600952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288e03e-a386-44a7-ae26-04083d3d592b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:39.603108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288e03e-a386-44a7-ae26-04083d3d592b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:39.604362 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288e03e-a386-44a7-ae26-04083d3d592b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:39.621572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 483/945] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:39.623053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e578b-4d1d-46f3-b4c8-75a8b469aedc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:39.623470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e578b-4d1d-46f3-b4c8-75a8b469aedc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:39.623960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e578b-4d1d-46f3-b4c8-75a8b469aedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:39.647837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-538e578b-4d1d-46f3-b4c8-75a8b469aedc None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:39.649173 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-538e578b-4d1d-46f3-b4c8-75a8b469aedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:39.678120 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2644f6e-95bf-4700-894c-d927897e1f99 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:39.681544 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:39.718644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec194282-08a9-4748-a2fc-2b1b9bd6075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:39.719306 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec194282-08a9-4748-a2fc-2b1b9bd6075d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:39.719652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec194282-08a9-4748-a2fc-2b1b9bd6075d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:39.720056 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec194282-08a9-4748-a2fc-2b1b9bd6075d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:39.723123 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 484/946] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:39.724067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e578b-4d1d-46f3-b4c8-75a8b469aedc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:39.737479 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec194282-08a9-4748-a2fc-2b1b9bd6075d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:39.739423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec194282-08a9-4748-a2fc-2b1b9bd6075d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:39.752220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-ec194282-08a9-4748-a2fc-2b1b9bd6075d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:39.752220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:39.752220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:39.752220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:39.752220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:39.752220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:39.752220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:39.752220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:39.752220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:39.752220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:39.752220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:39.752220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:39.752220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:39.752220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:39.752220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:39.753596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:39.754661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:39.754661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:39.754661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:39.754661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:39.754661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:39.754661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:39.754661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:39.754661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:39.756893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 463/947] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:39.763064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec194282-08a9-4748-a2fc-2b1b9bd6075d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:39.816315 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:39.863914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e578b-4d1d-46f3-b4c8-75a8b469aedc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:39.889184 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec194282-08a9-4748-a2fc-2b1b9bd6075d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:39.903096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f54d17-5fcb-40b4-88c1-7be9a360bfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:39.903917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f54d17-5fcb-40b4-88c1-7be9a360bfc7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:39.904326 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f54d17-5fcb-40b4-88c1-7be9a360bfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:39.904851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f54d17-5fcb-40b4-88c1-7be9a360bfc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:39.912564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f54d17-5fcb-40b4-88c1-7be9a360bfc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:39.914334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f54d17-5fcb-40b4-88c1-7be9a360bfc7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:39.928720 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d4258-e796-43e1-a544-7bf2ed5e4715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:39.928973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-d6f54d17-5fcb-40b4-88c1-7be9a360bfc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:39.928973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:39.928973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:39.928973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:39.928973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:39.928973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:39.928973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:39.928973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:39.928973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:39.928973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:39.928973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:39.928973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:39.928973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:39.928973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:39.928973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:39.930261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:39.931504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:39.931504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:39.931504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:39.931504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:39.931504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:39.931504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:39.931504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:39.931504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:39.933270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d4258-e796-43e1-a544-7bf2ed5e4715 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:39.933652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 485/948] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:39.934161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d4258-e796-43e1-a544-7bf2ed5e4715 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:39.934308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d4258-e796-43e1-a544-7bf2ed5e4715 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:39.935013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d4258-e796-43e1-a544-7bf2ed5e4715 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:39.935320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d4258-e796-43e1-a544-7bf2ed5e4715 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:39.940007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d4258-e796-43e1-a544-7bf2ed5e4715 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:39.945665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f54d17-5fcb-40b4-88c1-7be9a360bfc7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:39.957385 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 464/949] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Aug 30 04:57:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:40.005156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d4258-e796-43e1-a544-7bf2ed5e4715 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:40.036572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:40.098439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f54d17-5fcb-40b4-88c1-7be9a360bfc7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:40.135658 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:40.146451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d4258-e796-43e1-a544-7bf2ed5e4715 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:40.160968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95f6e2-3cf9-473b-b0d6-5535d61baa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:40.161682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95f6e2-3cf9-473b-b0d6-5535d61baa97 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:40.161682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95f6e2-3cf9-473b-b0d6-5535d61baa97 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:40.161869 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95f6e2-3cf9-473b-b0d6-5535d61baa97 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:40.162516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95f6e2-3cf9-473b-b0d6-5535d61baa97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:40.162826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95f6e2-3cf9-473b-b0d6-5535d61baa97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:40.165114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95f6e2-3cf9-473b-b0d6-5535d61baa97 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:40.178548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 486/950] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:40.184877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95f6e2-3cf9-473b-b0d6-5535d61baa97 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:40.203679 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668ca61-e3a5-433e-947a-c3f70d659d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:40.204452 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668ca61-e3a5-433e-947a-c3f70d659d4d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:40.204727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668ca61-e3a5-433e-947a-c3f70d659d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:40.205294 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668ca61-e3a5-433e-947a-c3f70d659d4d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:40.206068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668ca61-e3a5-433e-947a-c3f70d659d4d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:40.207124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668ca61-e3a5-433e-947a-c3f70d659d4d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-2668ca61-e3a5-433e-947a-c3f70d659d4d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:40.218872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:40.220148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:40.221419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:40.221419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:40.221419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:40.221419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:40.221419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:40.221419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:40.221419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:40.221419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:40.221419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:40.221419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:40.221419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:40.221419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:40.221419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:57:40.221419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:40.221419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 465/951] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:40.230595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668ca61-e3a5-433e-947a-c3f70d659d4d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:40.321476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95f6e2-3cf9-473b-b0d6-5535d61baa97 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:40.362391 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:40.384184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e21af-ecf7-4039-8e44-7af0538e8896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:40.384785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668ca61-e3a5-433e-947a-c3f70d659d4d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:40.385123 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e21af-ecf7-4039-8e44-7af0538e8896 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:40.385498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e21af-ecf7-4039-8e44-7af0538e8896 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:40.385868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e21af-ecf7-4039-8e44-7af0538e8896 None admin] PATH_INFO: `/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/487fc3d8ac924be0a1d66ae8ca49f76c/roles/4c2f9308c8fb42598460286c6520acb7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:40.388681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e21af-ecf7-4039-8e44-7af0538e8896 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8aae17def04cf48190ede4bffefe70, user_id=487fc3d8ac924be0a1d66ae8ca49f76c, role_id=4c2f9308c8fb42598460286c6520acb7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:40.391338 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e21af-ecf7-4039-8e44-7af0538e8896 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:40.413290 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 487/952] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:57:40 2022] PUT /identity/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/487fc3d8ac924be0a1d66ae8ca49f76c/roles/4c2f9308c8fb42598460286c6520acb7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:57:40.452544 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafac27-626c-456d-9c32-881ee17112d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:40.453256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafac27-626c-456d-9c32-881ee17112d8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:40.453684 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafac27-626c-456d-9c32-881ee17112d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:40.454252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafac27-626c-456d-9c32-881ee17112d8 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:40.455226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafac27-626c-456d-9c32-881ee17112d8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:40.455539 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafac27-626c-456d-9c32-881ee17112d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:40.457753 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafac27-626c-456d-9c32-881ee17112d8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:40.466280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 466/953] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Aug 30 04:57:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:40.473242 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e21af-ecf7-4039-8e44-7af0538e8896 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:40.533914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:40.599662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e21af-ecf7-4039-8e44-7af0538e8896 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:40.649071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10c263-fe19-4b88-bdeb-3d144c596688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:40.649697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10c263-fe19-4b88-bdeb-3d144c596688 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:40.650020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10c263-fe19-4b88-bdeb-3d144c596688 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:40.650293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10c263-fe19-4b88-bdeb-3d144c596688 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:40.650925 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10c263-fe19-4b88-bdeb-3d144c596688 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:40.651221 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10c263-fe19-4b88-bdeb-3d144c596688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:40.652611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10c263-fe19-4b88-bdeb-3d144c596688 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:40.658156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 488/954] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Aug 30 04:57:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:40.733859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae173ae-195f-4d2e-ac6f-b91631cb04bc None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:40.733859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae173ae-195f-4d2e-ac6f-b91631cb04bc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:40.734118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae173ae-195f-4d2e-ac6f-b91631cb04bc None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:40.735782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 467/955] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:40.742367 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d616f-fc14-4977-b33b-e4b838b8e0c6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:40.742922 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d616f-fc14-4977-b33b-e4b838b8e0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:40.743000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d616f-fc14-4977-b33b-e4b838b8e0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:40.764517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-715d616f-fc14-4977-b33b-e4b838b8e0c6 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:40.765816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-715d616f-fc14-4977-b33b-e4b838b8e0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:40.853383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 489/956] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:41.131585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae173ae-195f-4d2e-ac6f-b91631cb04bc None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:41.246658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae173ae-195f-4d2e-ac6f-b91631cb04bc None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:41.282521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6727964-9d90-46e7-b6f4-88fef68393ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:41.283384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6727964-9d90-46e7-b6f4-88fef68393ad None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:41.283885 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6727964-9d90-46e7-b6f4-88fef68393ad None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:41.284310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6727964-9d90-46e7-b6f4-88fef68393ad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:41.285069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6727964-9d90-46e7-b6f4-88fef68393ad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:41.286580 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6727964-9d90-46e7-b6f4-88fef68393ad None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b6727964-9d90-46e7-b6f4-88fef68393ad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:41.296273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:41.297587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:41.298696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:41.298696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:41.298696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:41.298696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:41.298696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:41.298696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:41.298696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:41.298696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:41.298696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:41.298696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:41.298696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:41.298696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:41.298696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:57:41.298696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:41.301060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 468/957] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Aug 30 04:57:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:41.307999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d616f-fc14-4977-b33b-e4b838b8e0c6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:41.348081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:41.411536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d616f-fc14-4977-b33b-e4b838b8e0c6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:41.448109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898eaa9-8de7-43db-b513-a8c682729188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:41.448951 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898eaa9-8de7-43db-b513-a8c682729188 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:41.449404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898eaa9-8de7-43db-b513-a8c682729188 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:41.449815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898eaa9-8de7-43db-b513-a8c682729188 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:41.450573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898eaa9-8de7-43db-b513-a8c682729188 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:41.451011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898eaa9-8de7-43db-b513-a8c682729188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:41.452847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898eaa9-8de7-43db-b513-a8c682729188 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:41.464043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 490/958] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Aug 30 04:57:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:41.466085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6727964-9d90-46e7-b6f4-88fef68393ad None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:41.493171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:41.591781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6727964-9d90-46e7-b6f4-88fef68393ad None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:41.627369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3571d97-f4e1-42cb-9714-efcc597eeedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:41.628540 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3571d97-f4e1-42cb-9714-efcc597eeedd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:41.628958 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3571d97-f4e1-42cb-9714-efcc597eeedd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:41.629365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3571d97-f4e1-42cb-9714-efcc597eeedd None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:41.630127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3571d97-f4e1-42cb-9714-efcc597eeedd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:41.630565 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3571d97-f4e1-42cb-9714-efcc597eeedd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:41.632097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3571d97-f4e1-42cb-9714-efcc597eeedd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:41.638255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 469/959] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Aug 30 04:57:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:41.643935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898eaa9-8de7-43db-b513-a8c682729188 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:41.764840 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898eaa9-8de7-43db-b513-a8c682729188 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:41.767231 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:41.813582 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35a276-f4b5-43f3-abcb-842bce275f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:41.814580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35a276-f4b5-43f3-abcb-842bce275f01 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:41.815037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35a276-f4b5-43f3-abcb-842bce275f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:41.815522 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35a276-f4b5-43f3-abcb-842bce275f01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:41.816398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35a276-f4b5-43f3-abcb-842bce275f01 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:41.818330 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35a276-f4b5-43f3-abcb-842bce275f01 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:41.844452 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 491/960] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 04:57:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:42.111835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486e7fc-e43e-4b64-a764-997899651835 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:42.112586 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486e7fc-e43e-4b64-a764-997899651835 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:42.113066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486e7fc-e43e-4b64-a764-997899651835 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:42.114963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 470/961] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:42.120348 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32ec1-7b2f-4d7c-8b54-5303b8dd1cca None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:42.120626 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32ec1-7b2f-4d7c-8b54-5303b8dd1cca None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:42.120898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32ec1-7b2f-4d7c-8b54-5303b8dd1cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:42.141298 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-33c32ec1-7b2f-4d7c-8b54-5303b8dd1cca None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:42.142516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-33c32ec1-7b2f-4d7c-8b54-5303b8dd1cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:42.225467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 492/962] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:42.502124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486e7fc-e43e-4b64-a764-997899651835 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:42.526641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5ccfe-35fc-4e3c-b015-071660bda717 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:42.526985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5ccfe-35fc-4e3c-b015-071660bda717 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:42.527258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5ccfe-35fc-4e3c-b015-071660bda717 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:42.528886 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 493/963] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:57:42.540941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0d630-1732-4cd4-851c-3bd04d0ba3f3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:42.541636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0d630-1732-4cd4-851c-3bd04d0ba3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:42.542269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0d630-1732-4cd4-851c-3bd04d0ba3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:42.567526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ace0d630-1732-4cd4-851c-3bd04d0ba3f3 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:42.568929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ace0d630-1732-4cd4-851c-3bd04d0ba3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:42.595013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:42.617444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486e7fc-e43e-4b64-a764-997899651835 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:42.648553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 494/964] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:42.654708 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a10e9a-b41d-4580-bf9b-64fd51095611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:42.655533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a10e9a-b41d-4580-bf9b-64fd51095611 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:42.656066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a10e9a-b41d-4580-bf9b-64fd51095611 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:42.656476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a10e9a-b41d-4580-bf9b-64fd51095611 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:42.657327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a10e9a-b41d-4580-bf9b-64fd51095611 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:42.658951 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a10e9a-b41d-4580-bf9b-64fd51095611 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:42.675099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.sql.core [None req-c5a10e9a-b41d-4580-bf9b-64fd51095611 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 04:57:42.675099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 04:57:42.675099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [parameters: {'user_id': 'c207a296ce7744b985dae47808ad5061', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 04:57:42.675099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81675) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 04:57:42.684114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-c5a10e9a-b41d-4580-bf9b-64fd51095611 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 04:57:42.684114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:42.684114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:57:42.684114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:57:42.684114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:57:42.684114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:57:42.684114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:57:42.684114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:57:42.684114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:57:42.684114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:57:42.684114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:57:42.684114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:57:42.684114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:57:42.684114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application result.read() Aug 30 04:57:42.684114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:57:42.685213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application yield resource Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise self.value Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application session.commit() Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 04:57:42.686388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self.session.flush() Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application compat.raise_( Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 04:57:42.687480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:57:42.688570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application result.read() Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:57:42.689561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:57:42.690429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:57:42.690429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:57:42.690429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:57:42.690429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:57:42.690429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 04:57:42.690429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 04:57:42.690429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c207a296ce7744b985dae47808ad5061', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 04:57:42.690429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 04:57:42.690429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:42.690429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:42.690429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:42.690429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:42.690429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:42.690429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:42.690429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 04:57:42.691331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 04:57:42.692559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 04:57:42.692559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 04:57:42.692559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 04:57:42.692559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 04:57:42.692559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 04:57:42.692559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:42.694753 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 471/965] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Aug 30 04:57:42 2022] POST /identity/v3/users => generated 160 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:42.701296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0d630-1732-4cd4-851c-3bd04d0ba3f3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:42.722984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:42.832503 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0d630-1732-4cd4-851c-3bd04d0ba3f3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:42.876530 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2596d7-b0e9-45a7-89ef-8e9182f48ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:42.877561 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2596d7-b0e9-45a7-89ef-8e9182f48ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:42.878231 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2596d7-b0e9-45a7-89ef-8e9182f48ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:42.878550 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2596d7-b0e9-45a7-89ef-8e9182f48ad6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:42.880858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36670b26-ef5b-4a00-8339-39d64ea9f64a None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:42.881216 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36670b26-ef5b-4a00-8339-39d64ea9f64a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:42.881560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36670b26-ef5b-4a00-8339-39d64ea9f64a None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:42.889533 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2596d7-b0e9-45a7-89ef-8e9182f48ad6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:42.890671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 472/966] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:42 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:42.891100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2596d7-b0e9-45a7-89ef-8e9182f48ad6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:42.891988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e18dad-9790-446e-a5c4-34992b94a402 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:42.892276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e18dad-9790-446e-a5c4-34992b94a402 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:42.892547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e18dad-9790-446e-a5c4-34992b94a402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-2b2596d7-b0e9-45a7-89ef-8e9182f48ad6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:42.907540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:42.908673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:42.909697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:42.909697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:42.909697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:42.909697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:42.909697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:42.909697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:42.909697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:42.909697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:42.909697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:57:42.909697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:42.909697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 495/967] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:57:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:42.914905 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-36e18dad-9790-446e-a5c4-34992b94a402 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:42.916506 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-36e18dad-9790-446e-a5c4-34992b94a402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:42.923121 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2596d7-b0e9-45a7-89ef-8e9182f48ad6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:43.018308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 473/968] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:43.019300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e18dad-9790-446e-a5c4-34992b94a402 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:43.046812 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:43.079865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2596d7-b0e9-45a7-89ef-8e9182f48ad6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:43.128704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd15c69-f609-4a4b-9eec-07af80e360c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:43.129430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd15c69-f609-4a4b-9eec-07af80e360c7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:43.129768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd15c69-f609-4a4b-9eec-07af80e360c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:43.130107 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd15c69-f609-4a4b-9eec-07af80e360c7 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:43.131200 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd15c69-f609-4a4b-9eec-07af80e360c7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:43.132803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:43.132924 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd15c69-f609-4a4b-9eec-07af80e360c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:43.134945 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd15c69-f609-4a4b-9eec-07af80e360c7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:43.182524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 496/969] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Aug 30 04:57:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:43.193340 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e18dad-9790-446e-a5c4-34992b94a402 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:43.245644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb56091-008b-4413-a03f-ab1f88ff3fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:43.246815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb56091-008b-4413-a03f-ab1f88ff3fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:43.247371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb56091-008b-4413-a03f-ab1f88ff3fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:43.247988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb56091-008b-4413-a03f-ab1f88ff3fe4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:43.262784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb56091-008b-4413-a03f-ab1f88ff3fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-afb56091-008b-4413-a03f-ab1f88ff3fe4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:43.268462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:43.269527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:43.270417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:43.270417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:43.270417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:43.270417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:43.270417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:43.270417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:43.270417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:43.270417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:43.270417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:43.270417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:43.270417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:57:43.270417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:43.273972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 474/970] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Aug 30 04:57:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:43.281437 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd15c69-f609-4a4b-9eec-07af80e360c7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:43.329303 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb56091-008b-4413-a03f-ab1f88ff3fe4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:43.420084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd15c69-f609-4a4b-9eec-07af80e360c7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:43.470607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:43.481032 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5785c52-3ac5-4339-b2d1-72f6983a1faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:43.482069 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5785c52-3ac5-4339-b2d1-72f6983a1faa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:43.482520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5785c52-3ac5-4339-b2d1-72f6983a1faa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:43.483703 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5785c52-3ac5-4339-b2d1-72f6983a1faa None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:43.483821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb56091-008b-4413-a03f-ab1f88ff3fe4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:43.484155 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5785c52-3ac5-4339-b2d1-72f6983a1faa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:43.484654 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5785c52-3ac5-4339-b2d1-72f6983a1faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:43.487324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5785c52-3ac5-4339-b2d1-72f6983a1faa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:43.509314 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 497/971] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Aug 30 04:57:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:43.516682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5785c52-3ac5-4339-b2d1-72f6983a1faa None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:43.531482 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:43.539248 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e91538-0a16-4e53-a0d1-dde37e2fc476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:43.540219 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e91538-0a16-4e53-a0d1-dde37e2fc476 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:43.540496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e91538-0a16-4e53-a0d1-dde37e2fc476 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:43.540770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e91538-0a16-4e53-a0d1-dde37e2fc476 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:43.541431 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e91538-0a16-4e53-a0d1-dde37e2fc476 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:43.542934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e91538-0a16-4e53-a0d1-dde37e2fc476 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:43.565169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 475/972] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Aug 30 04:57:43 2022] POST /identity/v3/services => generated 242 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:43.638888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5785c52-3ac5-4339-b2d1-72f6983a1faa None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:43.685248 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b52a8-5cc1-402f-bb4e-3f94be67b63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:43.686318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b52a8-5cc1-402f-bb4e-3f94be67b63f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:43.686802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b52a8-5cc1-402f-bb4e-3f94be67b63f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:43.687280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b52a8-5cc1-402f-bb4e-3f94be67b63f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:43.701558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b52a8-5cc1-402f-bb4e-3f94be67b63f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:43.703432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b52a8-5cc1-402f-bb4e-3f94be67b63f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-9a9b52a8-5cc1-402f-bb4e-3f94be67b63f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:43.720249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:43.721456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:43.722562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:43.722562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:43.722562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:43.723806 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 498/973] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:43.731217 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e91538-0a16-4e53-a0d1-dde37e2fc476 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:43.841559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e91538-0a16-4e53-a0d1-dde37e2fc476 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:43.875809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca85ef2-39d2-4df1-bea8-ad91ee5e5680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:43.876448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca85ef2-39d2-4df1-bea8-ad91ee5e5680 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:43.876726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca85ef2-39d2-4df1-bea8-ad91ee5e5680 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:43.876998 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca85ef2-39d2-4df1-bea8-ad91ee5e5680 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:43.877643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca85ef2-39d2-4df1-bea8-ad91ee5e5680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:43.878198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca85ef2-39d2-4df1-bea8-ad91ee5e5680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:43.879559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca85ef2-39d2-4df1-bea8-ad91ee5e5680 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:43.896535 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 476/974] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:43.897744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b52a8-5cc1-402f-bb4e-3f94be67b63f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:43.943224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:43.990129 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf0d56-0788-481a-91ca-0411d997b0dd None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:43.990480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf0d56-0788-481a-91ca-0411d997b0dd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:43.990823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf0d56-0788-481a-91ca-0411d997b0dd None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:43.992902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 477/975] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:57:43.997752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a19862-e35d-4d86-9872-0d30d9840482 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:43.997968 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a19862-e35d-4d86-9872-0d30d9840482 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:43.998239 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a19862-e35d-4d86-9872-0d30d9840482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:44.008965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b52a8-5cc1-402f-bb4e-3f94be67b63f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:44.017957 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-17a19862-e35d-4d86-9872-0d30d9840482 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:44.019199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-17a19862-e35d-4d86-9872-0d30d9840482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:44.050276 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62f2c2-ab17-45d2-961b-948903e2a7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:44.050921 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62f2c2-ab17-45d2-961b-948903e2a7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:44.051191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62f2c2-ab17-45d2-961b-948903e2a7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:44.051460 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62f2c2-ab17-45d2-961b-948903e2a7e0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:44.064430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62f2c2-ab17-45d2-961b-948903e2a7e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:44.065900 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62f2c2-ab17-45d2-961b-948903e2a7e0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:44.073159 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ca62f2c2-ab17-45d2-961b-948903e2a7e0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:44.078179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:44.079337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:44.080542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:44.080542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:44.080542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:44.080542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:44.080542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:44.080542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:44.080542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:44.080542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:44.080542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:57:44.080542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:44.086623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 499/976] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Aug 30 04:57:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:44.087738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62f2c2-ab17-45d2-961b-948903e2a7e0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:44.097702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 478/977] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:44.190450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62f2c2-ab17-45d2-961b-948903e2a7e0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:44.191980 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:44.228673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc954fe-dfcf-444c-9901-147f4fe9a49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:44.229199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc954fe-dfcf-444c-9901-147f4fe9a49e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:44.229477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc954fe-dfcf-444c-9901-147f4fe9a49e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:44.229740 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc954fe-dfcf-444c-9901-147f4fe9a49e None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:44.230475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc954fe-dfcf-444c-9901-147f4fe9a49e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:44.230772 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc954fe-dfcf-444c-9901-147f4fe9a49e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:44.232211 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc954fe-dfcf-444c-9901-147f4fe9a49e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:44.260990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 500/978] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Aug 30 04:57:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:44.262249 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a19862-e35d-4d86-9872-0d30d9840482 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:44.370959 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc954fe-dfcf-444c-9901-147f4fe9a49e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:44.371161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a19862-e35d-4d86-9872-0d30d9840482 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:44.407262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db56c9f-5c79-4ba1-9fdb-da6c2bf351f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:44.407862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db56c9f-5c79-4ba1-9fdb-da6c2bf351f3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:44.408156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db56c9f-5c79-4ba1-9fdb-da6c2bf351f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:44.408427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db56c9f-5c79-4ba1-9fdb-da6c2bf351f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:44.461371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:44.483429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db56c9f-5c79-4ba1-9fdb-da6c2bf351f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:44.485078 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db56c9f-5c79-4ba1-9fdb-da6c2bf351f3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:44.489051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc954fe-dfcf-444c-9901-147f4fe9a49e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:44.526508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a474d63-0032-4680-93b7-60fe486fe2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:44.527130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a474d63-0032-4680-93b7-60fe486fe2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:44.527411 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a474d63-0032-4680-93b7-60fe486fe2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:44.527681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a474d63-0032-4680-93b7-60fe486fe2b8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:44.528291 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a474d63-0032-4680-93b7-60fe486fe2b8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:44.529744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a474d63-0032-4680-93b7-60fe486fe2b8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-3a474d63-0032-4680-93b7-60fe486fe2b8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:44.539450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:44.540890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:44.542316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:44.542316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:44.542316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:44.542316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:44.542316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:44.542316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:44.542316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:44.542316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:44.542316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:44.542316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:44.542316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:44.542316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:44.542316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:57:44.542316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:44.545797 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 501/979] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Aug 30 04:57:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:44.546321 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a474d63-0032-4680-93b7-60fe486fe2b8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:44.573340 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:44.605068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 479/980] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:44 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:57:44.613244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db56c9f-5c79-4ba1-9fdb-da6c2bf351f3 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:44.660893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a474d63-0032-4680-93b7-60fe486fe2b8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:44.698421 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4867d4-c7b4-40d8-9e88-2a4e01218aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:44.699184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4867d4-c7b4-40d8-9e88-2a4e01218aad None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:44.699563 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4867d4-c7b4-40d8-9e88-2a4e01218aad None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:44.699932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4867d4-c7b4-40d8-9e88-2a4e01218aad None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:44.700709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4867d4-c7b4-40d8-9e88-2a4e01218aad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:44.701112 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4867d4-c7b4-40d8-9e88-2a4e01218aad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:44.702597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4867d4-c7b4-40d8-9e88-2a4e01218aad None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:44.704577 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:44.708333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 502/981] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Aug 30 04:57:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:44.714310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4867d4-c7b4-40d8-9e88-2a4e01218aad None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:44.728050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db56c9f-5c79-4ba1-9fdb-da6c2bf351f3 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:44.767458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a5fe7-57d7-4d8a-adbe-e83145944116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:44.768044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a5fe7-57d7-4d8a-adbe-e83145944116 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:44.768319 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a5fe7-57d7-4d8a-adbe-e83145944116 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:44.768581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a5fe7-57d7-4d8a-adbe-e83145944116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:44.779021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a5fe7-57d7-4d8a-adbe-e83145944116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:44.781145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a5fe7-57d7-4d8a-adbe-e83145944116 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-7a9a5fe7-57d7-4d8a-adbe-e83145944116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:44.797618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:44.798793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:44.799722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:44.799722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:44.799722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:44.799722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 480/982] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:44.805633 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a5fe7-57d7-4d8a-adbe-e83145944116 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:44.823119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:44.837398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4867d4-c7b4-40d8-9e88-2a4e01218aad None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:44.884354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e741a0b-5abe-42e5-922f-886676410652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:44.884727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741a0b-5abe-42e5-922f-886676410652 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:44.885222 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741a0b-5abe-42e5-922f-886676410652 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:44.885635 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741a0b-5abe-42e5-922f-886676410652 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:44.886366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e741a0b-5abe-42e5-922f-886676410652 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:44.886906 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e741a0b-5abe-42e5-922f-886676410652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:44.888743 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e741a0b-5abe-42e5-922f-886676410652 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:44.900806 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 503/983] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Aug 30 04:57:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:44.903728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e741a0b-5abe-42e5-922f-886676410652 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:44.922723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a5fe7-57d7-4d8a-adbe-e83145944116 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:44.963528 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61f53f-68f7-483f-8419-b1488ac37027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:44.964171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61f53f-68f7-483f-8419-b1488ac37027 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:44.964449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61f53f-68f7-483f-8419-b1488ac37027 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:44.964719 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61f53f-68f7-483f-8419-b1488ac37027 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:44.965368 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61f53f-68f7-483f-8419-b1488ac37027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:44.965684 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61f53f-68f7-483f-8419-b1488ac37027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:44.967049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61f53f-68f7-483f-8419-b1488ac37027 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:44.968693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:44.988022 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 481/984] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:44.989203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61f53f-68f7-483f-8419-b1488ac37027 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:45.030838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e741a0b-5abe-42e5-922f-886676410652 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:45.074384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be20ee4-1138-4c39-b68c-46e593026eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:45.074991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be20ee4-1138-4c39-b68c-46e593026eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:45.075257 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be20ee4-1138-4c39-b68c-46e593026eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:45.075637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be20ee4-1138-4c39-b68c-46e593026eb7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:45.076487 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be20ee4-1138-4c39-b68c-46e593026eb7 None admin] RBAC: Adding query filter params (interface=admin, service_id=09e349d0be5044bc8f82da4147e3fc63, region_id=RegionOne) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:45.076791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be20ee4-1138-4c39-b68c-46e593026eb7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:45.078137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be20ee4-1138-4c39-b68c-46e593026eb7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:45.084435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 504/985] 10.222.0.48 () {56 vars in 1249 bytes} [Tue Aug 30 04:57:44 2022] GET /identity/v3/endpoints?service_id=09e349d0be5044bc8f82da4147e3fc63&interface=admin®ion_id=RegionOne => generated 193 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:45.089081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be20ee4-1138-4c39-b68c-46e593026eb7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:45.113700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:45.128753 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61f53f-68f7-483f-8419-b1488ac37027 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:45.165071 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c12bd7-5c87-4909-b73b-a8701abd725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:45.165703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c12bd7-5c87-4909-b73b-a8701abd725b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:45.166024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c12bd7-5c87-4909-b73b-a8701abd725b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:45.166287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c12bd7-5c87-4909-b73b-a8701abd725b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:45.174091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c12bd7-5c87-4909-b73b-a8701abd725b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:45.175540 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c12bd7-5c87-4909-b73b-a8701abd725b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:45.187473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-c7c12bd7-5c87-4909-b73b-a8701abd725b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:45.187473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:45.187473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:45.187473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:45.187473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:45.187473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:45.187473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:45.187473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:45.187473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:45.187473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:45.187473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:45.187473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:45.187473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:45.187473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:45.187473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:45.188728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:45.189834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:45.189834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:45.189834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:45.189834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:45.189834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:45.189834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:45.189834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:45.189834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:45.193558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 482/986] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:45.194526 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c12bd7-5c87-4909-b73b-a8701abd725b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:45.217417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be20ee4-1138-4c39-b68c-46e593026eb7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:45.250833 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:45.256616 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35315997-0414-47a5-839b-20de6e82af40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:45.257562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315997-0414-47a5-839b-20de6e82af40 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:45.258063 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315997-0414-47a5-839b-20de6e82af40 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:45.258612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315997-0414-47a5-839b-20de6e82af40 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:45.259218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35315997-0414-47a5-839b-20de6e82af40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:45.260609 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35315997-0414-47a5-839b-20de6e82af40 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:45.268758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 505/987] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Aug 30 04:57:45 2022] GET /identity/v3/services => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:57:45.301381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c12bd7-5c87-4909-b73b-a8701abd725b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:45.339352 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bb983-fb96-4d90-9cde-73f6fa10ba98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:45.340001 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bb983-fb96-4d90-9cde-73f6fa10ba98 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:45.340274 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bb983-fb96-4d90-9cde-73f6fa10ba98 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:45.340544 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bb983-fb96-4d90-9cde-73f6fa10ba98 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:45.341265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bb983-fb96-4d90-9cde-73f6fa10ba98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:45.341565 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bb983-fb96-4d90-9cde-73f6fa10ba98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:45.343631 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bb983-fb96-4d90-9cde-73f6fa10ba98 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:45.365546 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 483/988] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:45.367513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35315997-0414-47a5-839b-20de6e82af40 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:45.458965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:45.480707 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35315997-0414-47a5-839b-20de6e82af40 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:45.516506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215f03a-b891-46a1-a290-a83307fb552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:45.517113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215f03a-b891-46a1-a290-a83307fb552b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:45.517390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215f03a-b891-46a1-a290-a83307fb552b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:45.517661 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215f03a-b891-46a1-a290-a83307fb552b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:45.518387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215f03a-b891-46a1-a290-a83307fb552b None admin] RBAC: Adding query filter params (role.id=4c2f9308c8fb42598460286c6520acb7, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=487fc3d8ac924be0a1d66ae8ca49f76c) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:45.518694 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215f03a-b891-46a1-a290-a83307fb552b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:45.520133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215f03a-b891-46a1-a290-a83307fb552b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:45.532796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 506/989] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:57:45 2022] GET /identity/v3/role_assignments?user.id=487fc3d8ac924be0a1d66ae8ca49f76c&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=4c2f9308c8fb42598460286c6520acb7 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:45.533007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2172a2-bdc6-4d38-bb53-fb12b3562d14 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:45.533007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2172a2-bdc6-4d38-bb53-fb12b3562d14 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:45.533007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2172a2-bdc6-4d38-bb53-fb12b3562d14 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:45.533007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 484/990] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:57:45.534575 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd85fba-61a5-4e4f-aee0-a65303290599 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:45.534860 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd85fba-61a5-4e4f-aee0-a65303290599 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:45.535127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd85fba-61a5-4e4f-aee0-a65303290599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:45.554990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-dcd85fba-61a5-4e4f-aee0-a65303290599 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:45.556158 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-dcd85fba-61a5-4e4f-aee0-a65303290599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:45.630927 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 507/991] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:45.894825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2172a2-bdc6-4d38-bb53-fb12b3562d14 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:46.001952 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2172a2-bdc6-4d38-bb53-fb12b3562d14 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:46.018138 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:46.042768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad1a1b-6a03-4689-8636-61205bf84946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:46.043393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad1a1b-6a03-4689-8636-61205bf84946 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:46.043663 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad1a1b-6a03-4689-8636-61205bf84946 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:46.043922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad1a1b-6a03-4689-8636-61205bf84946 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:46.044515 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad1a1b-6a03-4689-8636-61205bf84946 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:46.045883 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad1a1b-6a03-4689-8636-61205bf84946 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-59ad1a1b-6a03-4689-8636-61205bf84946 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:46.055459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:46.060253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:46.061148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:46.061148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:46.061148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:46.061148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:46.061148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:46.061148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:46.061148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:46.061148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:46.061148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:46.061148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:46.061148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:46.061148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:46.061148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:57:46.061148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:46.061148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 485/992] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:46.063071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd85fba-61a5-4e4f-aee0-a65303290599 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:46.139811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:46.166629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd85fba-61a5-4e4f-aee0-a65303290599 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:46.201877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebf397-7ac3-421f-b662-fe3b56973651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:46.202520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebf397-7ac3-421f-b662-fe3b56973651 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:46.202770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebf397-7ac3-421f-b662-fe3b56973651 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:46.203039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebf397-7ac3-421f-b662-fe3b56973651 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:46.203665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebf397-7ac3-421f-b662-fe3b56973651 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:46.203985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebf397-7ac3-421f-b662-fe3b56973651 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:46.205351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebf397-7ac3-421f-b662-fe3b56973651 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:46.215106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 508/993] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Aug 30 04:57:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:46.216081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad1a1b-6a03-4689-8636-61205bf84946 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:46.317648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad1a1b-6a03-4689-8636-61205bf84946 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:46.350453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fcddc-d0eb-4683-8048-3d25a5122619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:46.352588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fcddc-d0eb-4683-8048-3d25a5122619 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:46.352588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fcddc-d0eb-4683-8048-3d25a5122619 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:46.352588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fcddc-d0eb-4683-8048-3d25a5122619 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:46.353266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fcddc-d0eb-4683-8048-3d25a5122619 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:46.353561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fcddc-d0eb-4683-8048-3d25a5122619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:46.354921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fcddc-d0eb-4683-8048-3d25a5122619 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:46.365000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 486/994] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Aug 30 04:57:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:46.366265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebf397-7ac3-421f-b662-fe3b56973651 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:46.471292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebf397-7ac3-421f-b662-fe3b56973651 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:46.506594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453c7b1-63df-4f6b-88bd-a988184c01c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:46.507222 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c7b1-63df-4f6b-88bd-a988184c01c5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:46.507498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c7b1-63df-4f6b-88bd-a988184c01c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:46.507773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c7b1-63df-4f6b-88bd-a988184c01c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:46.508494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453c7b1-63df-4f6b-88bd-a988184c01c5 None admin] RBAC: Adding query filter params (interface=public, service_id=3c5ef3016f7b47ba992c393693ae4517, region_id=RegionOne) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:46.508799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453c7b1-63df-4f6b-88bd-a988184c01c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:46.510147 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453c7b1-63df-4f6b-88bd-a988184c01c5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:46.519122 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 509/995] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Aug 30 04:57:46 2022] GET /identity/v3/endpoints?service_id=3c5ef3016f7b47ba992c393693ae4517&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:46.524598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fcddc-d0eb-4683-8048-3d25a5122619 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:46.568982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:46.626642 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fcddc-d0eb-4683-8048-3d25a5122619 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:46.662146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d962c-d47d-458b-95b1-73b1548d25ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:46.662754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d962c-d47d-458b-95b1-73b1548d25ca None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:46.663029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d962c-d47d-458b-95b1-73b1548d25ca None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:46.663300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d962c-d47d-458b-95b1-73b1548d25ca None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:46.664463 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d962c-d47d-458b-95b1-73b1548d25ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:46.665818 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d962c-d47d-458b-95b1-73b1548d25ca None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:46.680244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 487/996] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Aug 30 04:57:46 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:57:47.233501 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48325-570b-45a5-8cf8-db42a2eba96f None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.234097 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48325-570b-45a5-8cf8-db42a2eba96f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.234097 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48325-570b-45a5-8cf8-db42a2eba96f None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.235475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 510/997] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:47.240578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a82ec-e1f1-45bb-ab76-a3af9402e2d8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.241066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a82ec-e1f1-45bb-ab76-a3af9402e2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.241259 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a82ec-e1f1-45bb-ab76-a3af9402e2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.260401 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-417a82ec-e1f1-45bb-ab76-a3af9402e2d8 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:47.261588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-417a82ec-e1f1-45bb-ab76-a3af9402e2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:47.330419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 488/998] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:47.481962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520658f-4d14-41f3-9ddc-81746fccdc79 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.482314 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520658f-4d14-41f3-9ddc-81746fccdc79 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.482509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520658f-4d14-41f3-9ddc-81746fccdc79 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.484009 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 511/999] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:47.489009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb9642-602b-4c0f-8591-72729724e991 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.489244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb9642-602b-4c0f-8591-72729724e991 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.489516 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb9642-602b-4c0f-8591-72729724e991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.508784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c9bb9642-602b-4c0f-8591-72729724e991 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:47.509970 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c9bb9642-602b-4c0f-8591-72729724e991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:47.539688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:47.579451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 489/1000] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:47.599369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520658f-4d14-41f3-9ddc-81746fccdc79 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:47.602452 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:47.705156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520658f-4d14-41f3-9ddc-81746fccdc79 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:47.738848 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eea519-ac19-45ac-8a73-63ffca75e7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:47.739840 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eea519-ac19-45ac-8a73-63ffca75e7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.740310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eea519-ac19-45ac-8a73-63ffca75e7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.740744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eea519-ac19-45ac-8a73-63ffca75e7b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.742094 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eea519-ac19-45ac-8a73-63ffca75e7b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:47.743706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eea519-ac19-45ac-8a73-63ffca75e7b1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-d7eea519-ac19-45ac-8a73-63ffca75e7b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:47.754013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:47.755228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:47.756349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:47.756349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:47.756349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:47.756349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:47.756349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:47.756349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:47.756349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:47.756349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:47.756349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:47.756349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:47.756349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:47.756349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:47.756349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:57:47.756349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:47.756349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 512/1001] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Aug 30 04:57:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:47.763300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb9642-602b-4c0f-8591-72729724e991 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:47.847831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eea519-ac19-45ac-8a73-63ffca75e7b1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:47.866637 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb9642-602b-4c0f-8591-72729724e991 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:47.903128 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c301e0-d0e6-46a6-a1f6-fc0ccd32352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:47.903732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c301e0-d0e6-46a6-a1f6-fc0ccd32352a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.904079 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c301e0-d0e6-46a6-a1f6-fc0ccd32352a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.904776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c301e0-d0e6-46a6-a1f6-fc0ccd32352a None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.905491 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c301e0-d0e6-46a6-a1f6-fc0ccd32352a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:47.905935 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c301e0-d0e6-46a6-a1f6-fc0ccd32352a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:47.907305 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c301e0-d0e6-46a6-a1f6-fc0ccd32352a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:47.917573 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 490/1002] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Aug 30 04:57:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:47.918357 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:47.920161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c301e0-d0e6-46a6-a1f6-fc0ccd32352a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:47.953339 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eea519-ac19-45ac-8a73-63ffca75e7b1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:47.953543 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:47.990412 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1c7a6-c437-4cfd-bec8-c89caafc67a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:47.990987 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1c7a6-c437-4cfd-bec8-c89caafc67a9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.991260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1c7a6-c437-4cfd-bec8-c89caafc67a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.991787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1c7a6-c437-4cfd-bec8-c89caafc67a9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.992216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1c7a6-c437-4cfd-bec8-c89caafc67a9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:47.993573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1c7a6-c437-4cfd-bec8-c89caafc67a9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7be1c7a6-c437-4cfd-bec8-c89caafc67a9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:48.002972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:48.008275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:48.009225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:48.009225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:48.009225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:48.009225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:48.009225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:48.009225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:48.009225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:48.009225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:48.009225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:48.009225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:48.009225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:48.009225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:48.009225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:57:48.009225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:48.009225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 513/1003] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Aug 30 04:57:47 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:48.011195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1c7a6-c437-4cfd-bec8-c89caafc67a9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:48.035825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c301e0-d0e6-46a6-a1f6-fc0ccd32352a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:48.075514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57ccd5-c739-4188-85c5-4b2d0e2b1c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:48.076208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57ccd5-c739-4188-85c5-4b2d0e2b1c7d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:48.076442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57ccd5-c739-4188-85c5-4b2d0e2b1c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:48.076697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57ccd5-c739-4188-85c5-4b2d0e2b1c7d None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:48.077327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57ccd5-c739-4188-85c5-4b2d0e2b1c7d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:48.077620 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57ccd5-c739-4188-85c5-4b2d0e2b1c7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:48.079031 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57ccd5-c739-4188-85c5-4b2d0e2b1c7d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:48.088715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 491/1004] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Aug 30 04:57:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:48.089695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57ccd5-c739-4188-85c5-4b2d0e2b1c7d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:48.128293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1c7a6-c437-4cfd-bec8-c89caafc67a9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:48.161553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:48.170966 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4dd9a-2105-409b-bee0-3c9c3120d09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:48.171958 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4dd9a-2105-409b-bee0-3c9c3120d09a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:48.172303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4dd9a-2105-409b-bee0-3c9c3120d09a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:48.172724 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4dd9a-2105-409b-bee0-3c9c3120d09a None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:48.173477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4dd9a-2105-409b-bee0-3c9c3120d09a None admin] RBAC: Adding query filter params (name=image) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:48.173774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4dd9a-2105-409b-bee0-3c9c3120d09a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:48.175697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4dd9a-2105-409b-bee0-3c9c3120d09a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:48.185293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 514/1005] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:48.186494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4dd9a-2105-409b-bee0-3c9c3120d09a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:48.187407 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:48.196426 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57ccd5-c739-4188-85c5-4b2d0e2b1c7d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:48.231257 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0bbc0-901b-4eff-9426-d478c6fa575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:48.232241 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0bbc0-901b-4eff-9426-d478c6fa575f None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:48.232522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0bbc0-901b-4eff-9426-d478c6fa575f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:48.232791 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0bbc0-901b-4eff-9426-d478c6fa575f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:48.233775 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0bbc0-901b-4eff-9426-d478c6fa575f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:48.235283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0bbc0-901b-4eff-9426-d478c6fa575f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:48.264063 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 492/1006] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 04:57:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:57:48.309609 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4dd9a-2105-409b-bee0-3c9c3120d09a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:48.353874 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a2a23-3d74-46a9-af06-d6c81a20e059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:48.354603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a2a23-3d74-46a9-af06-d6c81a20e059 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:48.354996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a2a23-3d74-46a9-af06-d6c81a20e059 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:48.355471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a2a23-3d74-46a9-af06-d6c81a20e059 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:48.356640 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a2a23-3d74-46a9-af06-d6c81a20e059 None admin] RBAC: Adding query filter params (type=image) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:48.357215 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a2a23-3d74-46a9-af06-d6c81a20e059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:48.359024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a2a23-3d74-46a9-af06-d6c81a20e059 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:48.368220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 515/1007] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:48.590390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738ac83-cf07-4b82-bb4e-7bc8da39e024 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:48.590656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738ac83-cf07-4b82-bb4e-7bc8da39e024 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:48.590964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738ac83-cf07-4b82-bb4e-7bc8da39e024 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:48.592888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 493/1008] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:48.598246 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d32e49-4e0a-4740-a374-db8428610f75 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:48.598532 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d32e49-4e0a-4740-a374-db8428610f75 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:48.598803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d32e49-4e0a-4740-a374-db8428610f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:48.617272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f7d32e49-4e0a-4740-a374-db8428610f75 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:48.618449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f7d32e49-4e0a-4740-a374-db8428610f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:48.671006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:48.692000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 516/1009] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:48 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:48.967136 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738ac83-cf07-4b82-bb4e-7bc8da39e024 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:49.081783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738ac83-cf07-4b82-bb4e-7bc8da39e024 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:49.118556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bf8b9-79e2-480f-8ff7-737ea0dabf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:49.119179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bf8b9-79e2-480f-8ff7-737ea0dabf13 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:49.119452 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bf8b9-79e2-480f-8ff7-737ea0dabf13 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:49.119719 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bf8b9-79e2-480f-8ff7-737ea0dabf13 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:49.120323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bf8b9-79e2-480f-8ff7-737ea0dabf13 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:49.121680 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bf8b9-79e2-480f-8ff7-737ea0dabf13 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-d18bf8b9-79e2-480f-8ff7-737ea0dabf13 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:49.130965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:49.136246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:49.137115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:49.137115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:49.137115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:49.137115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:49.137115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:49.137115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:49.137115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:49.137115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:49.137115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:49.137115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:49.137115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:49.137115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:49.137115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:57:49.137115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:49.137115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 494/1010] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:49.138606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d32e49-4e0a-4740-a374-db8428610f75 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:49.241017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d32e49-4e0a-4740-a374-db8428610f75 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:49.276901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658f202-19ea-43f0-a517-0bf94d912bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:49.277508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658f202-19ea-43f0-a517-0bf94d912bef None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:49.277783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658f202-19ea-43f0-a517-0bf94d912bef None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:49.278050 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658f202-19ea-43f0-a517-0bf94d912bef None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:49.278674 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658f202-19ea-43f0-a517-0bf94d912bef None admin] RBAC: Adding query filter params (name=compute) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:49.278970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658f202-19ea-43f0-a517-0bf94d912bef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:49.280373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658f202-19ea-43f0-a517-0bf94d912bef None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:49.289928 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 517/1011] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Aug 30 04:57:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:49.291170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bf8b9-79e2-480f-8ff7-737ea0dabf13 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:49.312205 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:49.400148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bf8b9-79e2-480f-8ff7-737ea0dabf13 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:49.435473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84775274-9d49-4eff-99f7-24142de693f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:49.436138 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84775274-9d49-4eff-99f7-24142de693f6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:49.436421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84775274-9d49-4eff-99f7-24142de693f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:49.436695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84775274-9d49-4eff-99f7-24142de693f6 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:49.437349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84775274-9d49-4eff-99f7-24142de693f6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:49.437652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84775274-9d49-4eff-99f7-24142de693f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:49.439057 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84775274-9d49-4eff-99f7-24142de693f6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:49.449254 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 495/1012] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Aug 30 04:57:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:49.450503 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658f202-19ea-43f0-a517-0bf94d912bef None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:49.502033 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:49.556285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658f202-19ea-43f0-a517-0bf94d912bef None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:49.589274 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274da49-01cd-4b8f-beec-9b798ce7ce81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:49.589876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274da49-01cd-4b8f-beec-9b798ce7ce81 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:49.590147 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274da49-01cd-4b8f-beec-9b798ce7ce81 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:49.590417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274da49-01cd-4b8f-beec-9b798ce7ce81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:49.591078 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274da49-01cd-4b8f-beec-9b798ce7ce81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:49.592526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274da49-01cd-4b8f-beec-9b798ce7ce81 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:49.619972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 518/1013] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 04:57:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:50.227891 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671678ad-b887-4a54-b72f-125a69ca6c95 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:50.228401 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671678ad-b887-4a54-b72f-125a69ca6c95 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:50.228678 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671678ad-b887-4a54-b72f-125a69ca6c95 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:50.230076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 496/1014] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:50.235929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b9dc8-8f50-4bd7-bff6-0afaf42b850c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:50.236194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b9dc8-8f50-4bd7-bff6-0afaf42b850c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:50.236496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b9dc8-8f50-4bd7-bff6-0afaf42b850c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:50.255209 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-990b9dc8-8f50-4bd7-bff6-0afaf42b850c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:50.257439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-990b9dc8-8f50-4bd7-bff6-0afaf42b850c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:50.279151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c7a85-62fa-4145-ad5f-969b75c5ffbe None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:50.279599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c7a85-62fa-4145-ad5f-969b75c5ffbe None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:50.280107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c7a85-62fa-4145-ad5f-969b75c5ffbe None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:50.281901 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 497/1015] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:57:50.286807 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d6c97-5549-4fb9-9941-dc4dee6e3064 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:50.287087 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d6c97-5549-4fb9-9941-dc4dee6e3064 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:50.287364 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d6c97-5549-4fb9-9941-dc4dee6e3064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:50.306541 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-801d6c97-5549-4fb9-9941-dc4dee6e3064 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:50.307727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-801d6c97-5549-4fb9-9941-dc4dee6e3064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:50.341955 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 519/1016] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:50 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:50.378555 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 498/1017] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:50 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:50.615035 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b9dc8-8f50-4bd7-bff6-0afaf42b850c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:50.647651 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:50.659287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d6c97-5549-4fb9-9941-dc4dee6e3064 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:50.673832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:50.732717 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b9dc8-8f50-4bd7-bff6-0afaf42b850c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:50.767255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d6c97-5549-4fb9-9941-dc4dee6e3064 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:50.771910 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f8d7e-4583-49f0-984c-4dc841d96279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:50.772587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f8d7e-4583-49f0-984c-4dc841d96279 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:50.772862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f8d7e-4583-49f0-984c-4dc841d96279 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:50.773132 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f8d7e-4583-49f0-984c-4dc841d96279 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:50.774294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f8d7e-4583-49f0-984c-4dc841d96279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:50.775872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f8d7e-4583-49f0-984c-4dc841d96279 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:50.777819 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 520/1018] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:50.783165 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f8d7e-4583-49f0-984c-4dc841d96279 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:50.805776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f239058-d6a3-4f1d-83fa-4675de8c82da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:50.806381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f239058-d6a3-4f1d-83fa-4675de8c82da None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:50.806654 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f239058-d6a3-4f1d-83fa-4675de8c82da None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:50.806918 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f239058-d6a3-4f1d-83fa-4675de8c82da None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:50.807571 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f239058-d6a3-4f1d-83fa-4675de8c82da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:50.808990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f239058-d6a3-4f1d-83fa-4675de8c82da None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:50.828028 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 499/1019] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Aug 30 04:57:50 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:57:50.899783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:50.905243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f8d7e-4583-49f0-984c-4dc841d96279 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:50.961479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaa256-89ce-4007-847c-1f8c2f6abc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:50.962091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaa256-89ce-4007-847c-1f8c2f6abc23 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:50.962368 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaa256-89ce-4007-847c-1f8c2f6abc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:50.963329 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaa256-89ce-4007-847c-1f8c2f6abc23 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:50.964003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaa256-89ce-4007-847c-1f8c2f6abc23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:50.965438 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaa256-89ce-4007-847c-1f8c2f6abc23 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:50.997228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 521/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Aug 30 04:57:50 2022] POST /identity/v3/projects => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:57:51.680033 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0db38-6e75-4f2a-b5c3-8a2c3b9c91ab None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:51.680583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0db38-6e75-4f2a-b5c3-8a2c3b9c91ab None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:51.680583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0db38-6e75-4f2a-b5c3-8a2c3b9c91ab None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:51.682047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 500/1021] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:51.687129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26b160-1dd3-48bf-8bb6-f6705cba3d52 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:51.687530 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26b160-1dd3-48bf-8bb6-f6705cba3d52 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:51.687708 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26b160-1dd3-48bf-8bb6-f6705cba3d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:51.706332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1a26b160-1dd3-48bf-8bb6-f6705cba3d52 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:51.707526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1a26b160-1dd3-48bf-8bb6-f6705cba3d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:51.776772 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 522/1022] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:52.048372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0db38-6e75-4f2a-b5c3-8a2c3b9c91ab None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:52.124471 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:52.157820 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0db38-6e75-4f2a-b5c3-8a2c3b9c91ab None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:52.192647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e204b74-dce6-4185-b7e4-dbfe980721a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:52.193283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e204b74-dce6-4185-b7e4-dbfe980721a7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:52.193563 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e204b74-dce6-4185-b7e4-dbfe980721a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:52.193834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e204b74-dce6-4185-b7e4-dbfe980721a7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:52.205310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e204b74-dce6-4185-b7e4-dbfe980721a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1e204b74-dce6-4185-b7e4-dbfe980721a7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:52.210066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:52.211029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:52.211927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:52.211927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:52.211927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:52.211927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:52.211927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:52.211927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:52.211927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:52.211927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:52.211927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:52.211927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:52.211927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:57:52.211927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:52.213326 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 501/1023] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Aug 30 04:57:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:52.217064 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26b160-1dd3-48bf-8bb6-f6705cba3d52 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:52.297080 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:52.323997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26b160-1dd3-48bf-8bb6-f6705cba3d52 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:52.359847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075405c-4480-43cd-8f0c-9b5daae461ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:52.360481 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075405c-4480-43cd-8f0c-9b5daae461ae None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:52.360753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075405c-4480-43cd-8f0c-9b5daae461ae None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:52.361076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075405c-4480-43cd-8f0c-9b5daae461ae None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:52.361735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075405c-4480-43cd-8f0c-9b5daae461ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:52.362028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075405c-4480-43cd-8f0c-9b5daae461ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:52.363375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075405c-4480-43cd-8f0c-9b5daae461ae None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:52.376033 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 523/1024] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Aug 30 04:57:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:52.378780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e204b74-dce6-4185-b7e4-dbfe980721a7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:52.494621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e204b74-dce6-4185-b7e4-dbfe980721a7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:52.526413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:52.533098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc43987-afc0-46b7-a447-f2467a7378da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:52.533747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc43987-afc0-46b7-a447-f2467a7378da None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:52.534027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc43987-afc0-46b7-a447-f2467a7378da None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:52.534341 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc43987-afc0-46b7-a447-f2467a7378da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:52.546681 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc43987-afc0-46b7-a447-f2467a7378da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:52.548325 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc43987-afc0-46b7-a447-f2467a7378da None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-3fc43987-afc0-46b7-a447-f2467a7378da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:52.564972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:52.565994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:52.566884 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:52.566884 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:52.566884 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:52.567667 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 502/1025] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:52.572064 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075405c-4480-43cd-8f0c-9b5daae461ae None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:52.673898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075405c-4480-43cd-8f0c-9b5daae461ae None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:52.707552 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b10c4-594e-40ae-ba29-88e88bb15bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:52.708217 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b10c4-594e-40ae-ba29-88e88bb15bfd None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:52.708481 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b10c4-594e-40ae-ba29-88e88bb15bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:52.708712 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b10c4-594e-40ae-ba29-88e88bb15bfd None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:52.709342 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b10c4-594e-40ae-ba29-88e88bb15bfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:52.709636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b10c4-594e-40ae-ba29-88e88bb15bfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:52.711529 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b10c4-594e-40ae-ba29-88e88bb15bfd None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:52.718659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:52.730038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 524/1026] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:52.731276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc43987-afc0-46b7-a447-f2467a7378da None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:52.795614 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9a28f-f18b-45f1-9c93-01cb2bc98474 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:52.795979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9a28f-f18b-45f1-9c93-01cb2bc98474 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:52.796190 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9a28f-f18b-45f1-9c93-01cb2bc98474 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:52.797678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 525/1027] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:57:52.802947 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e08dca-83f2-4412-9685-e704561e47c1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:52.803187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e08dca-83f2-4412-9685-e704561e47c1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:52.803426 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e08dca-83f2-4412-9685-e704561e47c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:52.821129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f6e08dca-83f2-4412-9685-e704561e47c1 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:52.822317 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f6e08dca-83f2-4412-9685-e704561e47c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:52.843022 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc43987-afc0-46b7-a447-f2467a7378da None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:52.890177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11d763-a7dd-49ff-8784-d6e733ad95cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:52.890805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11d763-a7dd-49ff-8784-d6e733ad95cc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:52.891079 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11d763-a7dd-49ff-8784-d6e733ad95cc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:52.891344 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11d763-a7dd-49ff-8784-d6e733ad95cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:52.899848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11d763-a7dd-49ff-8784-d6e733ad95cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:52.900389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 526/1028] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:52.901430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11d763-a7dd-49ff-8784-d6e733ad95cc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-ac11d763-a7dd-49ff-8784-d6e733ad95cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:52.919308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:52.920412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:52.926107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:52.926107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:52.926107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:52.926107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:52.926107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:52.926107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:52.926107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:52.926107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:52.926107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:57:52.926107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:52.926107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 503/1029] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Aug 30 04:57:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:52.927824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e08dca-83f2-4412-9685-e704561e47c1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:52.955669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e826e3-69ce-4b2f-ba61-994565a0cc54 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:52.955968 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e826e3-69ce-4b2f-ba61-994565a0cc54 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:52.956242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e826e3-69ce-4b2f-ba61-994565a0cc54 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:52.957695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 504/1030] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:57:52.962755 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a5895-7586-423c-947e-22fb894fba43 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:52.963037 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a5895-7586-423c-947e-22fb894fba43 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:52.963307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a5895-7586-423c-947e-22fb894fba43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:52.984353 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3b9a5895-7586-423c-947e-22fb894fba43 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:52.985592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3b9a5895-7586-423c-947e-22fb894fba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:53.028802 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:53.036165 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e08dca-83f2-4412-9685-e704561e47c1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:53.059374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 505/1031] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:53.067457 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:53.077973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd430c6e-5657-4577-abbe-2cf65d5c3eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:53.078579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd430c6e-5657-4577-abbe-2cf65d5c3eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:53.078856 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd430c6e-5657-4577-abbe-2cf65d5c3eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:53.079124 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd430c6e-5657-4577-abbe-2cf65d5c3eb0 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:53.079861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd430c6e-5657-4577-abbe-2cf65d5c3eb0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:53.080193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd430c6e-5657-4577-abbe-2cf65d5c3eb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:53.081612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd430c6e-5657-4577-abbe-2cf65d5c3eb0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:53.104357 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 527/1032] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Aug 30 04:57:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:53.105746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a5895-7586-423c-947e-22fb894fba43 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:53.167122 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd430c6e-5657-4577-abbe-2cf65d5c3eb0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:53.213123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a5895-7586-423c-947e-22fb894fba43 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:53.249533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83077c70-ee25-46e7-ae7b-2de979bc18e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:53.250517 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83077c70-ee25-46e7-ae7b-2de979bc18e5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:53.250941 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83077c70-ee25-46e7-ae7b-2de979bc18e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:53.251491 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83077c70-ee25-46e7-ae7b-2de979bc18e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:53.274316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd430c6e-5657-4577-abbe-2cf65d5c3eb0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:53.297772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:53.312720 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db679d0-64b9-41bd-82d2-d71a12bb650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:53.313560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db679d0-64b9-41bd-82d2-d71a12bb650e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:53.313839 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db679d0-64b9-41bd-82d2-d71a12bb650e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:53.314265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db679d0-64b9-41bd-82d2-d71a12bb650e None admin] PATH_INFO: `/v3/services/image` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:53.315165 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db679d0-64b9-41bd-82d2-d71a12bb650e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:53.316816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db679d0-64b9-41bd-82d2-d71a12bb650e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:53.324661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83077c70-ee25-46e7-ae7b-2de979bc18e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:53.326169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83077c70-ee25-46e7-ae7b-2de979bc18e5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-6db679d0-64b9-41bd-82d2-d71a12bb650e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:53.328170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:53.329551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:53.332507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:53.332507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:53.332507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:53.332507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:53.332507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:53.332507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:53.332507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:53.332507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:53.332507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:53.332507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:53.332507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:53.332507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:53.332507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:57:53.332507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:53.332507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 528/1033] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Aug 30 04:57:53 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:53.333335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db679d0-64b9-41bd-82d2-d71a12bb650e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:53.382249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:53.426757 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 506/1034] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:53 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:57:53.427593 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83077c70-ee25-46e7-ae7b-2de979bc18e5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:53.436880 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db679d0-64b9-41bd-82d2-d71a12bb650e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:53.471343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672fd4c-84be-4b57-b038-811a12ed9d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:53.471989 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672fd4c-84be-4b57-b038-811a12ed9d68 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:53.472267 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672fd4c-84be-4b57-b038-811a12ed9d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:53.472537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672fd4c-84be-4b57-b038-811a12ed9d68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:53.473631 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672fd4c-84be-4b57-b038-811a12ed9d68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:53.475055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672fd4c-84be-4b57-b038-811a12ed9d68 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:53.476691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 529/1035] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:53.477444 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672fd4c-84be-4b57-b038-811a12ed9d68 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:53.503174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:53.528595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83077c70-ee25-46e7-ae7b-2de979bc18e5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:53.563428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ef3d9-1be6-4e1f-a849-2a85f70b0708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:53.563981 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ef3d9-1be6-4e1f-a849-2a85f70b0708 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:53.564257 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ef3d9-1be6-4e1f-a849-2a85f70b0708 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:53.564536 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ef3d9-1be6-4e1f-a849-2a85f70b0708 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:53.565168 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ef3d9-1be6-4e1f-a849-2a85f70b0708 None admin] RBAC: Adding query filter params (name=image) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:53.565467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ef3d9-1be6-4e1f-a849-2a85f70b0708 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:53.566837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ef3d9-1be6-4e1f-a849-2a85f70b0708 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:53.572268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 507/1036] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:53.572950 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ef3d9-1be6-4e1f-a849-2a85f70b0708 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:53.578599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672fd4c-84be-4b57-b038-811a12ed9d68 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:53.597589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:53.615553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5ab30-78bb-46d5-bccd-1ae8f36e0011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:53.616747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5ab30-78bb-46d5-bccd-1ae8f36e0011 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:53.617024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5ab30-78bb-46d5-bccd-1ae8f36e0011 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:53.617293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5ab30-78bb-46d5-bccd-1ae8f36e0011 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:53.627792 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5ab30-78bb-46d5-bccd-1ae8f36e0011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:53.629258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5ab30-78bb-46d5-bccd-1ae8f36e0011 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-cdf5ab30-78bb-46d5-bccd-1ae8f36e0011 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:53.643862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:53.645036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:53.645965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:53.645965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:53.645965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:53.645965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 530/1037] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:53.645965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5ab30-78bb-46d5-bccd-1ae8f36e0011 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:53.673268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ef3d9-1be6-4e1f-a849-2a85f70b0708 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:53.707850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ddcc0-036d-4da8-ad0b-2de54da2c457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:53.708469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ddcc0-036d-4da8-ad0b-2de54da2c457 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:53.708744 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ddcc0-036d-4da8-ad0b-2de54da2c457 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:53.709012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ddcc0-036d-4da8-ad0b-2de54da2c457 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:53.709651 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ddcc0-036d-4da8-ad0b-2de54da2c457 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:53.711101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ddcc0-036d-4da8-ad0b-2de54da2c457 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:53.720978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:53.732563 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 508/1038] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:57:53 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:53.733455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ddcc0-036d-4da8-ad0b-2de54da2c457 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:53.748133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5ab30-78bb-46d5-bccd-1ae8f36e0011 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:53.787006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce44fba-dbea-4a03-9e3a-275d43d61f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:53.787642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce44fba-dbea-4a03-9e3a-275d43d61f8b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:53.787988 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce44fba-dbea-4a03-9e3a-275d43d61f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:53.788250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce44fba-dbea-4a03-9e3a-275d43d61f8b None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:53.788940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce44fba-dbea-4a03-9e3a-275d43d61f8b None admin] RBAC: Adding query filter params (type=image) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:53.789243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce44fba-dbea-4a03-9e3a-275d43d61f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:53.790629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce44fba-dbea-4a03-9e3a-275d43d61f8b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:53.796296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 531/1039] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:53.802139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce44fba-dbea-4a03-9e3a-275d43d61f8b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:53.841666 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:53.862284 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ddcc0-036d-4da8-ad0b-2de54da2c457 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:53.906022 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1b7f-f7e4-4705-8df9-65be13c837b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:53.906639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1b7f-f7e4-4705-8df9-65be13c837b0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:53.906916 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1b7f-f7e4-4705-8df9-65be13c837b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:53.907182 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1b7f-f7e4-4705-8df9-65be13c837b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:53.907998 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1b7f-f7e4-4705-8df9-65be13c837b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:53.908195 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1b7f-f7e4-4705-8df9-65be13c837b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:53.909551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1b7f-f7e4-4705-8df9-65be13c837b0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:53.917768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce44fba-dbea-4a03-9e3a-275d43d61f8b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:53.923383 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 509/1040] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:53.929613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1b7f-f7e4-4705-8df9-65be13c837b0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:53.955750 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bcdcc-42e8-458c-820f-7609e4ec0542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:53.956524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bcdcc-42e8-458c-820f-7609e4ec0542 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:53.956874 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bcdcc-42e8-458c-820f-7609e4ec0542 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:53.957217 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bcdcc-42e8-458c-820f-7609e4ec0542 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:53.957980 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bcdcc-42e8-458c-820f-7609e4ec0542 None admin] RBAC: Adding query filter params (interface=public, service_id=b43020c03f564da9bc9c8a91f5c1d0e4, region_id=RegionOne) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:53.958351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bcdcc-42e8-458c-820f-7609e4ec0542 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:53.960337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bcdcc-42e8-458c-820f-7609e4ec0542 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:53.965805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 532/1041] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Aug 30 04:57:53 2022] GET /identity/v3/endpoints?service_id=b43020c03f564da9bc9c8a91f5c1d0e4&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:53.972676 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bcdcc-42e8-458c-820f-7609e4ec0542 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:53.996540 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:54.044389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1b7f-f7e4-4705-8df9-65be13c837b0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:54.078976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9bd4a-4535-4618-afae-037a5bc6d2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:54.079604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9bd4a-4535-4618-afae-037a5bc6d2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:54.079879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9bd4a-4535-4618-afae-037a5bc6d2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:54.080421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9bd4a-4535-4618-afae-037a5bc6d2b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:54.085993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:54.087159 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9bd4a-4535-4618-afae-037a5bc6d2b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:54.088652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9bd4a-4535-4618-afae-037a5bc6d2b0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:54.090407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bcdcc-42e8-458c-820f-7609e4ec0542 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:54.100987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-94c9bd4a-4535-4618-afae-037a5bc6d2b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:54.100987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:54.100987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:54.100987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:54.100987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:54.100987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:54.100987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:54.100987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:54.100987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:54.100987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:54.100987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:54.100987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:54.100987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:54.100987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:54.100987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:54.101912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:54.102869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:54.102869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:54.102869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:54.102869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:54.102869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:54.102869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:54.102869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:54.102869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:54.102869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 510/1042] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:54.107920 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9bd4a-4535-4618-afae-037a5bc6d2b0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:54.134735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84284a-795e-4859-abc3-e0e1650da216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:54.135364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84284a-795e-4859-abc3-e0e1650da216 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:54.135645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84284a-795e-4859-abc3-e0e1650da216 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:54.135920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84284a-795e-4859-abc3-e0e1650da216 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:54.136698 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84284a-795e-4859-abc3-e0e1650da216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:54.138427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84284a-795e-4859-abc3-e0e1650da216 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:54.145823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 533/1043] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Aug 30 04:57:53 2022] GET /identity/v3/services => generated 1957 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:57:54.250416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9bd4a-4535-4618-afae-037a5bc6d2b0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:54.267164 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:54.294435 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2339102-126e-46e8-a027-e4fe9cc2e9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:54.295149 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2339102-126e-46e8-a027-e4fe9cc2e9ea None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:54.295497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2339102-126e-46e8-a027-e4fe9cc2e9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:54.295812 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2339102-126e-46e8-a027-e4fe9cc2e9ea None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:54.296602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2339102-126e-46e8-a027-e4fe9cc2e9ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:54.296962 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2339102-126e-46e8-a027-e4fe9cc2e9ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:54.298452 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2339102-126e-46e8-a027-e4fe9cc2e9ea None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:54.316261 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 511/1044] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:54.323223 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84284a-795e-4859-abc3-e0e1650da216 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:54.437811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84284a-795e-4859-abc3-e0e1650da216 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:54.472376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a084bc-a1bc-43e0-88e0-572ad6eb1e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:54.473067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a084bc-a1bc-43e0-88e0-572ad6eb1e1c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:54.473409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a084bc-a1bc-43e0-88e0-572ad6eb1e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:54.473743 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a084bc-a1bc-43e0-88e0-572ad6eb1e1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:54.474533 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a084bc-a1bc-43e0-88e0-572ad6eb1e1c None admin] RBAC: Adding query filter params (role.id=4c2f9308c8fb42598460286c6520acb7, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=1aa002909502426b80c97dbf05dca008) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:54.474904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a084bc-a1bc-43e0-88e0-572ad6eb1e1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:54.476445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a084bc-a1bc-43e0-88e0-572ad6eb1e1c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:54.488087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 534/1045] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:57:54 2022] GET /identity/v3/role_assignments?user.id=1aa002909502426b80c97dbf05dca008&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=4c2f9308c8fb42598460286c6520acb7 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:55.704523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e709475-56c1-42b4-b811-6397dd159607 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:55.705076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e709475-56c1-42b4-b811-6397dd159607 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:55.705076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e709475-56c1-42b4-b811-6397dd159607 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:55.706523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 512/1046] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:55.711999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743b84d-8619-43b0-915a-d82b02025f30 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:55.712399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743b84d-8619-43b0-915a-d82b02025f30 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:55.712559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743b84d-8619-43b0-915a-d82b02025f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:55.731781 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6743b84d-8619-43b0-915a-d82b02025f30 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:55.733008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6743b84d-8619-43b0-915a-d82b02025f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:55.755607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:55.804225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 535/1047] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:56.071374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e709475-56c1-42b4-b811-6397dd159607 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:56.091499 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c9f26-5e86-4de2-b765-438a2d2a666a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:56.091798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c9f26-5e86-4de2-b765-438a2d2a666a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:56.092102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c9f26-5e86-4de2-b765-438a2d2a666a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:56.093443 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 536/1048] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:56.098341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d69a5-50b9-4d07-9102-64dff01e8d2b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:56.098627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d69a5-50b9-4d07-9102-64dff01e8d2b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:56.098901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d69a5-50b9-4d07-9102-64dff01e8d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:56.118100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ed4d69a5-50b9-4d07-9102-64dff01e8d2b None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:56.119271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ed4d69a5-50b9-4d07-9102-64dff01e8d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:56.180079 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e709475-56c1-42b4-b811-6397dd159607 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:56.192777 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 537/1049] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:56.217155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307892e-db8f-4f46-830a-727a21abd21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:56.217860 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307892e-db8f-4f46-830a-727a21abd21c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:56.218203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307892e-db8f-4f46-830a-727a21abd21c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:56.218533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307892e-db8f-4f46-830a-727a21abd21c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:56.229398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307892e-db8f-4f46-830a-727a21abd21c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-9307892e-db8f-4f46-830a-727a21abd21c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:56.234189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:56.235125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:56.236394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:56.236394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:56.236394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:56.236394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:56.236394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:56.236394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:56.236394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:56.236394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:56.236394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:56.236394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:56.236394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:56.236394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:56.240253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 513/1050] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:57:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:56.241845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d69a5-50b9-4d07-9102-64dff01e8d2b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:56.335700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:56.351130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d69a5-50b9-4d07-9102-64dff01e8d2b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:56.357148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53406e-09c5-4f46-bee1-e25c8135135d None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:56.357432 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53406e-09c5-4f46-bee1-e25c8135135d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:56.357703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53406e-09c5-4f46-bee1-e25c8135135d None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:56.359752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 514/1051] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:56.364541 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae87f10-4983-4739-aae1-4111226951ad None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:56.364824 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae87f10-4983-4739-aae1-4111226951ad None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:56.365094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae87f10-4983-4739-aae1-4111226951ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:56.383586 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1ae87f10-4983-4739-aae1-4111226951ad None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:56.384798 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1ae87f10-4983-4739-aae1-4111226951ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:56.386928 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a500e1-4643-4126-a0cc-5de3ee91953e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:56.387545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a500e1-4643-4126-a0cc-5de3ee91953e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:56.387817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a500e1-4643-4126-a0cc-5de3ee91953e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:56.388115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a500e1-4643-4126-a0cc-5de3ee91953e None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:56.388773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a500e1-4643-4126-a0cc-5de3ee91953e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:56.389067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a500e1-4643-4126-a0cc-5de3ee91953e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:56.390409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a500e1-4643-4126-a0cc-5de3ee91953e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:56.404164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 538/1052] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:57:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:56.405046 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a500e1-4643-4126-a0cc-5de3ee91953e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:56.415205 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:56.464076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 515/1053] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:56.469135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae87f10-4983-4739-aae1-4111226951ad None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:56.520105 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a500e1-4643-4126-a0cc-5de3ee91953e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:56.556251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc36dea-f210-4148-b019-85ba89835286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:56.556887 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc36dea-f210-4148-b019-85ba89835286 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:56.557161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc36dea-f210-4148-b019-85ba89835286 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:56.557430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc36dea-f210-4148-b019-85ba89835286 None admin] PATH_INFO: `/v3/users/48d290ce072a424698480ec7ec43d49b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:56.572882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc36dea-f210-4148-b019-85ba89835286 None admin] RBAC: Authorizing `identity:get_user(user_id=48d290ce072a424698480ec7ec43d49b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:56.574323 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc36dea-f210-4148-b019-85ba89835286 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:56.575977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 539/1054] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:57:56 2022] GET /identity/v3/users/48d290ce072a424698480ec7ec43d49b => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:56.581771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc36dea-f210-4148-b019-85ba89835286 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:56.584089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae87f10-4983-4739-aae1-4111226951ad None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:56.590888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:56.622777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1f601-82cc-4eff-8258-cd3c138a626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:56.623324 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1f601-82cc-4eff-8258-cd3c138a626d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:56.623591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1f601-82cc-4eff-8258-cd3c138a626d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:56.623854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1f601-82cc-4eff-8258-cd3c138a626d None admin] PATH_INFO: `/v3/services/image` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:56.624469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1f601-82cc-4eff-8258-cd3c138a626d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:56.625820 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1f601-82cc-4eff-8258-cd3c138a626d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-2fb1f601-82cc-4eff-8258-cd3c138a626d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:56.634790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:56.635784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:56.636986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:56.636986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:56.636986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:56.636986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:56.636986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:56.636986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:56.636986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:56.636986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:56.636986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:56.636986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:56.636986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:57:56.636986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:57:56.636986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:57:56.636986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:56.636986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 516/1055] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Aug 30 04:57:56 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:56.641558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1f601-82cc-4eff-8258-cd3c138a626d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:56.671803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:56.692494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc36dea-f210-4148-b019-85ba89835286 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:56.727588 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec462d0-deb4-4360-a3aa-3baf2536a3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:56.728932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec462d0-deb4-4360-a3aa-3baf2536a3eb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:56.729243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec462d0-deb4-4360-a3aa-3baf2536a3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:56.729507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec462d0-deb4-4360-a3aa-3baf2536a3eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:56.746213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1f601-82cc-4eff-8258-cd3c138a626d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:56.779630 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694eaed0-5228-4ca7-b78b-916b6741a30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:56.780189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eaed0-5228-4ca7-b78b-916b6741a30b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:56.780458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eaed0-5228-4ca7-b78b-916b6741a30b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:56.780720 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eaed0-5228-4ca7-b78b-916b6741a30b None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:56.781336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694eaed0-5228-4ca7-b78b-916b6741a30b None admin] RBAC: Adding query filter params (name=image) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:56.781629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694eaed0-5228-4ca7-b78b-916b6741a30b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:56.782973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694eaed0-5228-4ca7-b78b-916b6741a30b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:56.787585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 517/1056] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:57:56.789103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694eaed0-5228-4ca7-b78b-916b6741a30b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:56.800341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec462d0-deb4-4360-a3aa-3baf2536a3eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:56.801815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec462d0-deb4-4360-a3aa-3baf2536a3eb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:56.810170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:56.882507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:56.891876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694eaed0-5228-4ca7-b78b-916b6741a30b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:56.906004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 540/1057] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:56 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:57:56.906835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec462d0-deb4-4360-a3aa-3baf2536a3eb None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:56.926125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b7db3-41e6-43a0-94dc-a7364b7f8f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:56.926749 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b7db3-41e6-43a0-94dc-a7364b7f8f06 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:56.927025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b7db3-41e6-43a0-94dc-a7364b7f8f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:56.927290 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b7db3-41e6-43a0-94dc-a7364b7f8f06 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:56.938995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b7db3-41e6-43a0-94dc-a7364b7f8f06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-141b7db3-41e6-43a0-94dc-a7364b7f8f06 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:56.943736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:56.945522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:56.946438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:56.946438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:56.946438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:56.946438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:56.946438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:56.946438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:56.946438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:56.946438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:56.946438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:56.946438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:56.946438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:57:56.946438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:56.946438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 518/1058] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Aug 30 04:57:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:56.946438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b7db3-41e6-43a0-94dc-a7364b7f8f06 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.011035 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec462d0-deb4-4360-a3aa-3baf2536a3eb None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.018444 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:57.048451 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962b151-6acf-4135-8ca2-e8789938fac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.048983 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962b151-6acf-4135-8ca2-e8789938fac9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.049084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b7db3-41e6-43a0-94dc-a7364b7f8f06 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.049258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962b151-6acf-4135-8ca2-e8789938fac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.049524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962b151-6acf-4135-8ca2-e8789938fac9 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.050147 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962b151-6acf-4135-8ca2-e8789938fac9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:57.050447 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962b151-6acf-4135-8ca2-e8789938fac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.051791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962b151-6acf-4135-8ca2-e8789938fac9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.056486 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 541/1059] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:57.057252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962b151-6acf-4135-8ca2-e8789938fac9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.089974 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d211cd-1a27-487c-9adc-a574d0abff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.090602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d211cd-1a27-487c-9adc-a574d0abff01 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.090879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d211cd-1a27-487c-9adc-a574d0abff01 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.091154 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d211cd-1a27-487c-9adc-a574d0abff01 None admin] PATH_INFO: `/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.092344 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d211cd-1a27-487c-9adc-a574d0abff01 None admin] RBAC: Authorizing `identity:get_project(project_id=ab3a61b677ab4ca3a098e4691426e1b2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.093740 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d211cd-1a27-487c-9adc-a574d0abff01 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.095413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 519/1060] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:57:56 2022] GET /identity/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:57.096165 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d211cd-1a27-487c-9adc-a574d0abff01 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.119198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:57.159892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962b151-6acf-4135-8ca2-e8789938fac9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.194850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964cd9a-ba23-495b-bad1-610d50235c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.195454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964cd9a-ba23-495b-bad1-610d50235c9c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.195733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964cd9a-ba23-495b-bad1-610d50235c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.196040 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964cd9a-ba23-495b-bad1-610d50235c9c None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.196730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964cd9a-ba23-495b-bad1-610d50235c9c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:57.197036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964cd9a-ba23-495b-bad1-610d50235c9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.198103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d211cd-1a27-487c-9adc-a574d0abff01 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.198431 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964cd9a-ba23-495b-bad1-610d50235c9c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.206708 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 542/1061] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Aug 30 04:57:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:57.207837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964cd9a-ba23-495b-bad1-610d50235c9c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.231782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36257028-849b-48aa-887e-98a63045150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.232436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36257028-849b-48aa-887e-98a63045150f None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.232721 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36257028-849b-48aa-887e-98a63045150f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.232991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36257028-849b-48aa-887e-98a63045150f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.233650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36257028-849b-48aa-887e-98a63045150f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.235011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36257028-849b-48aa-887e-98a63045150f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.239348 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:57.256101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 520/1062] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 04:57:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:57.257673 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36257028-849b-48aa-887e-98a63045150f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.325781 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964cd9a-ba23-495b-bad1-610d50235c9c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.354247 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:57.372003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55976fd-74bf-4d4b-9a64-717e09462012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.372893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55976fd-74bf-4d4b-9a64-717e09462012 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.372893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55976fd-74bf-4d4b-9a64-717e09462012 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.373153 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55976fd-74bf-4d4b-9a64-717e09462012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.373881 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55976fd-74bf-4d4b-9a64-717e09462012 None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=ab3a61b677ab4ca3a098e4691426e1b2, user.id=48d290ce072a424698480ec7ec43d49b) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:57.374186 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55976fd-74bf-4d4b-9a64-717e09462012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.375657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55976fd-74bf-4d4b-9a64-717e09462012 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.391979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 543/1063] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:57:57 2022] GET /identity/v3/role_assignments?user.id=48d290ce072a424698480ec7ec43d49b&scope.project.id=ab3a61b677ab4ca3a098e4691426e1b2&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:57.393650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36257028-849b-48aa-887e-98a63045150f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.435652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7546528-fafb-4fbb-913a-560fdbc84064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.436380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7546528-fafb-4fbb-913a-560fdbc84064 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.436660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7546528-fafb-4fbb-913a-560fdbc84064 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.436924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7546528-fafb-4fbb-913a-560fdbc84064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.452628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7546528-fafb-4fbb-913a-560fdbc84064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.454105 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7546528-fafb-4fbb-913a-560fdbc84064 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f7546528-fafb-4fbb-913a-560fdbc84064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:57.470697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:57.471736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:57.472917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:57.472917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:57.472917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:57.472917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 521/1064] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:57.479482 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55976fd-74bf-4d4b-9a64-717e09462012 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.576596 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:57.586785 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55976fd-74bf-4d4b-9a64-717e09462012 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.623628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3ffea-bb35-4861-8922-131e1e3bfc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.624610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3ffea-bb35-4861-8922-131e1e3bfc68 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.625095 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3ffea-bb35-4861-8922-131e1e3bfc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.625587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3ffea-bb35-4861-8922-131e1e3bfc68 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.626468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3ffea-bb35-4861-8922-131e1e3bfc68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:57.626971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3ffea-bb35-4861-8922-131e1e3bfc68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.628830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3ffea-bb35-4861-8922-131e1e3bfc68 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.642312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 544/1065] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:57.648341 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7546528-fafb-4fbb-913a-560fdbc84064 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.755784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7546528-fafb-4fbb-913a-560fdbc84064 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.783629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:57.792686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99917e5-44ce-4c21-b33a-00a3e77886b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.793387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99917e5-44ce-4c21-b33a-00a3e77886b2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.793668 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99917e5-44ce-4c21-b33a-00a3e77886b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.793941 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99917e5-44ce-4c21-b33a-00a3e77886b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.802356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99917e5-44ce-4c21-b33a-00a3e77886b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.803913 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99917e5-44ce-4c21-b33a-00a3e77886b2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b99917e5-44ce-4c21-b33a-00a3e77886b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:57:57.815922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:57.816955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:57.822412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:57.822412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:57.822412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:57:57.822412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:57:57.822412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:57:57.822412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:57:57.822412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:57:57.822412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:57:57.822412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:57:57.822412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:57.822412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 522/1066] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Aug 30 04:57:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:57.824222 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3ffea-bb35-4861-8922-131e1e3bfc68 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.926564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3ffea-bb35-4861-8922-131e1e3bfc68 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.963224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0369289-b348-4c9d-ad1e-9606dab95736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.963828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0369289-b348-4c9d-ad1e-9606dab95736 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.964129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0369289-b348-4c9d-ad1e-9606dab95736 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.964400 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0369289-b348-4c9d-ad1e-9606dab95736 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.965181 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0369289-b348-4c9d-ad1e-9606dab95736 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:57.965486 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0369289-b348-4c9d-ad1e-9606dab95736 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.966983 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0369289-b348-4c9d-ad1e-9606dab95736 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.987354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 545/1067] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Aug 30 04:57:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:57.993280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99917e5-44ce-4c21-b33a-00a3e77886b2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:58.097660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99917e5-44ce-4c21-b33a-00a3e77886b2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:58.131125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d559f99-be89-4e52-8798-87a9d0997fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:58.131787 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d559f99-be89-4e52-8798-87a9d0997fba None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:58.132090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d559f99-be89-4e52-8798-87a9d0997fba None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:58.132358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d559f99-be89-4e52-8798-87a9d0997fba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:58.142803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d559f99-be89-4e52-8798-87a9d0997fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:58.144260 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d559f99-be89-4e52-8798-87a9d0997fba None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1d559f99-be89-4e52-8798-87a9d0997fba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:57:58.158804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:58.159842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:57:58.160796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:57:58.160796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:57:58.160796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:58.164269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 523/1068] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:58.165675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0369289-b348-4c9d-ad1e-9606dab95736 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:58.180159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:58.273339 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0369289-b348-4c9d-ad1e-9606dab95736 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:58.308608 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150aa9e9-1630-4e29-b243-8ab4c52237c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:58.309250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150aa9e9-1630-4e29-b243-8ab4c52237c6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:58.309530 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150aa9e9-1630-4e29-b243-8ab4c52237c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:58.309856 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150aa9e9-1630-4e29-b243-8ab4c52237c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:58.310527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150aa9e9-1630-4e29-b243-8ab4c52237c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:58.310832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150aa9e9-1630-4e29-b243-8ab4c52237c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:58.312210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150aa9e9-1630-4e29-b243-8ab4c52237c6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:58.328233 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 546/1069] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:58.329848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d559f99-be89-4e52-8798-87a9d0997fba None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:58.377864 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:58.438030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d559f99-be89-4e52-8798-87a9d0997fba None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:58.477421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6f9bf-73db-4edc-843e-538f06dcbf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:58.478046 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6f9bf-73db-4edc-843e-538f06dcbf3d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:58.478318 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6f9bf-73db-4edc-843e-538f06dcbf3d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:58.478583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6f9bf-73db-4edc-843e-538f06dcbf3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:58.485084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6f9bf-73db-4edc-843e-538f06dcbf3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:58.486507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6f9bf-73db-4edc-843e-538f06dcbf3d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:58.498095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e0b6f9bf-73db-4edc-843e-538f06dcbf3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:58.498095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:58.498095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:58.498095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:58.498095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:58.498095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:58.498095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:58.498095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:58.498095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:58.498095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:58.498095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:58.498095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:58.498095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:57:58.498095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:57:58.498095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:58.499203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:58.501196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:57:58.501196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:57:58.501196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:57:58.501196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:57:58.501196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:57:58.501196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:57:58.501196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:57:58.501196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:57:58.501196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 524/1070] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:57:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:57:58.505246 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150aa9e9-1630-4e29-b243-8ab4c52237c6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:58.574242 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:58.606220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150aa9e9-1630-4e29-b243-8ab4c52237c6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:58.640240 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adc58e-6cf5-4590-b91f-6b662a4904fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:58.640851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adc58e-6cf5-4590-b91f-6b662a4904fa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:58.641175 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adc58e-6cf5-4590-b91f-6b662a4904fa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:58.641445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adc58e-6cf5-4590-b91f-6b662a4904fa None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:58.642130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adc58e-6cf5-4590-b91f-6b662a4904fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:58.642432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adc58e-6cf5-4590-b91f-6b662a4904fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:58.643839 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adc58e-6cf5-4590-b91f-6b662a4904fa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:58.655991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 547/1071] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:57:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:58.663243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6f9bf-73db-4edc-843e-538f06dcbf3d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:58.761637 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:58.769245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6f9bf-73db-4edc-843e-538f06dcbf3d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:58.805204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb208de-2415-474a-8f23-b5c95fb2c4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:58.805857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb208de-2415-474a-8f23-b5c95fb2c4d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:58.806131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb208de-2415-474a-8f23-b5c95fb2c4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:58.806399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb208de-2415-474a-8f23-b5c95fb2c4d3 None admin] PATH_INFO: `/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/1aa002909502426b80c97dbf05dca008/roles/4c2f9308c8fb42598460286c6520acb7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:58.808540 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb208de-2415-474a-8f23-b5c95fb2c4d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8aae17def04cf48190ede4bffefe70, user_id=1aa002909502426b80c97dbf05dca008, role_id=4c2f9308c8fb42598460286c6520acb7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:58.809978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb208de-2415-474a-8f23-b5c95fb2c4d3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:58.823435 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 525/1072] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:57:58 2022] PUT /identity/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/1aa002909502426b80c97dbf05dca008/roles/4c2f9308c8fb42598460286c6520acb7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:59.278064 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f314-3eac-4d21-85bc-6d8d1b61c62e None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:59.278593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f314-3eac-4d21-85bc-6d8d1b61c62e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:59.278889 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f314-3eac-4d21-85bc-6d8d1b61c62e None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:59.288034 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 548/1073] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:57:59.290748 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6358eb1-5f03-4502-b320-f9e2c94640e1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:59.291186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6358eb1-5f03-4502-b320-f9e2c94640e1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:59.291648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6358eb1-5f03-4502-b320-f9e2c94640e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:59.299380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05917b61-c6a1-4126-bf12-2f77bac664b4 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:59.299667 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05917b61-c6a1-4126-bf12-2f77bac664b4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:59.303971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05917b61-c6a1-4126-bf12-2f77bac664b4 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:59.305376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 549/1074] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:57:59.307191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3935b40-1815-4a62-92ef-32c8a6e8a413 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:59.307472 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3935b40-1815-4a62-92ef-32c8a6e8a413 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:59.307738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3935b40-1815-4a62-92ef-32c8a6e8a413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:59.322289 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f6358eb1-5f03-4502-b320-f9e2c94640e1 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:59.324285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f6358eb1-5f03-4502-b320-f9e2c94640e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:59.332432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a3935b40-1815-4a62-92ef-32c8a6e8a413 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:59.334264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a3935b40-1815-4a62-92ef-32c8a6e8a413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:59.422599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 526/1075] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:57:59.450022 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 550/1076] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:57:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:57:59.693842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6358eb1-5f03-4502-b320-f9e2c94640e1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:59.723131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3935b40-1815-4a62-92ef-32c8a6e8a413 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:59.784288 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:59.788316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:59.799433 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6358eb1-5f03-4502-b320-f9e2c94640e1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:59.833351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3935b40-1815-4a62-92ef-32c8a6e8a413 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:59.835769 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d9e53-e6b1-411a-a921-cd9b2f655b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:59.836414 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d9e53-e6b1-411a-a921-cd9b2f655b76 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:59.836688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d9e53-e6b1-411a-a921-cd9b2f655b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:59.836954 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d9e53-e6b1-411a-a921-cd9b2f655b76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:59.870469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ff532-6080-49e8-ac09-d9fd3dbbd78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:59.871100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ff532-6080-49e8-ac09-d9fd3dbbd78a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:59.871419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ff532-6080-49e8-ac09-d9fd3dbbd78a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:59.871644 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ff532-6080-49e8-ac09-d9fd3dbbd78a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:59.882272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ff532-6080-49e8-ac09-d9fd3dbbd78a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-fc8ff532-6080-49e8-ac09-d9fd3dbbd78a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:57:59.887057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:57:59.888138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:57:59.889016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:57:59.889016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:57:59.889016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:57:59.889016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:57:59.889016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:57:59.889016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:57:59.889016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:57:59.889016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:57:59.889016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:57:59.889016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:57:59.889016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:57:59.889016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:57:59.889016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 551/1077] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:57:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:57:59.894286 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ff532-6080-49e8-ac09-d9fd3dbbd78a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:59.916229 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d9e53-e6b1-411a-a921-cd9b2f655b76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:59.917943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d9e53-e6b1-411a-a921-cd9b2f655b76 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:00.005031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ff532-6080-49e8-ac09-d9fd3dbbd78a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:00.016769 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:00.028327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 527/1078] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:57:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:58:00.029275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:00.036219 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d9e53-e6b1-411a-a921-cd9b2f655b76 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:00.050197 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4f565-2c33-4eed-9543-3b1d0cc6b1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:00.050806 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4f565-2c33-4eed-9543-3b1d0cc6b1ce None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:00.051121 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4f565-2c33-4eed-9543-3b1d0cc6b1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:00.051391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4f565-2c33-4eed-9543-3b1d0cc6b1ce None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:00.052093 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4f565-2c33-4eed-9543-3b1d0cc6b1ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:00.052392 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4f565-2c33-4eed-9543-3b1d0cc6b1ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:00.053836 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4f565-2c33-4eed-9543-3b1d0cc6b1ce None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:00.062685 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 552/1079] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:57:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:58:00.068178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4f565-2c33-4eed-9543-3b1d0cc6b1ce None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:00.145707 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d9e53-e6b1-411a-a921-cd9b2f655b76 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:00.176448 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4f565-2c33-4eed-9543-3b1d0cc6b1ce None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:00.185472 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748aa5-d108-42b1-a1b2-1623004b650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:00.186094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748aa5-d108-42b1-a1b2-1623004b650f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:00.186352 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748aa5-d108-42b1-a1b2-1623004b650f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:00.186626 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748aa5-d108-42b1-a1b2-1623004b650f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:00.197592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd748aa5-d108-42b1-a1b2-1623004b650f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:00.199034 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd748aa5-d108-42b1-a1b2-1623004b650f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:00.213821 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3a7ca-cc81-4e06-9253-49db8bf3aa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-bd748aa5-d108-42b1-a1b2-1623004b650f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:58:00.214062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:58:00.215053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:58:00.215999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:58:00.215999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:58:00.215999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:58:00.216194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3a7ca-cc81-4e06-9253-49db8bf3aa49 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:00.216194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3a7ca-cc81-4e06-9253-49db8bf3aa49 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:00.216194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3a7ca-cc81-4e06-9253-49db8bf3aa49 None admin] PATH_INFO: `/v3/users/48d290ce072a424698480ec7ec43d49b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:00.217364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3a7ca-cc81-4e06-9253-49db8bf3aa49 None admin] RBAC: Authorizing `identity:get_user(user_id=48d290ce072a424698480ec7ec43d49b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:00.218786 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3a7ca-cc81-4e06-9253-49db8bf3aa49 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:00.220125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 528/1080] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:58:00.225223 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 553/1081] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:58:00 2022] GET /identity/v3/users/48d290ce072a424698480ec7ec43d49b => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:00.225356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748aa5-d108-42b1-a1b2-1623004b650f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:00.225966 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3a7ca-cc81-4e06-9253-49db8bf3aa49 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:00.268597 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:00.283386 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:00.331417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748aa5-d108-42b1-a1b2-1623004b650f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:00.349545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3a7ca-cc81-4e06-9253-49db8bf3aa49 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:00.372387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb1c41-b5a9-4824-b72b-a93766dee062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:00.373176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb1c41-b5a9-4824-b72b-a93766dee062 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:00.373455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb1c41-b5a9-4824-b72b-a93766dee062 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:00.373726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb1c41-b5a9-4824-b72b-a93766dee062 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:00.374373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb1c41-b5a9-4824-b72b-a93766dee062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:00.374671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb1c41-b5a9-4824-b72b-a93766dee062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:00.376099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb1c41-b5a9-4824-b72b-a93766dee062 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:00.386743 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f33bc-0f5c-481f-82c9-b284e116c094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:00.387608 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f33bc-0f5c-481f-82c9-b284e116c094 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:00.388061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f33bc-0f5c-481f-82c9-b284e116c094 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:00.388484 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f33bc-0f5c-481f-82c9-b284e116c094 None admin] PATH_INFO: `/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:00.389493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 529/1082] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:00.390061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f33bc-0f5c-481f-82c9-b284e116c094 None admin] RBAC: Authorizing `identity:get_project(project_id=ab3a61b677ab4ca3a098e4691426e1b2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:00.391578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f33bc-0f5c-481f-82c9-b284e116c094 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:00.393451 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 554/1083] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:58:00 2022] GET /identity/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:58:00.400626 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb1c41-b5a9-4824-b72b-a93766dee062 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:00.510966 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb1c41-b5a9-4824-b72b-a93766dee062 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:00.512699 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:00.551487 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405311a6-29f6-45f7-bbb9-ba31f6dd036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:00.552099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405311a6-29f6-45f7-bbb9-ba31f6dd036d None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:00.552377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405311a6-29f6-45f7-bbb9-ba31f6dd036d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:00.552648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405311a6-29f6-45f7-bbb9-ba31f6dd036d None admin] PATH_INFO: `/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2/users/48d290ce072a424698480ec7ec43d49b/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:00.554584 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405311a6-29f6-45f7-bbb9-ba31f6dd036d None admin] RBAC: Authorizing `identity:create_grant(project_id=ab3a61b677ab4ca3a098e4691426e1b2, user_id=48d290ce072a424698480ec7ec43d49b, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:00.556039 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405311a6-29f6-45f7-bbb9-ba31f6dd036d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:00.570776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 530/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:58:00 2022] PUT /identity/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2/users/48d290ce072a424698480ec7ec43d49b/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:58:00.770782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521175b-f577-4120-9f5a-d6ddcb240534 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:00.771061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521175b-f577-4120-9f5a-d6ddcb240534 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:00.771330 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521175b-f577-4120-9f5a-d6ddcb240534 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:00.772732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 555/1085] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:00.777820 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1d4be-bb82-43a8-b0b6-d7a0afbd5f56 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:00.778105 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1d4be-bb82-43a8-b0b6-d7a0afbd5f56 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:00.778378 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1d4be-bb82-43a8-b0b6-d7a0afbd5f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:00.797062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-37d1d4be-bb82-43a8-b0b6-d7a0afbd5f56 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:00.798243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-37d1d4be-bb82-43a8-b0b6-d7a0afbd5f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:00.863376 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 531/1086] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:01.130801 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521175b-f577-4120-9f5a-d6ddcb240534 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:01.232312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521175b-f577-4120-9f5a-d6ddcb240534 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:01.249121 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:01.267635 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b173b1-12aa-4f4d-a737-958687bf1735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:01.268281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b173b1-12aa-4f4d-a737-958687bf1735 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:01.268562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b173b1-12aa-4f4d-a737-958687bf1735 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:01.268836 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b173b1-12aa-4f4d-a737-958687bf1735 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:01.279156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b173b1-12aa-4f4d-a737-958687bf1735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-a5b173b1-12aa-4f4d-a737-958687bf1735 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:58:01.283934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:58:01.285531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:58:01.286677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:58:01.286677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:58:01.286677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:58:01.286677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:58:01.286677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:58:01.286677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:58:01.286677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:58:01.286677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:58:01.286677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:58:01.286677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:58:01.286677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:58:01.286677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:58:01.286677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 556/1087] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Aug 30 04:58:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:58:01.291050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1d4be-bb82-43a8-b0b6-d7a0afbd5f56 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:01.387786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:01.397267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1d4be-bb82-43a8-b0b6-d7a0afbd5f56 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:01.430915 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350c4db-515f-4cf2-8273-cebe5e9103f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:01.431514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c4db-515f-4cf2-8273-cebe5e9103f4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:01.431790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c4db-515f-4cf2-8273-cebe5e9103f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:01.432164 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c4db-515f-4cf2-8273-cebe5e9103f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:01.432821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350c4db-515f-4cf2-8273-cebe5e9103f4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:01.433119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350c4db-515f-4cf2-8273-cebe5e9103f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:01.434473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350c4db-515f-4cf2-8273-cebe5e9103f4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:01.442308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 532/1088] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Aug 30 04:58:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:01.448024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b173b1-12aa-4f4d-a737-958687bf1735 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:01.546920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b173b1-12aa-4f4d-a737-958687bf1735 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:01.579852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d717b-e147-419e-893c-cc9d21103d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:01.580506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d717b-e147-419e-893c-cc9d21103d25 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:01.580782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d717b-e147-419e-893c-cc9d21103d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:01.581054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d717b-e147-419e-893c-cc9d21103d25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:01.591378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d717b-e147-419e-893c-cc9d21103d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:01.592898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d717b-e147-419e-893c-cc9d21103d25 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-df0d717b-e147-419e-893c-cc9d21103d25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:58:01.607018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:58:01.608250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:58:01.609189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:58:01.609189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:58:01.609189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:58:01.609189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 557/1089] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:58:01.613967 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350c4db-515f-4cf2-8273-cebe5e9103f4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:01.721945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350c4db-515f-4cf2-8273-cebe5e9103f4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:01.755103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5b3d0-2154-4989-8303-c33ca6d62dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:01.755695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5b3d0-2154-4989-8303-c33ca6d62dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:01.755994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5b3d0-2154-4989-8303-c33ca6d62dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:01.756828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5b3d0-2154-4989-8303-c33ca6d62dd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:01.757459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5b3d0-2154-4989-8303-c33ca6d62dd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:01.757779 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5b3d0-2154-4989-8303-c33ca6d62dd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:01.759120 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5b3d0-2154-4989-8303-c33ca6d62dd9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:01.770378 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 533/1090] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:01.776027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d717b-e147-419e-893c-cc9d21103d25 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:01.807770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:01.874896 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d717b-e147-419e-893c-cc9d21103d25 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:01.908004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde81ce-c202-4584-8f27-595aa79d26d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:01.908629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde81ce-c202-4584-8f27-595aa79d26d8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:01.908899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde81ce-c202-4584-8f27-595aa79d26d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:01.909181 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde81ce-c202-4584-8f27-595aa79d26d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:01.916403 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde81ce-c202-4584-8f27-595aa79d26d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:01.917817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde81ce-c202-4584-8f27-595aa79d26d8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-bfde81ce-c202-4584-8f27-595aa79d26d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:58:01.929258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:58:01.930398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:58:01.931646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:58:01.931646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:58:01.931646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:58:01.931646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:58:01.931646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:58:01.931646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:58:01.931646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:58:01.931646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:58:01.931646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:58:01.931646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:58:01.931646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 558/1091] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Aug 30 04:58:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:58:01.936230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5b3d0-2154-4989-8303-c33ca6d62dd9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:01.952136 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:02.042741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5b3d0-2154-4989-8303-c33ca6d62dd9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:02.077657 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e05e9-151a-42bf-b5d7-be7c3ad417fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:02.078258 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e05e9-151a-42bf-b5d7-be7c3ad417fe None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:02.078532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e05e9-151a-42bf-b5d7-be7c3ad417fe None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:02.078798 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e05e9-151a-42bf-b5d7-be7c3ad417fe None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:02.079525 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e05e9-151a-42bf-b5d7-be7c3ad417fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:02.079827 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e05e9-151a-42bf-b5d7-be7c3ad417fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:02.081280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e05e9-151a-42bf-b5d7-be7c3ad417fe None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:02.098933 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 534/1092] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Aug 30 04:58:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:02.105239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde81ce-c202-4584-8f27-595aa79d26d8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:02.194491 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:02.204436 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde81ce-c202-4584-8f27-595aa79d26d8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:02.237567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a86d0-f0ac-4bb2-a1a8-c47a0585fcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:02.238097 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a86d0-f0ac-4bb2-a1a8-c47a0585fcc8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:02.238372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a86d0-f0ac-4bb2-a1a8-c47a0585fcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:02.238642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a86d0-f0ac-4bb2-a1a8-c47a0585fcc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:02.305360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a86d0-f0ac-4bb2-a1a8-c47a0585fcc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:02.306788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a86d0-f0ac-4bb2-a1a8-c47a0585fcc8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:02.393456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:02.404479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 559/1093] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:58:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:58:02.410365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e05e9-151a-42bf-b5d7-be7c3ad417fe None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:02.463727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fee51-2fcb-4568-adf2-ff9d708ee879 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:02.464041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fee51-2fcb-4568-adf2-ff9d708ee879 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:02.464322 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fee51-2fcb-4568-adf2-ff9d708ee879 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:02.465670 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 560/1094] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:58:02.470741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238df12b-ecc2-455a-9aaf-36dbde893819 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:02.471018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238df12b-ecc2-455a-9aaf-36dbde893819 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:02.471286 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238df12b-ecc2-455a-9aaf-36dbde893819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:02.483400 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:02.489820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-238df12b-ecc2-455a-9aaf-36dbde893819 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:02.490961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-238df12b-ecc2-455a-9aaf-36dbde893819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:02.517993 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e05e9-151a-42bf-b5d7-be7c3ad417fe None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:02.553505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c531a3b-4bc6-4a33-9643-0ec5c8b58c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:02.554125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c531a3b-4bc6-4a33-9643-0ec5c8b58c67 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:02.554395 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c531a3b-4bc6-4a33-9643-0ec5c8b58c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:02.554657 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c531a3b-4bc6-4a33-9643-0ec5c8b58c67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:02.560001 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 561/1095] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:58:02.564457 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c531a3b-4bc6-4a33-9643-0ec5c8b58c67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:02.565893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c531a3b-4bc6-4a33-9643-0ec5c8b58c67 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1c531a3b-4bc6-4a33-9643-0ec5c8b58c67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:58:02.580131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:58:02.586343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:58:02.587505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:58:02.587505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:58:02.587505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:58:02.587505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 535/1096] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:58:02.587796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238df12b-ecc2-455a-9aaf-36dbde893819 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:02.683148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238df12b-ecc2-455a-9aaf-36dbde893819 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:02.703351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:02.718368 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff340e4a-c60c-4294-bf1a-856ee17b68b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:02.718971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff340e4a-c60c-4294-bf1a-856ee17b68b1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:02.719250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff340e4a-c60c-4294-bf1a-856ee17b68b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:02.719523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff340e4a-c60c-4294-bf1a-856ee17b68b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:02.720184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff340e4a-c60c-4294-bf1a-856ee17b68b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:02.720489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff340e4a-c60c-4294-bf1a-856ee17b68b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:02.721848 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff340e4a-c60c-4294-bf1a-856ee17b68b1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:02.732861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 562/1097] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:02.738320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c531a3b-4bc6-4a33-9643-0ec5c8b58c67 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:02.830534 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff340e4a-c60c-4294-bf1a-856ee17b68b1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:02.837231 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c531a3b-4bc6-4a33-9643-0ec5c8b58c67 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:02.860157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:02.870991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230e84a-9277-40a1-870f-a2eb8303c44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:02.871615 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e84a-9277-40a1-870f-a2eb8303c44b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:02.871889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e84a-9277-40a1-870f-a2eb8303c44b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:02.872183 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e84a-9277-40a1-870f-a2eb8303c44b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:02.879028 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230e84a-9277-40a1-870f-a2eb8303c44b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:02.880491 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230e84a-9277-40a1-870f-a2eb8303c44b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:02.891932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-6230e84a-9277-40a1-870f-a2eb8303c44b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:58:02.891932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:58:02.891932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:58:02.891932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:58:02.891932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:58:02.891932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:58:02.891932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:58:02.891932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:58:02.891932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:58:02.891932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:58:02.891932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:58:02.891932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:58:02.891932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:58:02.891932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:58:02.891932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:58:02.892835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:58:02.899171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:58:02.899171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:58:02.899171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:58:02.899171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:58:02.899171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:58:02.899171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:58:02.899171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:58:02.899171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:58:02.899171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 536/1098] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:58:02.899660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230e84a-9277-40a1-870f-a2eb8303c44b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:02.932172 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff340e4a-c60c-4294-bf1a-856ee17b68b1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:02.965853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c82623-a804-48a0-92fb-4d9c7ec35ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:02.966475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c82623-a804-48a0-92fb-4d9c7ec35ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:02.966744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c82623-a804-48a0-92fb-4d9c7ec35ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:02.967009 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c82623-a804-48a0-92fb-4d9c7ec35ec2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:02.978051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c82623-a804-48a0-92fb-4d9c7ec35ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-63c82623-a804-48a0-92fb-4d9c7ec35ec2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:58:02.982828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:58:02.983865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:58:02.984767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:58:02.984767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:58:02.984767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:58:02.984767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:58:02.984767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:58:02.984767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:58:02.984767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:58:02.984767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:58:02.984767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:58:02.984767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:58:02.984767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:58:02.984767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:58:02.988245 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 563/1099] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:58:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:58:02.989869 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c82623-a804-48a0-92fb-4d9c7ec35ec2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:03.003447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230e84a-9277-40a1-870f-a2eb8303c44b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:03.032180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:03.037932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561860b-5684-4234-ad0e-17972db3ef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:03.038538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561860b-5684-4234-ad0e-17972db3ef72 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:03.038809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561860b-5684-4234-ad0e-17972db3ef72 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:03.039072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561860b-5684-4234-ad0e-17972db3ef72 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:03.039768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561860b-5684-4234-ad0e-17972db3ef72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:03.040100 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561860b-5684-4234-ad0e-17972db3ef72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:03.041535 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561860b-5684-4234-ad0e-17972db3ef72 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:03.054471 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 537/1100] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:58:03.060083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561860b-5684-4234-ad0e-17972db3ef72 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:03.092340 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c82623-a804-48a0-92fb-4d9c7ec35ec2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:03.104074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:03.126230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda2f2d-2e50-4046-9b0e-9a6d2b26ef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:03.126837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda2f2d-2e50-4046-9b0e-9a6d2b26ef31 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:03.127370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda2f2d-2e50-4046-9b0e-9a6d2b26ef31 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:03.127645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda2f2d-2e50-4046-9b0e-9a6d2b26ef31 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:03.128332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda2f2d-2e50-4046-9b0e-9a6d2b26ef31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:03.128631 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda2f2d-2e50-4046-9b0e-9a6d2b26ef31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:03.129981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda2f2d-2e50-4046-9b0e-9a6d2b26ef31 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:03.139298 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 564/1101] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:58:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:58:03.145026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda2f2d-2e50-4046-9b0e-9a6d2b26ef31 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:03.162095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561860b-5684-4234-ad0e-17972db3ef72 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:03.196723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378751ab-0308-4d88-94c1-14b94e6f145c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:03.197238 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378751ab-0308-4d88-94c1-14b94e6f145c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:03.197588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378751ab-0308-4d88-94c1-14b94e6f145c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:03.197859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378751ab-0308-4d88-94c1-14b94e6f145c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:03.198576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378751ab-0308-4d88-94c1-14b94e6f145c None admin] RBAC: Adding query filter params (role.id=4c2f9308c8fb42598460286c6520acb7, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=1aa002909502426b80c97dbf05dca008) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:03.198875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378751ab-0308-4d88-94c1-14b94e6f145c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:03.200321 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378751ab-0308-4d88-94c1-14b94e6f145c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:03.205909 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 538/1102] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:58:03 2022] GET /identity/v3/role_assignments?user.id=1aa002909502426b80c97dbf05dca008&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=4c2f9308c8fb42598460286c6520acb7 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:58:03.250218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda2f2d-2e50-4046-9b0e-9a6d2b26ef31 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:03.252010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:03.289458 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e0de4-3996-464c-9b60-ae067b1d67b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:03.290109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e0de4-3996-464c-9b60-ae067b1d67b1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:03.290388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e0de4-3996-464c-9b60-ae067b1d67b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:03.290660 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e0de4-3996-464c-9b60-ae067b1d67b1 None admin] PATH_INFO: `/v3/users/48d290ce072a424698480ec7ec43d49b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:03.291837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e0de4-3996-464c-9b60-ae067b1d67b1 None admin] RBAC: Authorizing `identity:get_user(user_id=48d290ce072a424698480ec7ec43d49b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:03.293313 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e0de4-3996-464c-9b60-ae067b1d67b1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:03.294980 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 565/1103] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:58:03 2022] GET /identity/v3/users/48d290ce072a424698480ec7ec43d49b => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:03.301061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378751ab-0308-4d88-94c1-14b94e6f145c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:03.406705 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378751ab-0308-4d88-94c1-14b94e6f145c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:03.416542 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:03.444269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de2a64-91fb-4150-86c8-8ab4570154ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:03.444877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de2a64-91fb-4150-86c8-8ab4570154ed None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:03.445145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de2a64-91fb-4150-86c8-8ab4570154ed None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:03.445407 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de2a64-91fb-4150-86c8-8ab4570154ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:03.512112 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de2a64-91fb-4150-86c8-8ab4570154ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:03.513543 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de2a64-91fb-4150-86c8-8ab4570154ed None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:03.612167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 539/1104] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:58:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:58:03.619114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e0de4-3996-464c-9b60-ae067b1d67b1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:03.721692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e0de4-3996-464c-9b60-ae067b1d67b1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:03.758789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c704a-64a1-43c5-9f9b-2caf48435cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:03.759415 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c704a-64a1-43c5-9f9b-2caf48435cce None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:03.759693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c704a-64a1-43c5-9f9b-2caf48435cce None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:03.759984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c704a-64a1-43c5-9f9b-2caf48435cce None admin] PATH_INFO: `/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:03.761106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c704a-64a1-43c5-9f9b-2caf48435cce None admin] RBAC: Authorizing `identity:get_project(project_id=ab3a61b677ab4ca3a098e4691426e1b2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:03.762529 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c704a-64a1-43c5-9f9b-2caf48435cce None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:03.764185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 566/1105] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:58:03 2022] GET /identity/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:03.770558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de2a64-91fb-4150-86c8-8ab4570154ed None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:03.781011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:03.875039 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de2a64-91fb-4150-86c8-8ab4570154ed None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:03.910902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4730fb-0466-404f-9302-c09af7935908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:03.911509 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4730fb-0466-404f-9302-c09af7935908 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:03.911784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4730fb-0466-404f-9302-c09af7935908 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:03.912088 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4730fb-0466-404f-9302-c09af7935908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:03.913350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4730fb-0466-404f-9302-c09af7935908 None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=ab3a61b677ab4ca3a098e4691426e1b2, user.id=48d290ce072a424698480ec7ec43d49b) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:03.913657 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4730fb-0466-404f-9302-c09af7935908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:03.915090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4730fb-0466-404f-9302-c09af7935908 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:03.921072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 540/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:58:03 2022] GET /identity/v3/role_assignments?user.id=48d290ce072a424698480ec7ec43d49b&scope.project.id=ab3a61b677ab4ca3a098e4691426e1b2&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:05.919438 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb339b-9d89-440e-8a65-9ba4f1e12fd3 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:05.919992 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb339b-9d89-440e-8a65-9ba4f1e12fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:05.919992 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb339b-9d89-440e-8a65-9ba4f1e12fd3 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:05.921348 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 567/1107] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:05.926712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ea797-487f-4133-979d-832310d1e2dc None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:05.927171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ea797-487f-4133-979d-832310d1e2dc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:05.927266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ea797-487f-4133-979d-832310d1e2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:05.946533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ae2ea797-487f-4133-979d-832310d1e2dc None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:05.947716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ae2ea797-487f-4133-979d-832310d1e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:06.015438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 541/1108] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:06.296587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb339b-9d89-440e-8a65-9ba4f1e12fd3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:06.339665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:06.405000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb339b-9d89-440e-8a65-9ba4f1e12fd3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:06.439690 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a2fd7-5941-4b7f-a88a-a7121ed9cb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:06.440349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a2fd7-5941-4b7f-a88a-a7121ed9cb8c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:06.440630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a2fd7-5941-4b7f-a88a-a7121ed9cb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:06.440900 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a2fd7-5941-4b7f-a88a-a7121ed9cb8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:06.442012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a2fd7-5941-4b7f-a88a-a7121ed9cb8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:06.443470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a2fd7-5941-4b7f-a88a-a7121ed9cb8c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:06.445074 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 568/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:58:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:06.450964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ea797-487f-4133-979d-832310d1e2dc None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:06.453269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:06.559293 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ea797-487f-4133-979d-832310d1e2dc None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:06.593321 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4189a8a-cd7a-4757-b136-e484d888cdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:06.593935 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4189a8a-cd7a-4757-b136-e484d888cdfc None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:06.594215 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4189a8a-cd7a-4757-b136-e484d888cdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:06.594485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4189a8a-cd7a-4757-b136-e484d888cdfc None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:06.595145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4189a8a-cd7a-4757-b136-e484d888cdfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:06.596645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4189a8a-cd7a-4757-b136-e484d888cdfc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:06.617319 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 542/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:58:06 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:58:08.553429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76d716-7f86-40a5-8b9a-5857b13ce64a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:08.554153 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76d716-7f86-40a5-8b9a-5857b13ce64a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:08.554153 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76d716-7f86-40a5-8b9a-5857b13ce64a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:08.555354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 569/1111] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:08.561304 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a8c6-04ef-408f-aae7-a40008380524 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:08.561805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a8c6-04ef-408f-aae7-a40008380524 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:08.561907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a8c6-04ef-408f-aae7-a40008380524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:08.580790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6ad0a8c6-04ef-408f-aae7-a40008380524 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:08.582004 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6ad0a8c6-04ef-408f-aae7-a40008380524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:08.640160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:08.656601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 543/1112] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:08.932826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76d716-7f86-40a5-8b9a-5857b13ce64a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:09.038539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76d716-7f86-40a5-8b9a-5857b13ce64a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:09.046204 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:09.073542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4241fa4-b381-48e3-b55a-040a85f082f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:09.074167 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4241fa4-b381-48e3-b55a-040a85f082f1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:09.074440 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4241fa4-b381-48e3-b55a-040a85f082f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:09.074708 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4241fa4-b381-48e3-b55a-040a85f082f1 None admin] PATH_INFO: `/v3/roles/1201453b538f4257a1dc8723d67c0cdd` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:09.076131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4241fa4-b381-48e3-b55a-040a85f082f1 None admin] RBAC: Authorizing `identity:get_role(role_id=1201453b538f4257a1dc8723d67c0cdd)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:09.077488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4241fa4-b381-48e3-b55a-040a85f082f1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:09.078800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 570/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:58:08 2022] GET /identity/v3/roles/1201453b538f4257a1dc8723d67c0cdd => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:09.084833 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0a8c6-04ef-408f-aae7-a40008380524 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:09.193262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0a8c6-04ef-408f-aae7-a40008380524 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:09.227370 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8084a-ab31-417e-9246-55e0da2ff705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:09.228024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8084a-ab31-417e-9246-55e0da2ff705 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:09.228303 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8084a-ab31-417e-9246-55e0da2ff705 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:09.228573 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8084a-ab31-417e-9246-55e0da2ff705 None admin] PATH_INFO: `/v3/users/39fb27bb6ac44b9782fa0faf8120e120` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:09.241685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8084a-ab31-417e-9246-55e0da2ff705 None admin] RBAC: Authorizing `identity:get_user(user_id=39fb27bb6ac44b9782fa0faf8120e120)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:09.243124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8084a-ab31-417e-9246-55e0da2ff705 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:09.244767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 544/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:58:09 2022] GET /identity/v3/users/39fb27bb6ac44b9782fa0faf8120e120 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:58:09.250633 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4241fa4-b381-48e3-b55a-040a85f082f1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:09.350159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4241fa4-b381-48e3-b55a-040a85f082f1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:09.384012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94823fab-85ea-401e-9c90-eabaf6ead5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:09.384613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94823fab-85ea-401e-9c90-eabaf6ead5df None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:09.384888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94823fab-85ea-401e-9c90-eabaf6ead5df None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:09.385156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94823fab-85ea-401e-9c90-eabaf6ead5df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:09.427986 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:09.453173 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94823fab-85ea-401e-9c90-eabaf6ead5df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:09.454541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94823fab-85ea-401e-9c90-eabaf6ead5df None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:09.553865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 571/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:58:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:58:09.559828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8084a-ab31-417e-9246-55e0da2ff705 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:09.605317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:09.660246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8084a-ab31-417e-9246-55e0da2ff705 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:09.697257 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef096cc-9a53-4474-9c2a-cc5afbec20ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:09.697914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef096cc-9a53-4474-9c2a-cc5afbec20ee None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:09.698195 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef096cc-9a53-4474-9c2a-cc5afbec20ee None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:09.698468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef096cc-9a53-4474-9c2a-cc5afbec20ee None admin] PATH_INFO: `/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:09.699602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef096cc-9a53-4474-9c2a-cc5afbec20ee None admin] RBAC: Authorizing `identity:get_project(project_id=ab3a61b677ab4ca3a098e4691426e1b2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:09.701067 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef096cc-9a53-4474-9c2a-cc5afbec20ee None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:09.702722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 545/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:58:09 2022] GET /identity/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:09.709564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94823fab-85ea-401e-9c90-eabaf6ead5df None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:09.790228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:09.821992 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94823fab-85ea-401e-9c90-eabaf6ead5df None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:09.861675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966e242-23a0-40a4-9ba4-ccf5931e3d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:09.862264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966e242-23a0-40a4-9ba4-ccf5931e3d7c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:09.862538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966e242-23a0-40a4-9ba4-ccf5931e3d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:09.862802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966e242-23a0-40a4-9ba4-ccf5931e3d7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:09.863518 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966e242-23a0-40a4-9ba4-ccf5931e3d7c None admin] RBAC: Adding query filter params (role.id=1201453b538f4257a1dc8723d67c0cdd, scope.project.id=ab3a61b677ab4ca3a098e4691426e1b2, user.id=39fb27bb6ac44b9782fa0faf8120e120) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:09.863814 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966e242-23a0-40a4-9ba4-ccf5931e3d7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:09.865257 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966e242-23a0-40a4-9ba4-ccf5931e3d7c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:09.870802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 572/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:58:09 2022] GET /identity/v3/role_assignments?user.id=39fb27bb6ac44b9782fa0faf8120e120&scope.project.id=ab3a61b677ab4ca3a098e4691426e1b2&role.id=1201453b538f4257a1dc8723d67c0cdd => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:11.749271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb0834-eb2a-4702-965c-c3210a416801 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:11.749826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb0834-eb2a-4702-965c-c3210a416801 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:11.749826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb0834-eb2a-4702-965c-c3210a416801 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:11.751148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 546/1118] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:11.757262 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e0907-8360-43e9-829c-912538db392a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:11.757686 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e0907-8360-43e9-829c-912538db392a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:11.757814 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e0907-8360-43e9-829c-912538db392a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:11.776122 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a89e0907-8360-43e9-829c-912538db392a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:11.777309 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a89e0907-8360-43e9-829c-912538db392a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:11.841594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 573/1119] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:12.106663 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb0834-eb2a-4702-965c-c3210a416801 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:12.204767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb0834-eb2a-4702-965c-c3210a416801 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:12.219226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:12.239393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481b5d4-1c3f-4f28-899e-cbd3686be928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:12.240058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481b5d4-1c3f-4f28-899e-cbd3686be928 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:12.240333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481b5d4-1c3f-4f28-899e-cbd3686be928 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:12.240597 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481b5d4-1c3f-4f28-899e-cbd3686be928 None admin] PATH_INFO: `/v3/roles/1201453b538f4257a1dc8723d67c0cdd` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:12.241951 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481b5d4-1c3f-4f28-899e-cbd3686be928 None admin] RBAC: Authorizing `identity:get_role(role_id=1201453b538f4257a1dc8723d67c0cdd)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:12.243293 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481b5d4-1c3f-4f28-899e-cbd3686be928 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:12.244629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 547/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:58:12 2022] GET /identity/v3/roles/1201453b538f4257a1dc8723d67c0cdd => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:12.250456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e0907-8360-43e9-829c-912538db392a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:12.314726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:12.347186 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e0907-8360-43e9-829c-912538db392a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:12.381306 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7a4d2-b428-4f91-9f50-348eb01821b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:12.381868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7a4d2-b428-4f91-9f50-348eb01821b7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:12.382141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7a4d2-b428-4f91-9f50-348eb01821b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:12.382409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7a4d2-b428-4f91-9f50-348eb01821b7 None admin] PATH_INFO: `/v3/users/39fb27bb6ac44b9782fa0faf8120e120` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:12.383508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7a4d2-b428-4f91-9f50-348eb01821b7 None admin] RBAC: Authorizing `identity:get_user(user_id=39fb27bb6ac44b9782fa0faf8120e120)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:12.384950 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7a4d2-b428-4f91-9f50-348eb01821b7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:12.386496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 574/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:58:12 2022] GET /identity/v3/users/39fb27bb6ac44b9782fa0faf8120e120 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:12.392401 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481b5d4-1c3f-4f28-899e-cbd3686be928 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:12.490208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481b5d4-1c3f-4f28-899e-cbd3686be928 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:12.523253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21fdb3-e687-4ce4-9578-4891ba4c275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:12.523877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21fdb3-e687-4ce4-9578-4891ba4c275a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:12.524179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21fdb3-e687-4ce4-9578-4891ba4c275a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:12.524447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21fdb3-e687-4ce4-9578-4891ba4c275a None admin] PATH_INFO: `/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:12.525547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21fdb3-e687-4ce4-9578-4891ba4c275a None admin] RBAC: Authorizing `identity:get_project(project_id=ab3a61b677ab4ca3a098e4691426e1b2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:12.526966 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21fdb3-e687-4ce4-9578-4891ba4c275a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:12.528602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 548/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:58:12 2022] GET /identity/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:12.534669 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7a4d2-b428-4f91-9f50-348eb01821b7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:12.632472 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7a4d2-b428-4f91-9f50-348eb01821b7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:12.665408 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ec51b-6f14-4838-ad17-9b3193717070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:12.666057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ec51b-6f14-4838-ad17-9b3193717070 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:12.666333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ec51b-6f14-4838-ad17-9b3193717070 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:12.666605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ec51b-6f14-4838-ad17-9b3193717070 None admin] PATH_INFO: `/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2/users/39fb27bb6ac44b9782fa0faf8120e120/roles/1201453b538f4257a1dc8723d67c0cdd` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:12.668718 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ec51b-6f14-4838-ad17-9b3193717070 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab3a61b677ab4ca3a098e4691426e1b2, user_id=39fb27bb6ac44b9782fa0faf8120e120, role_id=1201453b538f4257a1dc8723d67c0cdd)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:12.670128 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ec51b-6f14-4838-ad17-9b3193717070 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:12.673070 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:12.685082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 575/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:58:12 2022] PUT /identity/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2/users/39fb27bb6ac44b9782fa0faf8120e120/roles/1201453b538f4257a1dc8723d67c0cdd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:58:14.558502 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbecc4-0b09-4a42-b1b0-87ec608b7332 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:14.559061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbecc4-0b09-4a42-b1b0-87ec608b7332 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:14.559061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbecc4-0b09-4a42-b1b0-87ec608b7332 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:14.560416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 549/1124] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:14.565467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5900d-e430-4f63-b37c-719b3705e208 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:14.565883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5900d-e430-4f63-b37c-719b3705e208 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:14.566009 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5900d-e430-4f63-b37c-719b3705e208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:14.586195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ffb5900d-e430-4f63-b37c-719b3705e208 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:14.587377 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ffb5900d-e430-4f63-b37c-719b3705e208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:14.653840 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 576/1125] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:58:14.920725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbecc4-0b09-4a42-b1b0-87ec608b7332 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:14.971358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:15.026296 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbecc4-0b09-4a42-b1b0-87ec608b7332 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:15.061310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b749558-6383-4d4d-9063-de82b704e0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:15.061926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b749558-6383-4d4d-9063-de82b704e0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:15.062199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b749558-6383-4d4d-9063-de82b704e0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:15.062462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b749558-6383-4d4d-9063-de82b704e0d5 None admin] PATH_INFO: `/v3/roles/1201453b538f4257a1dc8723d67c0cdd` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:15.063813 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b749558-6383-4d4d-9063-de82b704e0d5 None admin] RBAC: Authorizing `identity:get_role(role_id=1201453b538f4257a1dc8723d67c0cdd)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:15.065207 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b749558-6383-4d4d-9063-de82b704e0d5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:15.066728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 550/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:58:14 2022] GET /identity/v3/roles/1201453b538f4257a1dc8723d67c0cdd => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:15.072544 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5900d-e430-4f63-b37c-719b3705e208 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:15.180492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5900d-e430-4f63-b37c-719b3705e208 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:15.206114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:15.215965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a3b5a-6d2c-4252-890e-02e60f9f31c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:15.216603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a3b5a-6d2c-4252-890e-02e60f9f31c2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:15.216878 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a3b5a-6d2c-4252-890e-02e60f9f31c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:15.217428 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a3b5a-6d2c-4252-890e-02e60f9f31c2 None admin] PATH_INFO: `/v3/users/39fb27bb6ac44b9782fa0faf8120e120` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:15.218254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a3b5a-6d2c-4252-890e-02e60f9f31c2 None admin] RBAC: Authorizing `identity:get_user(user_id=39fb27bb6ac44b9782fa0faf8120e120)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:15.219667 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a3b5a-6d2c-4252-890e-02e60f9f31c2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:15.221267 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 577/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:58:15 2022] GET /identity/v3/users/39fb27bb6ac44b9782fa0faf8120e120 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:15.227601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b749558-6383-4d4d-9063-de82b704e0d5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:15.337468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b749558-6383-4d4d-9063-de82b704e0d5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:15.355397 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:15.372724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828fdbb-9dba-4fcb-9e62-5c4ab07b25d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:15.373332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828fdbb-9dba-4fcb-9e62-5c4ab07b25d2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:15.373607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828fdbb-9dba-4fcb-9e62-5c4ab07b25d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:15.373878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828fdbb-9dba-4fcb-9e62-5c4ab07b25d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:15.449470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828fdbb-9dba-4fcb-9e62-5c4ab07b25d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:15.450821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828fdbb-9dba-4fcb-9e62-5c4ab07b25d2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:15.548486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 551/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:58:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:58:15.554583 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a3b5a-6d2c-4252-890e-02e60f9f31c2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:15.663235 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a3b5a-6d2c-4252-890e-02e60f9f31c2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:15.696458 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c88e9-c489-4e97-85d7-2df0134f264d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:15.697102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c88e9-c489-4e97-85d7-2df0134f264d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:15.697375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c88e9-c489-4e97-85d7-2df0134f264d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:15.697641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c88e9-c489-4e97-85d7-2df0134f264d None admin] PATH_INFO: `/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:15.698755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c88e9-c489-4e97-85d7-2df0134f264d None admin] RBAC: Authorizing `identity:get_project(project_id=ab3a61b677ab4ca3a098e4691426e1b2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:15.700240 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c88e9-c489-4e97-85d7-2df0134f264d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:15.701791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 578/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:58:15 2022] GET /identity/v3/projects/ab3a61b677ab4ca3a098e4691426e1b2 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:15.708091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828fdbb-9dba-4fcb-9e62-5c4ab07b25d2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:15.726450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:15.809976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828fdbb-9dba-4fcb-9e62-5c4ab07b25d2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:15.842494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020ea2b-0e1b-4201-9e24-8e05d2a51691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:15.843082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020ea2b-0e1b-4201-9e24-8e05d2a51691 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:15.843355 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020ea2b-0e1b-4201-9e24-8e05d2a51691 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:15.843624 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020ea2b-0e1b-4201-9e24-8e05d2a51691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:15.844365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020ea2b-0e1b-4201-9e24-8e05d2a51691 None admin] RBAC: Adding query filter params (role.id=1201453b538f4257a1dc8723d67c0cdd, scope.project.id=ab3a61b677ab4ca3a098e4691426e1b2, user.id=39fb27bb6ac44b9782fa0faf8120e120) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:15.844668 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020ea2b-0e1b-4201-9e24-8e05d2a51691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:15.846088 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020ea2b-0e1b-4201-9e24-8e05d2a51691 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:15.852325 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 552/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:58:15 2022] GET /identity/v3/role_assignments?user.id=39fb27bb6ac44b9782fa0faf8120e120&scope.project.id=ab3a61b677ab4ca3a098e4691426e1b2&role.id=1201453b538f4257a1dc8723d67c0cdd => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:17.774971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b959ec-dfff-4dca-88b8-54cbd0adc158 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:17.775567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b959ec-dfff-4dca-88b8-54cbd0adc158 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:17.775567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b959ec-dfff-4dca-88b8-54cbd0adc158 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:17.776869 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 579/1131] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:17.782106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39eeb0-88cb-4612-9ffd-3954ba2c55fb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:17.782538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39eeb0-88cb-4612-9ffd-3954ba2c55fb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:17.782647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39eeb0-88cb-4612-9ffd-3954ba2c55fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:17.803296 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1c39eeb0-88cb-4612-9ffd-3954ba2c55fb None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:17.804516 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1c39eeb0-88cb-4612-9ffd-3954ba2c55fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:17.872843 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 553/1132] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:18.139445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b959ec-dfff-4dca-88b8-54cbd0adc158 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:18.200815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:18.243113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b959ec-dfff-4dca-88b8-54cbd0adc158 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:18.276072 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120363f-9da4-42de-b269-b60c39f207c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:18.276687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120363f-9da4-42de-b269-b60c39f207c4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:18.277043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120363f-9da4-42de-b269-b60c39f207c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:18.277519 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120363f-9da4-42de-b269-b60c39f207c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:18.278402 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120363f-9da4-42de-b269-b60c39f207c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:18.279825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120363f-9da4-42de-b269-b60c39f207c4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:18.281401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 580/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:58:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:18.287210 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39eeb0-88cb-4612-9ffd-3954ba2c55fb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:18.301111 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:18.387449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39eeb0-88cb-4612-9ffd-3954ba2c55fb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:18.421613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b55763-9896-4d7b-84d8-525b489cb447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:18.422132 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b55763-9896-4d7b-84d8-525b489cb447 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:18.422403 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b55763-9896-4d7b-84d8-525b489cb447 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:18.423752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b55763-9896-4d7b-84d8-525b489cb447 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:18.423752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b55763-9896-4d7b-84d8-525b489cb447 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:18.424772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b55763-9896-4d7b-84d8-525b489cb447 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:18.453431 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 554/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Aug 30 04:58:18 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:58:20.401133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a257f13-f007-41b3-b934-7d36ba67b554 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:20.401831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a257f13-f007-41b3-b934-7d36ba67b554 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:20.401831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a257f13-f007-41b3-b934-7d36ba67b554 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:20.403001 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 581/1135] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:20.408274 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfb914-03e2-4fc4-a9da-cdc4ff1fac91 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:20.408746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfb914-03e2-4fc4-a9da-cdc4ff1fac91 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:20.408846 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfb914-03e2-4fc4-a9da-cdc4ff1fac91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:20.426619 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a0dfb914-03e2-4fc4-a9da-cdc4ff1fac91 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:20.427871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a0dfb914-03e2-4fc4-a9da-cdc4ff1fac91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:20.486373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:20.497468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 555/1136] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:20.769502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a257f13-f007-41b3-b934-7d36ba67b554 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:20.884358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a257f13-f007-41b3-b934-7d36ba67b554 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:20.917611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:20.923874 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8bd81-784f-4a51-b93b-528d95d83032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:20.924567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8bd81-784f-4a51-b93b-528d95d83032 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:20.924845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8bd81-784f-4a51-b93b-528d95d83032 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:20.925117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8bd81-784f-4a51-b93b-528d95d83032 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:20.926307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8bd81-784f-4a51-b93b-528d95d83032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:20.928002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8bd81-784f-4a51-b93b-528d95d83032 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:20.929675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 582/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:58:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:20.935847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfb914-03e2-4fc4-a9da-cdc4ff1fac91 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:21.032608 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfb914-03e2-4fc4-a9da-cdc4ff1fac91 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:21.066629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533c73e-a265-4828-bb67-82dd21a22e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:21.067232 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533c73e-a265-4828-bb67-82dd21a22e97 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:21.068065 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533c73e-a265-4828-bb67-82dd21a22e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:21.068333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533c73e-a265-4828-bb67-82dd21a22e97 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:21.068978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533c73e-a265-4828-bb67-82dd21a22e97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:21.070400 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533c73e-a265-4828-bb67-82dd21a22e97 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:21.092980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 556/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:58:20 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:58:23.057625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43115ff0-823d-43ad-8a16-069722d3f447 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:23.058152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43115ff0-823d-43ad-8a16-069722d3f447 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:23.058152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43115ff0-823d-43ad-8a16-069722d3f447 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:23.059516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 583/1139] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:23.064759 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa6099-e427-4d6f-9458-e7aebf29f2b3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:23.065199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa6099-e427-4d6f-9458-e7aebf29f2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:23.065307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa6099-e427-4d6f-9458-e7aebf29f2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:23.084734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-81aa6099-e427-4d6f-9458-e7aebf29f2b3 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:23.085920 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-81aa6099-e427-4d6f-9458-e7aebf29f2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:23.132970 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:23.154830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 557/1140] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:23.421712 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43115ff0-823d-43ad-8a16-069722d3f447 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:23.521803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43115ff0-823d-43ad-8a16-069722d3f447 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:23.554711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24433c4a-3620-4363-8f49-c00da215dfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:23.555323 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433c4a-3620-4363-8f49-c00da215dfc1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:23.555599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433c4a-3620-4363-8f49-c00da215dfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:23.555871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433c4a-3620-4363-8f49-c00da215dfc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:23.565969 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24433c4a-3620-4363-8f49-c00da215dfc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-24433c4a-3620-4363-8f49-c00da215dfc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:58:23.571278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:58:23.572488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:58:23.573418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:58:23.573418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:58:23.573418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:58:23.573418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:58:23.573418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:58:23.573418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:58:23.573418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:58:23.573418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:58:23.573418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:58:23.573418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:58:23.573418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:58:23.573418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:58:23.573418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 584/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:58:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:58:23.578467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa6099-e427-4d6f-9458-e7aebf29f2b3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:23.673343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa6099-e427-4d6f-9458-e7aebf29f2b3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:23.706599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d9d13-86ef-4433-98ac-548d3c56178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:23.707193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d9d13-86ef-4433-98ac-548d3c56178f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:23.707468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d9d13-86ef-4433-98ac-548d3c56178f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:23.707737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d9d13-86ef-4433-98ac-548d3c56178f None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:23.708444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d9d13-86ef-4433-98ac-548d3c56178f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:23.708747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d9d13-86ef-4433-98ac-548d3c56178f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:23.710104 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d9d13-86ef-4433-98ac-548d3c56178f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:23.717846 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 558/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:23.725303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24433c4a-3620-4363-8f49-c00da215dfc1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:23.782550 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:23.823261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24433c4a-3620-4363-8f49-c00da215dfc1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:23.855968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe275ad2-bdfb-4af9-8b9c-2b696d59cf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:23.856580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe275ad2-bdfb-4af9-8b9c-2b696d59cf99 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:23.856853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe275ad2-bdfb-4af9-8b9c-2b696d59cf99 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:23.857119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe275ad2-bdfb-4af9-8b9c-2b696d59cf99 None admin] PATH_INFO: `/v3/users/fe173d242b3c4a8f848ba07b916e8ee2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:23.870183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe275ad2-bdfb-4af9-8b9c-2b696d59cf99 None admin] RBAC: Authorizing `identity:get_user(user_id=fe173d242b3c4a8f848ba07b916e8ee2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:23.871598 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe275ad2-bdfb-4af9-8b9c-2b696d59cf99 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:23.873210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 585/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:58:23 2022] GET /identity/v3/users/fe173d242b3c4a8f848ba07b916e8ee2 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:23.879569 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d9d13-86ef-4433-98ac-548d3c56178f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:23.922788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:23.981249 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d9d13-86ef-4433-98ac-548d3c56178f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:24.014633 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb68550-a22f-42f3-89da-eace61f43d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:24.015231 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb68550-a22f-42f3-89da-eace61f43d7c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:24.015503 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb68550-a22f-42f3-89da-eace61f43d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:24.015769 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb68550-a22f-42f3-89da-eace61f43d7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:24.082308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb68550-a22f-42f3-89da-eace61f43d7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:24.083781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb68550-a22f-42f3-89da-eace61f43d7c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:24.124153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:24.179295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 559/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:58:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:58:24.185229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe275ad2-bdfb-4af9-8b9c-2b696d59cf99 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:24.286610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe275ad2-bdfb-4af9-8b9c-2b696d59cf99 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:24.303063 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:24.321664 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83ca25-9452-4475-8577-3bab8aaa0e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:24.322307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83ca25-9452-4475-8577-3bab8aaa0e57 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:24.322591 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83ca25-9452-4475-8577-3bab8aaa0e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:24.322864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83ca25-9452-4475-8577-3bab8aaa0e57 None admin] PATH_INFO: `/v3/projects/1bc482cecf4446f88a85c91ee49a0c75` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:24.323988 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83ca25-9452-4475-8577-3bab8aaa0e57 None admin] RBAC: Authorizing `identity:get_project(project_id=1bc482cecf4446f88a85c91ee49a0c75)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:24.325410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83ca25-9452-4475-8577-3bab8aaa0e57 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:24.327031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 586/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:58:24 2022] GET /identity/v3/projects/1bc482cecf4446f88a85c91ee49a0c75 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:24.333666 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb68550-a22f-42f3-89da-eace61f43d7c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:24.433906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb68550-a22f-42f3-89da-eace61f43d7c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:24.471318 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51367a-5441-4f7e-a51a-19c31ccb7b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:24.471927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51367a-5441-4f7e-a51a-19c31ccb7b0d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:24.472252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51367a-5441-4f7e-a51a-19c31ccb7b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:24.472506 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51367a-5441-4f7e-a51a-19c31ccb7b0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:24.473222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51367a-5441-4f7e-a51a-19c31ccb7b0d None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=1bc482cecf4446f88a85c91ee49a0c75, user.id=fe173d242b3c4a8f848ba07b916e8ee2) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:24.474076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51367a-5441-4f7e-a51a-19c31ccb7b0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:24.475487 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51367a-5441-4f7e-a51a-19c31ccb7b0d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:24.480969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 560/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:58:24 2022] GET /identity/v3/role_assignments?user.id=fe173d242b3c4a8f848ba07b916e8ee2&scope.project.id=1bc482cecf4446f88a85c91ee49a0c75&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:26.346852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536d0cd-750d-4e5f-b23a-9b232d4a4874 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:26.347378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536d0cd-750d-4e5f-b23a-9b232d4a4874 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:26.347378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536d0cd-750d-4e5f-b23a-9b232d4a4874 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:26.348697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 587/1147] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:26.354102 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43887a47-db68-4003-ac27-c1d9945f945c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:26.354511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43887a47-db68-4003-ac27-c1d9945f945c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:26.354652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43887a47-db68-4003-ac27-c1d9945f945c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:26.367405 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:26.373261 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-43887a47-db68-4003-ac27-c1d9945f945c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:26.374461 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-43887a47-db68-4003-ac27-c1d9945f945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:26.440988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 561/1148] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:26.716892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536d0cd-750d-4e5f-b23a-9b232d4a4874 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:26.826294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536d0cd-750d-4e5f-b23a-9b232d4a4874 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:26.861860 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7babc9f-9d66-4d84-a7eb-40552bb78cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:26.862525 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7babc9f-9d66-4d84-a7eb-40552bb78cdb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:26.862884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7babc9f-9d66-4d84-a7eb-40552bb78cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:26.863206 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7babc9f-9d66-4d84-a7eb-40552bb78cdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:26.874527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7babc9f-9d66-4d84-a7eb-40552bb78cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f7babc9f-9d66-4d84-a7eb-40552bb78cdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:58:26.880055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:58:26.881138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:58:26.882253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:58:26.882253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:58:26.882253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:58:26.882253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:58:26.882253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:58:26.882253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:58:26.882253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:58:26.882253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:58:26.882253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:58:26.882253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:58:26.882253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:58:26.882253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:58:26.882253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 588/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:58:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:58:26.889284 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43887a47-db68-4003-ac27-c1d9945f945c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:26.985713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43887a47-db68-4003-ac27-c1d9945f945c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:27.021629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680829b-8f31-483a-b1e4-76c24ed95d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:27.022228 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680829b-8f31-483a-b1e4-76c24ed95d7a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:27.022504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680829b-8f31-483a-b1e4-76c24ed95d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:27.022772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680829b-8f31-483a-b1e4-76c24ed95d7a None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:27.023438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680829b-8f31-483a-b1e4-76c24ed95d7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:27.023737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680829b-8f31-483a-b1e4-76c24ed95d7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:27.025125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680829b-8f31-483a-b1e4-76c24ed95d7a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:27.027468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:27.034070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 562/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:58:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:27.040432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7babc9f-9d66-4d84-a7eb-40552bb78cdb None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:27.087470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:27.142466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7babc9f-9d66-4d84-a7eb-40552bb78cdb None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:27.177124 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f870c7-2413-4bd5-9ac6-b350b223954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:27.177759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f870c7-2413-4bd5-9ac6-b350b223954a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:27.178032 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f870c7-2413-4bd5-9ac6-b350b223954a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:27.178300 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f870c7-2413-4bd5-9ac6-b350b223954a None admin] PATH_INFO: `/v3/users/fe173d242b3c4a8f848ba07b916e8ee2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:27.179500 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f870c7-2413-4bd5-9ac6-b350b223954a None admin] RBAC: Authorizing `identity:get_user(user_id=fe173d242b3c4a8f848ba07b916e8ee2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:27.180957 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f870c7-2413-4bd5-9ac6-b350b223954a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:27.182536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 589/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:58:27 2022] GET /identity/v3/users/fe173d242b3c4a8f848ba07b916e8ee2 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:27.188469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680829b-8f31-483a-b1e4-76c24ed95d7a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:27.288043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680829b-8f31-483a-b1e4-76c24ed95d7a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:27.322869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bc884-9fc2-4b4f-aed8-2781e3a8e612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:27.323499 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bc884-9fc2-4b4f-aed8-2781e3a8e612 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:27.323777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bc884-9fc2-4b4f-aed8-2781e3a8e612 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:27.324082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bc884-9fc2-4b4f-aed8-2781e3a8e612 None admin] PATH_INFO: `/v3/projects/1bc482cecf4446f88a85c91ee49a0c75` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:27.325196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bc884-9fc2-4b4f-aed8-2781e3a8e612 None admin] RBAC: Authorizing `identity:get_project(project_id=1bc482cecf4446f88a85c91ee49a0c75)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:27.326626 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bc884-9fc2-4b4f-aed8-2781e3a8e612 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:27.328308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 563/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:58:27 2022] GET /identity/v3/projects/1bc482cecf4446f88a85c91ee49a0c75 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:27.334763 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f870c7-2413-4bd5-9ac6-b350b223954a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:27.431010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f870c7-2413-4bd5-9ac6-b350b223954a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:27.443680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:27.465239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc7464-130e-4578-a67c-01a9f613e818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:27.465881 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc7464-130e-4578-a67c-01a9f613e818 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:27.466152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc7464-130e-4578-a67c-01a9f613e818 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:27.466420 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc7464-130e-4578-a67c-01a9f613e818 None admin] PATH_INFO: `/v3/projects/1bc482cecf4446f88a85c91ee49a0c75/users/fe173d242b3c4a8f848ba07b916e8ee2/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:27.468309 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc7464-130e-4578-a67c-01a9f613e818 None admin] RBAC: Authorizing `identity:create_grant(project_id=1bc482cecf4446f88a85c91ee49a0c75, user_id=fe173d242b3c4a8f848ba07b916e8ee2, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:27.469717 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc7464-130e-4578-a67c-01a9f613e818 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:27.483052 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 590/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:58:27 2022] PUT /identity/v3/projects/1bc482cecf4446f88a85c91ee49a0c75/users/fe173d242b3c4a8f848ba07b916e8ee2/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:58:29.349335 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b1b69-c8ad-428e-8685-9c7b31485521 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:29.349852 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b1b69-c8ad-428e-8685-9c7b31485521 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:29.349940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b1b69-c8ad-428e-8685-9c7b31485521 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:29.351326 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 564/1154] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:29.356572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a95e-436a-4e59-a498-4bdd831ae74a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:29.357073 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a95e-436a-4e59-a498-4bdd831ae74a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:29.357417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a95e-436a-4e59-a498-4bdd831ae74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:29.377026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b807a95e-436a-4e59-a498-4bdd831ae74a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:29.378205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b807a95e-436a-4e59-a498-4bdd831ae74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:29.452661 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 591/1155] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:29.718826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b1b69-c8ad-428e-8685-9c7b31485521 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:29.784976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:29.823431 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b1b69-c8ad-428e-8685-9c7b31485521 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:29.856575 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad68da-7838-4f9f-9976-5ae277f594ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:29.857194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad68da-7838-4f9f-9976-5ae277f594ed None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:29.857466 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad68da-7838-4f9f-9976-5ae277f594ed None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:29.857730 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad68da-7838-4f9f-9976-5ae277f594ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:29.868679 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad68da-7838-4f9f-9976-5ae277f594ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b8ad68da-7838-4f9f-9976-5ae277f594ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:58:29.873350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:58:29.874453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:58:29.875645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:58:29.875645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:58:29.875645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:58:29.875645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:58:29.875645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:58:29.875645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:58:29.875645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:58:29.875645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:58:29.875645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:58:29.875645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:58:29.875645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:58:29.875645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:58:29.875645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 565/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:58:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:58:29.881881 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807a95e-436a-4e59-a498-4bdd831ae74a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:29.987174 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807a95e-436a-4e59-a498-4bdd831ae74a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:29.989328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:30.024664 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117021e-d232-4402-a3a7-8415f6fee3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:30.025269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117021e-d232-4402-a3a7-8415f6fee3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:30.025545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117021e-d232-4402-a3a7-8415f6fee3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:30.025817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117021e-d232-4402-a3a7-8415f6fee3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:30.026475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117021e-d232-4402-a3a7-8415f6fee3b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:30.026776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117021e-d232-4402-a3a7-8415f6fee3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:30.028161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117021e-d232-4402-a3a7-8415f6fee3b5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:30.036854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 592/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:58:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:30.042668 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad68da-7838-4f9f-9976-5ae277f594ed None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:30.148848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad68da-7838-4f9f-9976-5ae277f594ed None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:30.175084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:30.184799 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc9486-ba3a-48af-8259-9d33a0ae0def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:30.185451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9486-ba3a-48af-8259-9d33a0ae0def None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:30.185725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9486-ba3a-48af-8259-9d33a0ae0def None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:30.185991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9486-ba3a-48af-8259-9d33a0ae0def None admin] PATH_INFO: `/v3/users/fe173d242b3c4a8f848ba07b916e8ee2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:30.187115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc9486-ba3a-48af-8259-9d33a0ae0def None admin] RBAC: Authorizing `identity:get_user(user_id=fe173d242b3c4a8f848ba07b916e8ee2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:30.188594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc9486-ba3a-48af-8259-9d33a0ae0def None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:30.190177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 566/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:58:30 2022] GET /identity/v3/users/fe173d242b3c4a8f848ba07b916e8ee2 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:30.196179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117021e-d232-4402-a3a7-8415f6fee3b5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:30.300726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117021e-d232-4402-a3a7-8415f6fee3b5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:30.335768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8d122-f870-4915-900f-e7b0be3621cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:30.336398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8d122-f870-4915-900f-e7b0be3621cc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:30.336672 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8d122-f870-4915-900f-e7b0be3621cc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:30.336938 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8d122-f870-4915-900f-e7b0be3621cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:30.368713 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:30.406934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8d122-f870-4915-900f-e7b0be3621cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:30.408411 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8d122-f870-4915-900f-e7b0be3621cc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:30.510383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 593/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:58:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:58:30.516497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc9486-ba3a-48af-8259-9d33a0ae0def None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:30.617270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc9486-ba3a-48af-8259-9d33a0ae0def None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:30.650874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24233b-aa2a-481f-952d-bffefd41452d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:30.651600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24233b-aa2a-481f-952d-bffefd41452d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:30.652196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24233b-aa2a-481f-952d-bffefd41452d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:30.652196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24233b-aa2a-481f-952d-bffefd41452d None admin] PATH_INFO: `/v3/projects/1bc482cecf4446f88a85c91ee49a0c75` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:30.653315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24233b-aa2a-481f-952d-bffefd41452d None admin] RBAC: Authorizing `identity:get_project(project_id=1bc482cecf4446f88a85c91ee49a0c75)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:30.654746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24233b-aa2a-481f-952d-bffefd41452d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:30.656417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 567/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:58:30 2022] GET /identity/v3/projects/1bc482cecf4446f88a85c91ee49a0c75 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:30.663093 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8d122-f870-4915-900f-e7b0be3621cc None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:30.727997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:30.767160 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8d122-f870-4915-900f-e7b0be3621cc None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:30.801392 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e893f6-ee73-4c30-b306-7ce85d979efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:30.802000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e893f6-ee73-4c30-b306-7ce85d979efb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:30.802273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e893f6-ee73-4c30-b306-7ce85d979efb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:30.802542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e893f6-ee73-4c30-b306-7ce85d979efb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:30.803272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e893f6-ee73-4c30-b306-7ce85d979efb None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=1bc482cecf4446f88a85c91ee49a0c75, user.id=fe173d242b3c4a8f848ba07b916e8ee2) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:30.803575 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e893f6-ee73-4c30-b306-7ce85d979efb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:30.805030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e893f6-ee73-4c30-b306-7ce85d979efb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:30.810871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 594/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:58:30 2022] GET /identity/v3/role_assignments?user.id=fe173d242b3c4a8f848ba07b916e8ee2&scope.project.id=1bc482cecf4446f88a85c91ee49a0c75&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:32.802444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4657b0a-08ff-40d7-87cb-de3eace66526 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:32.803111 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4657b0a-08ff-40d7-87cb-de3eace66526 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:32.803111 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4657b0a-08ff-40d7-87cb-de3eace66526 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:32.804326 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 568/1162] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:32.809610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52255d20-7783-4269-a27d-4367afab70c4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:32.810039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52255d20-7783-4269-a27d-4367afab70c4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:32.810152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52255d20-7783-4269-a27d-4367afab70c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:32.828291 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-52255d20-7783-4269-a27d-4367afab70c4 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:32.829471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-52255d20-7783-4269-a27d-4367afab70c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:32.895966 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 595/1163] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:33.173755 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4657b0a-08ff-40d7-87cb-de3eace66526 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:33.235745 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:33.276896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4657b0a-08ff-40d7-87cb-de3eace66526 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:33.311486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca86eaa-071e-4890-b4b6-a5add90d5caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:33.312180 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca86eaa-071e-4890-b4b6-a5add90d5caa None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:33.312458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca86eaa-071e-4890-b4b6-a5add90d5caa None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:33.312723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca86eaa-071e-4890-b4b6-a5add90d5caa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:33.384576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca86eaa-071e-4890-b4b6-a5add90d5caa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:33.386042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca86eaa-071e-4890-b4b6-a5add90d5caa None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:33.447433 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:33.486481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 569/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:58:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:58:33.493141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52255d20-7783-4269-a27d-4367afab70c4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:33.549273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:33.592974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52255d20-7783-4269-a27d-4367afab70c4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:33.629915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad07ca8-31f1-42f8-aebc-1536f563463f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:33.630526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad07ca8-31f1-42f8-aebc-1536f563463f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:33.630796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad07ca8-31f1-42f8-aebc-1536f563463f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:33.631059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad07ca8-31f1-42f8-aebc-1536f563463f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:33.638027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad07ca8-31f1-42f8-aebc-1536f563463f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:33.639709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad07ca8-31f1-42f8-aebc-1536f563463f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-aad07ca8-31f1-42f8-aebc-1536f563463f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:58:33.651787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:58:33.653055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:58:33.654119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:58:33.654119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:58:33.654119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:58:33.654119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:58:33.654119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:58:33.654119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:58:33.654119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:58:33.654119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:58:33.654119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:58:33.654119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:58:33.654119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:58:33.654119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:58:33.654119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 04:58:33.654119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:58:33.654119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 596/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Aug 30 04:58:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:58:33.659379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca86eaa-071e-4890-b4b6-a5add90d5caa None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:33.761774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca86eaa-071e-4890-b4b6-a5add90d5caa None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:33.802518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb8df6-d4e6-417a-8624-01532e9c80a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:33.803155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb8df6-d4e6-417a-8624-01532e9c80a3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:33.803387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb8df6-d4e6-417a-8624-01532e9c80a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:33.803655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb8df6-d4e6-417a-8624-01532e9c80a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:33.804322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb8df6-d4e6-417a-8624-01532e9c80a3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:33.804624 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb8df6-d4e6-417a-8624-01532e9c80a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:33.805986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb8df6-d4e6-417a-8624-01532e9c80a3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:33.813523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 570/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Aug 30 04:58:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:35.928320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccedb9-d086-485b-9a1d-e77c837cdce9 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:35.928883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccedb9-d086-485b-9a1d-e77c837cdce9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:35.928883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccedb9-d086-485b-9a1d-e77c837cdce9 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:35.930177 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 597/1167] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:35.935422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b9e2d-1f80-486c-91a8-c906db396a01 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:35.935857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b9e2d-1f80-486c-91a8-c906db396a01 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:35.935973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b9e2d-1f80-486c-91a8-c906db396a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:35.954343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-745b9e2d-1f80-486c-91a8-c906db396a01 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:35.955539 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-745b9e2d-1f80-486c-91a8-c906db396a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:35.976813 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:36.024264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 571/1168] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:36.304870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccedb9-d086-485b-9a1d-e77c837cdce9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:36.411060 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccedb9-d086-485b-9a1d-e77c837cdce9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:36.433532 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:36.451349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f8295-80d5-440c-96a9-de3f859be15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:36.451967 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f8295-80d5-440c-96a9-de3f859be15e None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:36.452251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f8295-80d5-440c-96a9-de3f859be15e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:36.452525 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f8295-80d5-440c-96a9-de3f859be15e None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:36.453184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f8295-80d5-440c-96a9-de3f859be15e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:36.454706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f8295-80d5-440c-96a9-de3f859be15e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:36.470860 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 598/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Tue Aug 30 04:58:36 2022] POST /identity/v3/domains => generated 267 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:58:38.443274 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611b7a5-2555-4e18-997f-237c3ed95be0 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:38.443831 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611b7a5-2555-4e18-997f-237c3ed95be0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:38.443831 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611b7a5-2555-4e18-997f-237c3ed95be0 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:38.445182 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 572/1170] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:38.450705 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920840b-353f-4593-ac13-04599edf7132 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:38.451183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920840b-353f-4593-ac13-04599edf7132 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:38.451296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920840b-353f-4593-ac13-04599edf7132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:38.469655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8920840b-353f-4593-ac13-04599edf7132 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:38.470838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8920840b-353f-4593-ac13-04599edf7132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:38.536977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 599/1171] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:38.811408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611b7a5-2555-4e18-997f-237c3ed95be0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:38.921369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611b7a5-2555-4e18-997f-237c3ed95be0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:38.956437 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac563c-f8f8-4289-a20c-1a4cb8a9cbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:38.957089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac563c-f8f8-4289-a20c-1a4cb8a9cbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:38.957359 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac563c-f8f8-4289-a20c-1a4cb8a9cbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:38.957622 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac563c-f8f8-4289-a20c-1a4cb8a9cbb8 None admin] PATH_INFO: `/v3/domains/c5d3f87da553427d925815a37efcea79` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:38.968346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac563c-f8f8-4289-a20c-1a4cb8a9cbb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c5d3f87da553427d925815a37efcea79)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:38.970457 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac563c-f8f8-4289-a20c-1a4cb8a9cbb8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:38.973585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 573/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Tue Aug 30 04:58:38 2022] GET /identity/v3/domains/c5d3f87da553427d925815a37efcea79 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:38.979559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920840b-353f-4593-ac13-04599edf7132 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:39.095964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920840b-353f-4593-ac13-04599edf7132 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:39.106112 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:39.132475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f3cc-6dd5-4cd8-b49c-6cac15329327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:39.133081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f3cc-6dd5-4cd8-b49c-6cac15329327 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:39.133355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f3cc-6dd5-4cd8-b49c-6cac15329327 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:39.133624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f3cc-6dd5-4cd8-b49c-6cac15329327 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:39.134302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953f3cc-6dd5-4cd8-b49c-6cac15329327 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:39.135727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953f3cc-6dd5-4cd8-b49c-6cac15329327 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:39.162768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 600/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Aug 30 04:58:38 2022] POST /identity/v3/projects => generated 361 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:58:41.107158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f540a46-a3cc-4fc5-a504-7212ab3b38cb None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:41.107714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f540a46-a3cc-4fc5-a504-7212ab3b38cb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:41.107714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f540a46-a3cc-4fc5-a504-7212ab3b38cb None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:41.109072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 574/1174] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:41.115147 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d446b7-b14e-4ba5-a99e-c63df1056502 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:41.115634 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d446b7-b14e-4ba5-a99e-c63df1056502 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:41.115738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d446b7-b14e-4ba5-a99e-c63df1056502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:41.135074 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e9d446b7-b14e-4ba5-a99e-c63df1056502 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:41.137082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e9d446b7-b14e-4ba5-a99e-c63df1056502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:41.210133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 601/1175] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:41.479490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f540a46-a3cc-4fc5-a504-7212ab3b38cb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:41.498587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:41.581574 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f540a46-a3cc-4fc5-a504-7212ab3b38cb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:41.613727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebd61e-c8d2-4bfc-bcfd-259a45b57598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:41.614338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebd61e-c8d2-4bfc-bcfd-259a45b57598 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:41.614606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebd61e-c8d2-4bfc-bcfd-259a45b57598 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:41.614871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebd61e-c8d2-4bfc-bcfd-259a45b57598 None admin] PATH_INFO: `/v3/domains/c5d3f87da553427d925815a37efcea79` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:41.615983 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebd61e-c8d2-4bfc-bcfd-259a45b57598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c5d3f87da553427d925815a37efcea79)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:41.617399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebd61e-c8d2-4bfc-bcfd-259a45b57598 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:41.618956 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 575/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Tue Aug 30 04:58:41 2022] GET /identity/v3/domains/c5d3f87da553427d925815a37efcea79 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:41.624851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d446b7-b14e-4ba5-a99e-c63df1056502 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:41.713059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:41.723436 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d446b7-b14e-4ba5-a99e-c63df1056502 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:41.758149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebbb7a-3cd6-4298-a007-c38676b27a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:41.758675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebbb7a-3cd6-4298-a007-c38676b27a62 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:41.758950 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebbb7a-3cd6-4298-a007-c38676b27a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:41.759218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebbb7a-3cd6-4298-a007-c38676b27a62 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:41.759863 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebbb7a-3cd6-4298-a007-c38676b27a62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:41.761304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebbb7a-3cd6-4298-a007-c38676b27a62 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:41.781985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 602/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:58:41 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:58:43.748873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08982fc4-a740-4b55-b3d3-ed74aec7af19 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:43.749449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08982fc4-a740-4b55-b3d3-ed74aec7af19 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:43.749449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08982fc4-a740-4b55-b3d3-ed74aec7af19 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:43.751024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 576/1178] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:43.760482 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba4ee7-7e07-4165-81c0-478260cb2acc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:43.760482 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba4ee7-7e07-4165-81c0-478260cb2acc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:43.760482 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba4ee7-7e07-4165-81c0-478260cb2acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:43.776908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-deba4ee7-7e07-4165-81c0-478260cb2acc None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:43.778122 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-deba4ee7-7e07-4165-81c0-478260cb2acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:43.845023 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 603/1179] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:44.116789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08982fc4-a740-4b55-b3d3-ed74aec7af19 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:44.202813 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:44.219974 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08982fc4-a740-4b55-b3d3-ed74aec7af19 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:44.253078 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fd04d-6572-4e7c-801a-1f5d698f74ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:44.254205 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fd04d-6572-4e7c-801a-1f5d698f74ca None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:44.254474 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fd04d-6572-4e7c-801a-1f5d698f74ca None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:44.254739 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fd04d-6572-4e7c-801a-1f5d698f74ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:44.265354 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fd04d-6572-4e7c-801a-1f5d698f74ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-aa6fd04d-6572-4e7c-801a-1f5d698f74ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:58:44.270732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:58:44.271926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:58:44.273213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:58:44.273213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:58:44.273213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:58:44.273213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:58:44.273213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:58:44.273213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:58:44.273213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:58:44.273213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:58:44.273213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:58:44.273213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:58:44.273213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:58:44.273213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:58:44.273213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 577/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:58:44.277972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba4ee7-7e07-4165-81c0-478260cb2acc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:44.351659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:44.374433 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba4ee7-7e07-4165-81c0-478260cb2acc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:44.407748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aee634-88ce-4f37-9510-e8b141c59e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:44.408435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee634-88ce-4f37-9510-e8b141c59e9a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:44.408711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee634-88ce-4f37-9510-e8b141c59e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:44.408979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee634-88ce-4f37-9510-e8b141c59e9a None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:44.409671 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aee634-88ce-4f37-9510-e8b141c59e9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:44.409969 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aee634-88ce-4f37-9510-e8b141c59e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:44.411318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aee634-88ce-4f37-9510-e8b141c59e9a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:44.419110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 604/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:44.425020 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fd04d-6572-4e7c-801a-1f5d698f74ca None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:44.523068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fd04d-6572-4e7c-801a-1f5d698f74ca None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:44.558817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d7448-842f-45c3-9daa-3e87d55e3f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:44.559462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d7448-842f-45c3-9daa-3e87d55e3f52 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:44.559745 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d7448-842f-45c3-9daa-3e87d55e3f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:44.560075 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d7448-842f-45c3-9daa-3e87d55e3f52 None admin] PATH_INFO: `/v3/users/7da0ba5a8fa54f33bbd73f2fa56a6bcb` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:44.573939 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d7448-842f-45c3-9daa-3e87d55e3f52 None admin] RBAC: Authorizing `identity:get_user(user_id=7da0ba5a8fa54f33bbd73f2fa56a6bcb)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:44.575369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d7448-842f-45c3-9daa-3e87d55e3f52 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:44.576990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 578/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:58:44 2022] GET /identity/v3/users/7da0ba5a8fa54f33bbd73f2fa56a6bcb => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:44.583105 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aee634-88ce-4f37-9510-e8b141c59e9a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:44.682421 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aee634-88ce-4f37-9510-e8b141c59e9a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:44.715665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1b6bd-6d28-4834-84f4-b9f2b45fb540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:44.716307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1b6bd-6d28-4834-84f4-b9f2b45fb540 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:44.716580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1b6bd-6d28-4834-84f4-b9f2b45fb540 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:44.716847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1b6bd-6d28-4834-84f4-b9f2b45fb540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:44.726739 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:44.785996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1b6bd-6d28-4834-84f4-b9f2b45fb540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:44.787451 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1b6bd-6d28-4834-84f4-b9f2b45fb540 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:44.889970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 605/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:58:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:58:44.896219 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d7448-842f-45c3-9daa-3e87d55e3f52 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:44.899139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:45.004162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d7448-842f-45c3-9daa-3e87d55e3f52 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:45.040836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fbee2-76f6-47c3-900d-d2baf351ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:45.041469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fbee2-76f6-47c3-900d-d2baf351ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:45.041744 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fbee2-76f6-47c3-900d-d2baf351ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:45.042011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fbee2-76f6-47c3-900d-d2baf351ffe5 None admin] PATH_INFO: `/v3/projects/6c880d01724344c3beb9ae7b4f6239d7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:45.043114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fbee2-76f6-47c3-900d-d2baf351ffe5 None admin] RBAC: Authorizing `identity:get_project(project_id=6c880d01724344c3beb9ae7b4f6239d7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:45.044574 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fbee2-76f6-47c3-900d-d2baf351ffe5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:45.046287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 579/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:58:44 2022] GET /identity/v3/projects/6c880d01724344c3beb9ae7b4f6239d7 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:45.053086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1b6bd-6d28-4834-84f4-b9f2b45fb540 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:45.091023 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:45.150854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1b6bd-6d28-4834-84f4-b9f2b45fb540 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:45.186517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac0a0e-eb49-4217-9bfe-bf3f1fdc9929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:45.187116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac0a0e-eb49-4217-9bfe-bf3f1fdc9929 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:45.187390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac0a0e-eb49-4217-9bfe-bf3f1fdc9929 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:45.187654 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac0a0e-eb49-4217-9bfe-bf3f1fdc9929 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:45.188412 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac0a0e-eb49-4217-9bfe-bf3f1fdc9929 None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=6c880d01724344c3beb9ae7b4f6239d7, user.id=7da0ba5a8fa54f33bbd73f2fa56a6bcb) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:45.188715 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac0a0e-eb49-4217-9bfe-bf3f1fdc9929 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:45.190131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac0a0e-eb49-4217-9bfe-bf3f1fdc9929 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:45.195850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 606/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:58:45 2022] GET /identity/v3/role_assignments?user.id=7da0ba5a8fa54f33bbd73f2fa56a6bcb&scope.project.id=6c880d01724344c3beb9ae7b4f6239d7&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:58:47.082928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba362e3-acdd-4c0a-aed7-31b6e5d30027 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:47.083464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba362e3-acdd-4c0a-aed7-31b6e5d30027 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:47.083464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba362e3-acdd-4c0a-aed7-31b6e5d30027 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:47.084832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 580/1186] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:47.090593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e85db-a582-4d3a-ba29-3fede1c5f376 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:47.091779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e85db-a582-4d3a-ba29-3fede1c5f376 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:47.091779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e85db-a582-4d3a-ba29-3fede1c5f376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:47.109401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-920e85db-a582-4d3a-ba29-3fede1c5f376 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:47.110587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-920e85db-a582-4d3a-ba29-3fede1c5f376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:47.177804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 607/1187] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:47.447075 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba362e3-acdd-4c0a-aed7-31b6e5d30027 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:47.527503 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:47.559621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba362e3-acdd-4c0a-aed7-31b6e5d30027 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:47.592918 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d935e6-8ec1-4bfa-a5e6-a65bb10b005a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:47.593528 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d935e6-8ec1-4bfa-a5e6-a65bb10b005a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:47.593797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d935e6-8ec1-4bfa-a5e6-a65bb10b005a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:47.594058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d935e6-8ec1-4bfa-a5e6-a65bb10b005a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:47.604101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d935e6-8ec1-4bfa-a5e6-a65bb10b005a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-26d935e6-8ec1-4bfa-a5e6-a65bb10b005a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:58:47.608765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:58:47.609895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:58:47.610943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:58:47.610943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:58:47.610943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:58:47.610943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:58:47.610943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:58:47.610943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:58:47.610943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:58:47.610943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:58:47.610943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:58:47.610943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:58:47.610943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:58:47.610943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:58:47.610943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 581/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:58:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:58:47.616446 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e85db-a582-4d3a-ba29-3fede1c5f376 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:47.646159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:47.713277 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e85db-a582-4d3a-ba29-3fede1c5f376 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:47.746144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa15bb-72e7-46f8-a526-09708ca9d3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:47.746738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa15bb-72e7-46f8-a526-09708ca9d3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:47.747012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa15bb-72e7-46f8-a526-09708ca9d3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:47.747325 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa15bb-72e7-46f8-a526-09708ca9d3c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:47.747929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa15bb-72e7-46f8-a526-09708ca9d3c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:47.748256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa15bb-72e7-46f8-a526-09708ca9d3c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:47.749622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa15bb-72e7-46f8-a526-09708ca9d3c2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:47.758625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 608/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:58:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:47.764483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d935e6-8ec1-4bfa-a5e6-a65bb10b005a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:47.865932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d935e6-8ec1-4bfa-a5e6-a65bb10b005a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:47.895079 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:47.901021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d77ba-e27a-4500-8526-77b06608acd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:47.901643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d77ba-e27a-4500-8526-77b06608acd6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:47.901916 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d77ba-e27a-4500-8526-77b06608acd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:47.902182 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d77ba-e27a-4500-8526-77b06608acd6 None admin] PATH_INFO: `/v3/users/7da0ba5a8fa54f33bbd73f2fa56a6bcb` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:47.903279 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d77ba-e27a-4500-8526-77b06608acd6 None admin] RBAC: Authorizing `identity:get_user(user_id=7da0ba5a8fa54f33bbd73f2fa56a6bcb)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:47.904736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d77ba-e27a-4500-8526-77b06608acd6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:47.906469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 582/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:58:47 2022] GET /identity/v3/users/7da0ba5a8fa54f33bbd73f2fa56a6bcb => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:47.913805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa15bb-72e7-46f8-a526-09708ca9d3c2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:48.008924 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:48.016455 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa15bb-72e7-46f8-a526-09708ca9d3c2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:48.057266 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85041473-6a02-4587-af93-2bf732cee139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:48.057888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85041473-6a02-4587-af93-2bf732cee139 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:48.058162 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85041473-6a02-4587-af93-2bf732cee139 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:48.058429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85041473-6a02-4587-af93-2bf732cee139 None admin] PATH_INFO: `/v3/projects/6c880d01724344c3beb9ae7b4f6239d7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:48.059880 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85041473-6a02-4587-af93-2bf732cee139 None admin] RBAC: Authorizing `identity:get_project(project_id=6c880d01724344c3beb9ae7b4f6239d7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:48.060996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85041473-6a02-4587-af93-2bf732cee139 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:48.062610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 609/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:58:47 2022] GET /identity/v3/projects/6c880d01724344c3beb9ae7b4f6239d7 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:48.068815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d77ba-e27a-4500-8526-77b06608acd6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:48.168368 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d77ba-e27a-4500-8526-77b06608acd6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:48.207630 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710da58-dbd3-400f-a373-b3e0830443a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:48.208295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710da58-dbd3-400f-a373-b3e0830443a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:48.208566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710da58-dbd3-400f-a373-b3e0830443a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:48.208829 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710da58-dbd3-400f-a373-b3e0830443a6 None admin] PATH_INFO: `/v3/projects/6c880d01724344c3beb9ae7b4f6239d7/users/7da0ba5a8fa54f33bbd73f2fa56a6bcb/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:48.210685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710da58-dbd3-400f-a373-b3e0830443a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c880d01724344c3beb9ae7b4f6239d7, user_id=7da0ba5a8fa54f33bbd73f2fa56a6bcb, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:48.212455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710da58-dbd3-400f-a373-b3e0830443a6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:48.228369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 583/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:58:48 2022] PUT /identity/v3/projects/6c880d01724344c3beb9ae7b4f6239d7/users/7da0ba5a8fa54f33bbd73f2fa56a6bcb/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:58:50.152793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db78133-b9a0-4805-9975-28c1e2796ec2 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:50.153350 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db78133-b9a0-4805-9975-28c1e2796ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:50.153350 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db78133-b9a0-4805-9975-28c1e2796ec2 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:50.154679 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 610/1193] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:58:50.160333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bf2e4-ae2f-496d-9bd5-63926b7ac738 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:50.160757 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bf2e4-ae2f-496d-9bd5-63926b7ac738 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:50.160906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bf2e4-ae2f-496d-9bd5-63926b7ac738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:50.179433 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e64bf2e4-ae2f-496d-9bd5-63926b7ac738 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:50.180653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e64bf2e4-ae2f-496d-9bd5-63926b7ac738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:50.232920 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:50.248173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 584/1194] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:58:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:58:50.526359 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db78133-b9a0-4805-9975-28c1e2796ec2 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:50.627480 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db78133-b9a0-4805-9975-28c1e2796ec2 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:50.660496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e141ec-be0a-4e55-b3ec-2c6ff627c1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:50.661109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e141ec-be0a-4e55-b3ec-2c6ff627c1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:50.661381 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e141ec-be0a-4e55-b3ec-2c6ff627c1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:50.661646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e141ec-be0a-4e55-b3ec-2c6ff627c1c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:50.672175 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e141ec-be0a-4e55-b3ec-2c6ff627c1c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-e5e141ec-be0a-4e55-b3ec-2c6ff627c1c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:58:50.677509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:58:50.678604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:58:50.679468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:58:50.679468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:58:50.679468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:58:50.679468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:58:50.679468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:58:50.679468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:58:50.679468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:58:50.679468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:58:50.679468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:58:50.679468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:58:50.679468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:58:50.679468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:58:50.679468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 611/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 04:58:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:58:50.684745 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bf2e4-ae2f-496d-9bd5-63926b7ac738 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:50.782559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bf2e4-ae2f-496d-9bd5-63926b7ac738 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:50.816430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058c53a-8d39-4967-80c3-4520264a23ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:50.817031 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058c53a-8d39-4967-80c3-4520264a23ab None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:50.817305 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058c53a-8d39-4967-80c3-4520264a23ab None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:50.817577 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058c53a-8d39-4967-80c3-4520264a23ab None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:50.818233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058c53a-8d39-4967-80c3-4520264a23ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:50.818532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058c53a-8d39-4967-80c3-4520264a23ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:50.819887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058c53a-8d39-4967-80c3-4520264a23ab None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:50.827868 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 585/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 04:58:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:50.833827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e141ec-be0a-4e55-b3ec-2c6ff627c1c8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:50.863284 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:50.938308 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e141ec-be0a-4e55-b3ec-2c6ff627c1c8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:50.970592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb29b1f-8c8e-44df-afc9-124083016758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:50.971210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb29b1f-8c8e-44df-afc9-124083016758 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:50.971485 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb29b1f-8c8e-44df-afc9-124083016758 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:50.972304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb29b1f-8c8e-44df-afc9-124083016758 None admin] PATH_INFO: `/v3/users/7da0ba5a8fa54f33bbd73f2fa56a6bcb` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:50.973410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb29b1f-8c8e-44df-afc9-124083016758 None admin] RBAC: Authorizing `identity:get_user(user_id=7da0ba5a8fa54f33bbd73f2fa56a6bcb)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:50.974823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb29b1f-8c8e-44df-afc9-124083016758 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:50.976416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 612/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Aug 30 04:58:50 2022] GET /identity/v3/users/7da0ba5a8fa54f33bbd73f2fa56a6bcb => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:50.982461 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058c53a-8d39-4967-80c3-4520264a23ab None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:51.033684 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:51.084851 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058c53a-8d39-4967-80c3-4520264a23ab None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:51.118429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9179cc0-fdec-4709-877d-4cd23857c1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:51.119026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9179cc0-fdec-4709-877d-4cd23857c1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:51.119309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9179cc0-fdec-4709-877d-4cd23857c1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:51.119580 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9179cc0-fdec-4709-877d-4cd23857c1b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:51.186692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9179cc0-fdec-4709-877d-4cd23857c1b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:51.188163 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9179cc0-fdec-4709-877d-4cd23857c1b4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:51.238100 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:51.288387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 586/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:58:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:58:51.294523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb29b1f-8c8e-44df-afc9-124083016758 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:51.384167 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:51.394080 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb29b1f-8c8e-44df-afc9-124083016758 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:51.427047 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ed8fa-e12b-47db-b103-a606d22d6f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:51.427657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ed8fa-e12b-47db-b103-a606d22d6f8f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:51.427932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ed8fa-e12b-47db-b103-a606d22d6f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:51.428233 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ed8fa-e12b-47db-b103-a606d22d6f8f None admin] PATH_INFO: `/v3/projects/6c880d01724344c3beb9ae7b4f6239d7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:51.429337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ed8fa-e12b-47db-b103-a606d22d6f8f None admin] RBAC: Authorizing `identity:get_project(project_id=6c880d01724344c3beb9ae7b4f6239d7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:51.430755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ed8fa-e12b-47db-b103-a606d22d6f8f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:51.432386 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 613/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Aug 30 04:58:51 2022] GET /identity/v3/projects/6c880d01724344c3beb9ae7b4f6239d7 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:58:51.438832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9179cc0-fdec-4709-877d-4cd23857c1b4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:51.541949 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9179cc0-fdec-4709-877d-4cd23857c1b4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:51.581425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a02d9-c88a-441e-b76f-1c6885896453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:51.582030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a02d9-c88a-441e-b76f-1c6885896453 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:51.582309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a02d9-c88a-441e-b76f-1c6885896453 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:51.582578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a02d9-c88a-441e-b76f-1c6885896453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:51.583313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a02d9-c88a-441e-b76f-1c6885896453 None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=6c880d01724344c3beb9ae7b4f6239d7, user.id=7da0ba5a8fa54f33bbd73f2fa56a6bcb) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:58:51.583616 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a02d9-c88a-441e-b76f-1c6885896453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:51.585090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a02d9-c88a-441e-b76f-1c6885896453 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:51.591043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 587/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:58:51 2022] GET /identity/v3/role_assignments?user.id=7da0ba5a8fa54f33bbd73f2fa56a6bcb&scope.project.id=6c880d01724344c3beb9ae7b4f6239d7&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:59:01.421905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=21 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:01.588371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=93 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:47.407848 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ef147-b856-43d2-b687-987fe586806c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:47.408457 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ef147-b856-43d2-b687-987fe586806c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:47.410295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ef147-b856-43d2-b687-987fe586806c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:47.410295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 614/1201] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:59:47.416522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d17831-f052-4013-bf8a-85668221bbd8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:47.416969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d17831-f052-4013-bf8a-85668221bbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:47.417145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d17831-f052-4013-bf8a-85668221bbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:47.437646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-31d17831-f052-4013-bf8a-85668221bbd8 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:59:47.439022 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-31d17831-f052-4013-bf8a-85668221bbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:47.531585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 588/1202] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:59:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:59:47.827045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ef147-b856-43d2-b687-987fe586806c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:47.966508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ef147-b856-43d2-b687-987fe586806c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:48.010052 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5157b-8357-4cbc-b89e-b6dd756b1b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:48.010804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5157b-8357-4cbc-b89e-b6dd756b1b6d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:48.011041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5157b-8357-4cbc-b89e-b6dd756b1b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:48.011310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5157b-8357-4cbc-b89e-b6dd756b1b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:48.024803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5157b-8357-4cbc-b89e-b6dd756b1b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:48.026269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5157b-8357-4cbc-b89e-b6dd756b1b6d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-aed5157b-8357-4cbc-b89e-b6dd756b1b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:59:48.043548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:59:48.044975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:59:48.046272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:59:48.046272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:59:48.046272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:59:48.047751 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 615/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:59:48.054241 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d17831-f052-4013-bf8a-85668221bbd8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:48.200345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d17831-f052-4013-bf8a-85668221bbd8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:48.244332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:48.250587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a5c58-544e-42ae-8d3f-4cbeede1d811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:48.251186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a5c58-544e-42ae-8d3f-4cbeede1d811 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:48.251447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a5c58-544e-42ae-8d3f-4cbeede1d811 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:48.251719 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a5c58-544e-42ae-8d3f-4cbeede1d811 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:48.252403 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a5c58-544e-42ae-8d3f-4cbeede1d811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:59:48.252708 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a5c58-544e-42ae-8d3f-4cbeede1d811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:48.254082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a5c58-544e-42ae-8d3f-4cbeede1d811 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:48.267115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 589/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:59:48.273555 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5157b-8357-4cbc-b89e-b6dd756b1b6d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:48.339783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:48.402843 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5157b-8357-4cbc-b89e-b6dd756b1b6d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:48.448513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3983e-7bb2-4eba-9000-edd297cf3069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:48.448513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3983e-7bb2-4eba-9000-edd297cf3069 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:48.448513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3983e-7bb2-4eba-9000-edd297cf3069 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:48.448513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3983e-7bb2-4eba-9000-edd297cf3069 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:48.449495 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3983e-7bb2-4eba-9000-edd297cf3069 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:48.449495 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3983e-7bb2-4eba-9000-edd297cf3069 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:48.477558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 616/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Aug 30 04:59:48 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:59:50.774081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698faa9a-0458-4922-abb3-ef022f2af683 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:50.774652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698faa9a-0458-4922-abb3-ef022f2af683 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:50.774652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698faa9a-0458-4922-abb3-ef022f2af683 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:50.776520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 590/1206] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:59:50.782601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff22162-4749-4147-89c7-4707ad4d8503 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:50.783056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff22162-4749-4147-89c7-4707ad4d8503 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:50.783166 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff22162-4749-4147-89c7-4707ad4d8503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:50.806042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bff22162-4749-4147-89c7-4707ad4d8503 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:59:50.807358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bff22162-4749-4147-89c7-4707ad4d8503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:50.886263 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 617/1207] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:59:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:59:51.185708 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698faa9a-0458-4922-abb3-ef022f2af683 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:51.309694 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698faa9a-0458-4922-abb3-ef022f2af683 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:51.350876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88581475-4095-44cb-b33a-9d43d8fe40ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:51.351507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88581475-4095-44cb-b33a-9d43d8fe40ee None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:51.351782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88581475-4095-44cb-b33a-9d43d8fe40ee None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:51.352115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88581475-4095-44cb-b33a-9d43d8fe40ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:51.364694 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88581475-4095-44cb-b33a-9d43d8fe40ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-88581475-4095-44cb-b33a-9d43d8fe40ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:59:51.369632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:59:51.370777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:59:51.371677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:59:51.371677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:59:51.371677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:59:51.371677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:59:51.371677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:59:51.371677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:59:51.371677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:59:51.371677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:59:51.371677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:59:51.371677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:59:51.371677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:59:51.371677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:59:51.371677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 591/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:59:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:59:51.378054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff22162-4749-4147-89c7-4707ad4d8503 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:51.428715 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:51.493290 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff22162-4749-4147-89c7-4707ad4d8503 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:51.534559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7e698-c027-4d76-85e4-6eb2135d40ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:51.535310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7e698-c027-4d76-85e4-6eb2135d40ac None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:51.535717 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7e698-c027-4d76-85e4-6eb2135d40ac None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:51.535935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7e698-c027-4d76-85e4-6eb2135d40ac None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:51.536755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7e698-c027-4d76-85e4-6eb2135d40ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:59:51.537026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7e698-c027-4d76-85e4-6eb2135d40ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:51.538550 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7e698-c027-4d76-85e4-6eb2135d40ac None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:51.549013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 618/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:59:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:59:51.555093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88581475-4095-44cb-b33a-9d43d8fe40ee None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:51.623119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:51.687003 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88581475-4095-44cb-b33a-9d43d8fe40ee None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:51.727781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55b971-3774-433d-99f4-90bd55ca0da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:51.728829 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55b971-3774-433d-99f4-90bd55ca0da0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:51.729250 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55b971-3774-433d-99f4-90bd55ca0da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:51.729656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55b971-3774-433d-99f4-90bd55ca0da0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:51.741002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55b971-3774-433d-99f4-90bd55ca0da0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:51.742444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55b971-3774-433d-99f4-90bd55ca0da0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-6b55b971-3774-433d-99f4-90bd55ca0da0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:59:51.757772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:59:51.758794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:59:51.760157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:59:51.760157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:59:51.760157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:59:51.760157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 592/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:59:51.764905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7e698-c027-4d76-85e4-6eb2135d40ac None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:51.876075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:51.879311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7e698-c027-4d76-85e4-6eb2135d40ac None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:51.921951 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea37ae6-7f50-4636-843f-cae3ecee843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:51.922605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea37ae6-7f50-4636-843f-cae3ecee843c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:51.922919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea37ae6-7f50-4636-843f-cae3ecee843c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:51.923219 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea37ae6-7f50-4636-843f-cae3ecee843c None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:51.923896 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea37ae6-7f50-4636-843f-cae3ecee843c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:59:51.924261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea37ae6-7f50-4636-843f-cae3ecee843c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:51.925749 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea37ae6-7f50-4636-843f-cae3ecee843c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:51.940164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 619/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:59:51.945564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55b971-3774-433d-99f4-90bd55ca0da0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:52.066825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55b971-3774-433d-99f4-90bd55ca0da0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:52.068603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:52.107129 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea588cb0-89bb-4320-852c-972500237925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:52.109821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea588cb0-89bb-4320-852c-972500237925 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:52.109821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea588cb0-89bb-4320-852c-972500237925 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:52.109821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea588cb0-89bb-4320-852c-972500237925 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:52.117366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea588cb0-89bb-4320-852c-972500237925 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:52.118904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea588cb0-89bb-4320-852c-972500237925 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-ea588cb0-89bb-4320-852c-972500237925 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:59:52.131522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:59:52.132735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:59:52.133882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:59:52.133882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:59:52.133882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:59:52.133882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:59:52.133882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:59:52.133882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:59:52.133882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:59:52.133882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:59:52.133882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:59:52.133882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:59:52.133882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 593/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:59:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:59:52.138760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea37ae6-7f50-4636-843f-cae3ecee843c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:52.258995 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea37ae6-7f50-4636-843f-cae3ecee843c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:52.299502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc9ec7-86ac-4c6a-b6da-f2ba0d0a21e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:52.300140 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc9ec7-86ac-4c6a-b6da-f2ba0d0a21e4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:52.300414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc9ec7-86ac-4c6a-b6da-f2ba0d0a21e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:52.300687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc9ec7-86ac-4c6a-b6da-f2ba0d0a21e4 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:52.301413 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc9ec7-86ac-4c6a-b6da-f2ba0d0a21e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:59:52.301702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc9ec7-86ac-4c6a-b6da-f2ba0d0a21e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:52.303380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc9ec7-86ac-4c6a-b6da-f2ba0d0a21e4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:52.326907 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 620/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Aug 30 04:59:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:59:52.329425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea588cb0-89bb-4320-852c-972500237925 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:52.462281 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea588cb0-89bb-4320-852c-972500237925 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:52.501973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f3cd7-d2a3-4d21-bdef-046882bf4eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:52.503747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3cd7-d2a3-4d21-bdef-046882bf4eca None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:52.503747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3cd7-d2a3-4d21-bdef-046882bf4eca None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:52.503747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3cd7-d2a3-4d21-bdef-046882bf4eca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:52.538926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:52.584575 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f3cd7-d2a3-4d21-bdef-046882bf4eca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:52.585951 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f3cd7-d2a3-4d21-bdef-046882bf4eca None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:52.712912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 594/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 04:59:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:59:52.718944 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc9ec7-86ac-4c6a-b6da-f2ba0d0a21e4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:52.743575 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:52.839923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc9ec7-86ac-4c6a-b6da-f2ba0d0a21e4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:52.876475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7445b-e71a-4121-a34d-9113204440c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:52.877150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7445b-e71a-4121-a34d-9113204440c6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:52.877403 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7445b-e71a-4121-a34d-9113204440c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:52.877719 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7445b-e71a-4121-a34d-9113204440c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:52.888167 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7445b-e71a-4121-a34d-9113204440c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:52.890323 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7445b-e71a-4121-a34d-9113204440c6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-10b7445b-e71a-4121-a34d-9113204440c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:59:52.906476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:59:52.907680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:59:52.908645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:59:52.908645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:59:52.908645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:59:52.908645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 621/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:59:52.914176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f3cd7-d2a3-4d21-bdef-046882bf4eca None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:52.976676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:53.017626 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f3cd7-d2a3-4d21-bdef-046882bf4eca None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:53.054415 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1d4b6-d18b-4cde-9611-0864c7f11e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:53.054996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1d4b6-d18b-4cde-9611-0864c7f11e57 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:53.055268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1d4b6-d18b-4cde-9611-0864c7f11e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:53.055534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1d4b6-d18b-4cde-9611-0864c7f11e57 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:53.056207 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1d4b6-d18b-4cde-9611-0864c7f11e57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:59:53.056503 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1d4b6-d18b-4cde-9611-0864c7f11e57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:53.057870 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1d4b6-d18b-4cde-9611-0864c7f11e57 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:53.069801 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 595/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:59:53.075634 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7445b-e71a-4121-a34d-9113204440c6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:53.169016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:53.211042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7445b-e71a-4121-a34d-9113204440c6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:53.246817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5914a-8da0-45c3-a21e-0dd328cdd4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:53.247520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5914a-8da0-45c3-a21e-0dd328cdd4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:53.247861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5914a-8da0-45c3-a21e-0dd328cdd4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:53.248203 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5914a-8da0-45c3-a21e-0dd328cdd4b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:53.256753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5914a-8da0-45c3-a21e-0dd328cdd4b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:53.258257 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5914a-8da0-45c3-a21e-0dd328cdd4b1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:53.269536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-44d5914a-8da0-45c3-a21e-0dd328cdd4b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:59:53.269536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:59:53.269536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:59:53.269536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:59:53.269536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:59:53.269536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:59:53.269536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:59:53.269536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:59:53.269536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:59:53.269536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:59:53.269536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:59:53.269536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:59:53.269536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:59:53.269536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:59:53.269536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:59:53.270427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:59:53.276254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:59:53.276254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:59:53.276254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:59:53.276254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:59:53.276254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:59:53.276254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:59:53.276254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:59:53.276254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 04:59:53.276254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 622/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:59:53.276826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1d4b6-d18b-4cde-9611-0864c7f11e57 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:53.388917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1d4b6-d18b-4cde-9611-0864c7f11e57 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:53.414002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:53.427042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dca39-b366-401b-b9b7-585ea53e2bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:53.427575 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dca39-b366-401b-b9b7-585ea53e2bdf None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:53.427908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dca39-b366-401b-b9b7-585ea53e2bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:53.428222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dca39-b366-401b-b9b7-585ea53e2bdf None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:53.428925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dca39-b366-401b-b9b7-585ea53e2bdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:59:53.429229 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dca39-b366-401b-b9b7-585ea53e2bdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:53.430716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dca39-b366-401b-b9b7-585ea53e2bdf None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:53.453111 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 596/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:59:53.454892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5914a-8da0-45c3-a21e-0dd328cdd4b1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:53.592303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5914a-8da0-45c3-a21e-0dd328cdd4b1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:53.631244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:53.640110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2f1b1-74c9-4125-879a-f54ce3321826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:53.640736 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2f1b1-74c9-4125-879a-f54ce3321826 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:53.640999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2f1b1-74c9-4125-879a-f54ce3321826 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:53.641251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2f1b1-74c9-4125-879a-f54ce3321826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:53.642041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2f1b1-74c9-4125-879a-f54ce3321826 None admin] RBAC: Adding query filter params (role.id=2381dab0bb194ddfaf31c2933c683b71, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=ed835047051142d2bc98bb1564e3a98f) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:59:53.642352 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2f1b1-74c9-4125-879a-f54ce3321826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:53.643766 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2f1b1-74c9-4125-879a-f54ce3321826 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:53.651078 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 623/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 04:59:53 2022] GET /identity/v3/role_assignments?user.id=ed835047051142d2bc98bb1564e3a98f&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=2381dab0bb194ddfaf31c2933c683b71 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:59:55.707651 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d4d77-2b87-4179-b4cb-be04bfb15e96 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:55.708252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d4d77-2b87-4179-b4cb-be04bfb15e96 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:55.708359 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d4d77-2b87-4179-b4cb-be04bfb15e96 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:55.709967 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 597/1220] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 04:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:59:55.716090 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dfb76-7c4e-4f76-9789-536baa94f5f8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:55.716532 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dfb76-7c4e-4f76-9789-536baa94f5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:55.716638 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dfb76-7c4e-4f76-9789-536baa94f5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:55.737256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-227dfb76-7c4e-4f76-9789-536baa94f5f8 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:59:55.738539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-227dfb76-7c4e-4f76-9789-536baa94f5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:55.823371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 624/1221] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 04:59:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:59:56.100179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d4d77-2b87-4179-b4cb-be04bfb15e96 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:56.214181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d4d77-2b87-4179-b4cb-be04bfb15e96 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:56.256003 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a593de4-6a79-4f4d-92e8-60342b9554aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:56.256583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a593de4-6a79-4f4d-92e8-60342b9554aa None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:56.256890 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a593de4-6a79-4f4d-92e8-60342b9554aa None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:56.257208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a593de4-6a79-4f4d-92e8-60342b9554aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:56.268852 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a593de4-6a79-4f4d-92e8-60342b9554aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-2a593de4-6a79-4f4d-92e8-60342b9554aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:59:56.273838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:59:56.274936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:59:56.275819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:59:56.275819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:59:56.275819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:59:56.275819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:59:56.275819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:59:56.275819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:59:56.275819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:59:56.275819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:59:56.275819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:59:56.275819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:59:56.275819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:59:56.275819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:59:56.275819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 598/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 04:59:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:59:56.281123 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dfb76-7c4e-4f76-9789-536baa94f5f8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:56.381348 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dfb76-7c4e-4f76-9789-536baa94f5f8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:56.410448 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:56.422069 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e15de0-e1ac-481f-b264-8a191a6afd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:56.422681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e15de0-e1ac-481f-b264-8a191a6afd7b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:56.422954 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e15de0-e1ac-481f-b264-8a191a6afd7b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:56.423223 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e15de0-e1ac-481f-b264-8a191a6afd7b None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:56.423884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e15de0-e1ac-481f-b264-8a191a6afd7b None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:59:56.424214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e15de0-e1ac-481f-b264-8a191a6afd7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:56.425629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e15de0-e1ac-481f-b264-8a191a6afd7b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:56.434165 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 625/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 04:59:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:59:56.440772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a593de4-6a79-4f4d-92e8-60342b9554aa None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:56.486255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:56.549147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a593de4-6a79-4f4d-92e8-60342b9554aa None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:56.589450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382be27-e8c2-4629-8639-2625e35ee2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:56.590081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382be27-e8c2-4629-8639-2625e35ee2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:56.590356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382be27-e8c2-4629-8639-2625e35ee2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:56.590621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382be27-e8c2-4629-8639-2625e35ee2b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:56.602219 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382be27-e8c2-4629-8639-2625e35ee2b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:56.603928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382be27-e8c2-4629-8639-2625e35ee2b3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f382be27-e8c2-4629-8639-2625e35ee2b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:59:56.620191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:59:56.621655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:59:56.622698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:59:56.622698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:59:56.622698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:59:56.622698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 599/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:59:56.628282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e15de0-e1ac-481f-b264-8a191a6afd7b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:56.736741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e15de0-e1ac-481f-b264-8a191a6afd7b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:56.772917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5d36d-67fb-4dda-89e8-7a8ef4565869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:56.773469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5d36d-67fb-4dda-89e8-7a8ef4565869 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:56.773747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5d36d-67fb-4dda-89e8-7a8ef4565869 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:56.774018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5d36d-67fb-4dda-89e8-7a8ef4565869 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:56.774646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5d36d-67fb-4dda-89e8-7a8ef4565869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:59:56.774943 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5d36d-67fb-4dda-89e8-7a8ef4565869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:56.776342 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5d36d-67fb-4dda-89e8-7a8ef4565869 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:56.790223 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 626/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:59:56.796658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382be27-e8c2-4629-8639-2625e35ee2b3 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:56.894349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:56.902187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382be27-e8c2-4629-8639-2625e35ee2b3 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:56.941296 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb404f-3dac-4dcd-bc45-4d00a3eb6e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:56.941932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb404f-3dac-4dcd-bc45-4d00a3eb6e61 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:56.942200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb404f-3dac-4dcd-bc45-4d00a3eb6e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:56.942465 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb404f-3dac-4dcd-bc45-4d00a3eb6e61 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:56.950228 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb404f-3dac-4dcd-bc45-4d00a3eb6e61 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:56.951680 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb404f-3dac-4dcd-bc45-4d00a3eb6e61 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f6eb404f-3dac-4dcd-bc45-4d00a3eb6e61 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:59:56.965157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:59:56.966366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:59:56.967921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:59:56.967921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:59:56.967921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:59:56.967921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:59:56.967921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:59:56.967921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:59:56.967921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:59:56.967921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:59:56.967921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:59:56.967921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:59:56.967921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 600/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:59:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:59:56.972941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5d36d-67fb-4dda-89e8-7a8ef4565869 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:57.030870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:57.095477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5d36d-67fb-4dda-89e8-7a8ef4565869 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:57.136678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98df8a-b335-481f-8944-41ec04b89c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:57.137285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98df8a-b335-481f-8944-41ec04b89c9e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:57.137626 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98df8a-b335-481f-8944-41ec04b89c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:57.137818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98df8a-b335-481f-8944-41ec04b89c9e None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:57.138636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98df8a-b335-481f-8944-41ec04b89c9e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:59:57.138999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98df8a-b335-481f-8944-41ec04b89c9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:57.142844 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98df8a-b335-481f-8944-41ec04b89c9e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:57.168764 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 627/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Aug 30 04:59:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:59:57.170066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb404f-3dac-4dcd-bc45-4d00a3eb6e61 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:57.295517 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb404f-3dac-4dcd-bc45-4d00a3eb6e61 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:57.332970 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d0fdf-a39f-4181-95d8-ab08f4dd5412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:57.333622 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d0fdf-a39f-4181-95d8-ab08f4dd5412 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:57.333895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d0fdf-a39f-4181-95d8-ab08f4dd5412 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:57.334226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d0fdf-a39f-4181-95d8-ab08f4dd5412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:57.346702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d0fdf-a39f-4181-95d8-ab08f4dd5412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:57.348171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d0fdf-a39f-4181-95d8-ab08f4dd5412 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-9e3d0fdf-a39f-4181-95d8-ab08f4dd5412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:59:57.363838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:59:57.370200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:59:57.371377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:59:57.371377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:59:57.371377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:59:57.371377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 601/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 04:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:59:57.371797 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98df8a-b335-481f-8944-41ec04b89c9e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:57.483553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98df8a-b335-481f-8944-41ec04b89c9e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:57.486182 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:57.521765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f202e1-c1bb-4f18-8218-7d617695c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:57.522372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f202e1-c1bb-4f18-8218-7d617695c218 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:57.522646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f202e1-c1bb-4f18-8218-7d617695c218 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:57.522915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f202e1-c1bb-4f18-8218-7d617695c218 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:57.523552 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f202e1-c1bb-4f18-8218-7d617695c218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:59:57.523849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f202e1-c1bb-4f18-8218-7d617695c218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:57.525238 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f202e1-c1bb-4f18-8218-7d617695c218 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:57.537807 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 628/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 04:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:59:57.543861 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d0fdf-a39f-4181-95d8-ab08f4dd5412 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:57.554632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:57.654656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d0fdf-a39f-4181-95d8-ab08f4dd5412 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:57.693729 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063795a-2b24-4d0f-84ee-69334d5f7eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:57.694578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063795a-2b24-4d0f-84ee-69334d5f7eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:57.694890 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063795a-2b24-4d0f-84ee-69334d5f7eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:57.695216 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063795a-2b24-4d0f-84ee-69334d5f7eb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:57.705434 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063795a-2b24-4d0f-84ee-69334d5f7eb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:57.706947 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063795a-2b24-4d0f-84ee-69334d5f7eb1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:57.719327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e063795a-2b24-4d0f-84ee-69334d5f7eb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:59:57.719327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:59:57.719327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:59:57.719327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:59:57.719327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:59:57.719327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:59:57.719327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:59:57.719327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:59:57.719327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:59:57.719327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:59:57.719327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:59:57.719327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:59:57.719327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:59:57.719327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:59:57.719327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:59:57.721090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:59:57.722887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:59:57.722887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:59:57.722887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:59:57.722887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:59:57.722887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:59:57.722887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:59:57.722887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:59:57.722887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 04:59:57.722887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 602/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 04:59:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:59:57.726906 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f202e1-c1bb-4f18-8218-7d617695c218 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:57.838846 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f202e1-c1bb-4f18-8218-7d617695c218 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:57.876594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598c794-a0dc-4258-8921-91e3748850e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:57.877205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598c794-a0dc-4258-8921-91e3748850e5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:57.877478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598c794-a0dc-4258-8921-91e3748850e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:57.877747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598c794-a0dc-4258-8921-91e3748850e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:57.878444 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598c794-a0dc-4258-8921-91e3748850e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:59:57.878739 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598c794-a0dc-4258-8921-91e3748850e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:57.880198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598c794-a0dc-4258-8921-91e3748850e5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:57.894163 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 629/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 04:59:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:59:57.900578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063795a-2b24-4d0f-84ee-69334d5f7eb1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:57.973939 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:58.011711 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063795a-2b24-4d0f-84ee-69334d5f7eb1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:58.048538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a272dd-e703-4456-8384-78eec3667bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:58.049316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a272dd-e703-4456-8384-78eec3667bae None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:58.049623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a272dd-e703-4456-8384-78eec3667bae None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:58.049889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a272dd-e703-4456-8384-78eec3667bae None admin] PATH_INFO: `/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/ed835047051142d2bc98bb1564e3a98f/roles/2381dab0bb194ddfaf31c2933c683b71` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:58.067663 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a272dd-e703-4456-8384-78eec3667bae None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8aae17def04cf48190ede4bffefe70, user_id=ed835047051142d2bc98bb1564e3a98f, role_id=2381dab0bb194ddfaf31c2933c683b71)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:58.069415 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a272dd-e703-4456-8384-78eec3667bae None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:58.083519 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 603/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 04:59:57 2022] PUT /identity/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/ed835047051142d2bc98bb1564e3a98f/roles/2381dab0bb194ddfaf31c2933c683b71 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:00:00.043525 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd724a5c-4771-41f2-ab17-8f3dd4a8de22 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:00.044084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd724a5c-4771-41f2-ab17-8f3dd4a8de22 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:00.044084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd724a5c-4771-41f2-ab17-8f3dd4a8de22 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:00.046025 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 630/1233] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:00:00.051673 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e4462-4a8b-4fa4-809e-f14df6341b10 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:00.052176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e4462-4a8b-4fa4-809e-f14df6341b10 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:00.052736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e4462-4a8b-4fa4-809e-f14df6341b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:00.071904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-763e4462-4a8b-4fa4-809e-f14df6341b10 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:00:00.073138 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-763e4462-4a8b-4fa4-809e-f14df6341b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:00:00.149479 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 604/1234] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:00:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 05:00:00.429643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd724a5c-4771-41f2-ab17-8f3dd4a8de22 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:00.455442 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:00.538332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd724a5c-4771-41f2-ab17-8f3dd4a8de22 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:00.582962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cf8c5-5745-4f18-aa28-7050d434d92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:00.583740 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cf8c5-5745-4f18-aa28-7050d434d92b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:00.584051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cf8c5-5745-4f18-aa28-7050d434d92b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:00.584470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cf8c5-5745-4f18-aa28-7050d434d92b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:00.596004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cf8c5-5745-4f18-aa28-7050d434d92b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-930cf8c5-5745-4f18-aa28-7050d434d92b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 05:00:00.601374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:00.602566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:00.603429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:00.603429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:00.603429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:00.603429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:00.603429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 05:00:00.603429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 05:00:00.603429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 05:00:00.603429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 05:00:00.603429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 05:00:00.603429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 05:00:00.603429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 05:00:00.603429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 05:00:00.603429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 631/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Aug 30 05:00:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:00.608752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e4462-4a8b-4fa4-809e-f14df6341b10 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:00.658697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:00.724000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e4462-4a8b-4fa4-809e-f14df6341b10 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:00.771737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be097714-ebe2-4fcc-8151-b1bee2e5c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:00.772788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be097714-ebe2-4fcc-8151-b1bee2e5c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:00.773232 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be097714-ebe2-4fcc-8151-b1bee2e5c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:00.773694 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be097714-ebe2-4fcc-8151-b1bee2e5c1d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:00.774821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be097714-ebe2-4fcc-8151-b1bee2e5c1d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:00.775343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be097714-ebe2-4fcc-8151-b1bee2e5c1d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:00.777678 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be097714-ebe2-4fcc-8151-b1bee2e5c1d8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:00.788500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 605/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Aug 30 05:00:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:00.794245 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cf8c5-5745-4f18-aa28-7050d434d92b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:00.885061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:00.906018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cf8c5-5745-4f18-aa28-7050d434d92b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:00.964360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b9f1f-27ab-4175-87e4-1b53a40e2723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:00.965111 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b9f1f-27ab-4175-87e4-1b53a40e2723 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:00.965493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b9f1f-27ab-4175-87e4-1b53a40e2723 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:00.965858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b9f1f-27ab-4175-87e4-1b53a40e2723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:00.982589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b9f1f-27ab-4175-87e4-1b53a40e2723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:00.985499 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b9f1f-27ab-4175-87e4-1b53a40e2723 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-9a7b9f1f-27ab-4175-87e4-1b53a40e2723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 05:00:01.009106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:01.010399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 05:00:01.011531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 05:00:01.011531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:01.011531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 05:00:01.011531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 632/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 05:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 05:00:01.017496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be097714-ebe2-4fcc-8151-b1bee2e5c1d8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:01.130737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be097714-ebe2-4fcc-8151-b1bee2e5c1d8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:01.140518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:01.166752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f7efd-4765-4fd4-9a51-d3f65689f004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:01.167353 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7efd-4765-4fd4-9a51-d3f65689f004 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:01.167632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7efd-4765-4fd4-9a51-d3f65689f004 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:01.168010 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7efd-4765-4fd4-9a51-d3f65689f004 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:01.168581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f7efd-4765-4fd4-9a51-d3f65689f004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:01.168881 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f7efd-4765-4fd4-9a51-d3f65689f004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:01.170280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f7efd-4765-4fd4-9a51-d3f65689f004 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:01.187836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 606/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 05:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:00:01.189142 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b9f1f-27ab-4175-87e4-1b53a40e2723 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:01.312496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b9f1f-27ab-4175-87e4-1b53a40e2723 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:01.352583 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bd411-0a4a-4919-ae16-2e9d426f1908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:01.353210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bd411-0a4a-4919-ae16-2e9d426f1908 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:01.353483 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bd411-0a4a-4919-ae16-2e9d426f1908 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:01.353747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bd411-0a4a-4919-ae16-2e9d426f1908 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:01.356744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:01.363171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bd411-0a4a-4919-ae16-2e9d426f1908 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:01.365085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bd411-0a4a-4919-ae16-2e9d426f1908 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-873bd411-0a4a-4919-ae16-2e9d426f1908 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 05:00:01.378991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:01.380312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:01.381445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:01.381445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:01.381445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 05:00:01.381445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 05:00:01.381445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 05:00:01.381445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 05:00:01.381445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 05:00:01.381445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 05:00:01.381445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 05:00:01.381445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 05:00:01.381445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 633/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 05:00:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:01.387450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f7efd-4765-4fd4-9a51-d3f65689f004 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:01.497947 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f7efd-4765-4fd4-9a51-d3f65689f004 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:01.536442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076460d-0d93-44f8-9d3a-2574fffb3f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:01.537044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076460d-0d93-44f8-9d3a-2574fffb3f76 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:01.537319 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076460d-0d93-44f8-9d3a-2574fffb3f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:01.537584 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076460d-0d93-44f8-9d3a-2574fffb3f76 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:01.538311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076460d-0d93-44f8-9d3a-2574fffb3f76 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:01.538606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076460d-0d93-44f8-9d3a-2574fffb3f76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:01.540226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076460d-0d93-44f8-9d3a-2574fffb3f76 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:01.558938 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 607/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Aug 30 05:00:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:01.565805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bd411-0a4a-4919-ae16-2e9d426f1908 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:01.682529 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bd411-0a4a-4919-ae16-2e9d426f1908 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:01.720984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacb0cd-9dba-4b80-8f30-09fc425378af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:01.721604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacb0cd-9dba-4b80-8f30-09fc425378af None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:01.721882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacb0cd-9dba-4b80-8f30-09fc425378af None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:01.722150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacb0cd-9dba-4b80-8f30-09fc425378af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:01.786688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:01.793564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacb0cd-9dba-4b80-8f30-09fc425378af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:01.795014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacb0cd-9dba-4b80-8f30-09fc425378af None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:01.909094 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 634/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 05:00:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 05:00:01.915042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076460d-0d93-44f8-9d3a-2574fffb3f76 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:01.946902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:02.036676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076460d-0d93-44f8-9d3a-2574fffb3f76 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:02.076461 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ce98d-9023-46e9-8e21-4cb5e87ddee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:02.077255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ce98d-9023-46e9-8e21-4cb5e87ddee8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:02.077545 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ce98d-9023-46e9-8e21-4cb5e87ddee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:02.077997 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ce98d-9023-46e9-8e21-4cb5e87ddee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:02.090072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ce98d-9023-46e9-8e21-4cb5e87ddee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:02.091539 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ce98d-9023-46e9-8e21-4cb5e87ddee8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-4b5ce98d-9023-46e9-8e21-4cb5e87ddee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 05:00:02.109462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:02.110676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 05:00:02.111761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 05:00:02.111761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:02.111761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:02.111761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 608/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 05:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 05:00:02.116951 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacb0cd-9dba-4b80-8f30-09fc425378af None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:02.232850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:02.239691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacb0cd-9dba-4b80-8f30-09fc425378af None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:02.278614 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1efade-f54e-4f17-a62b-bcb34a630c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:02.279420 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1efade-f54e-4f17-a62b-bcb34a630c37 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:02.279622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1efade-f54e-4f17-a62b-bcb34a630c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:02.279893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1efade-f54e-4f17-a62b-bcb34a630c37 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:02.280593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1efade-f54e-4f17-a62b-bcb34a630c37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:02.280933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1efade-f54e-4f17-a62b-bcb34a630c37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:02.282566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1efade-f54e-4f17-a62b-bcb34a630c37 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:02.295476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 635/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 05:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:00:02.301907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ce98d-9023-46e9-8e21-4cb5e87ddee8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:02.396924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:02.431271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ce98d-9023-46e9-8e21-4cb5e87ddee8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:02.470255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6eff3-4dfd-4d14-bebd-88290276e0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:02.471028 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6eff3-4dfd-4d14-bebd-88290276e0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:02.471520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6eff3-4dfd-4d14-bebd-88290276e0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:02.471908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6eff3-4dfd-4d14-bebd-88290276e0f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:02.479901 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6eff3-4dfd-4d14-bebd-88290276e0f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:02.481419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6eff3-4dfd-4d14-bebd-88290276e0f5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:02.493144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-d5a6eff3-4dfd-4d14-bebd-88290276e0f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 05:00:02.493144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:02.493144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:02.493144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:02.493144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:02.493144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:02.493144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:02.493144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:02.493144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:02.493144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:02.493144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:02.493144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:02.493144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 05:00:02.493144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 05:00:02.493144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:02.494117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:02.495036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 05:00:02.495036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 05:00:02.495036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 05:00:02.495036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 05:00:02.495036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 05:00:02.495036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 05:00:02.495036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 05:00:02.495036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:02.495036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 609/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 05:00:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:02.501032 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1efade-f54e-4f17-a62b-bcb34a630c37 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:02.613141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1efade-f54e-4f17-a62b-bcb34a630c37 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:02.652350 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec508c-b53e-477f-81f0-1abca9960e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:02.652952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec508c-b53e-477f-81f0-1abca9960e95 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:02.653227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec508c-b53e-477f-81f0-1abca9960e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:02.653497 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec508c-b53e-477f-81f0-1abca9960e95 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:02.654182 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec508c-b53e-477f-81f0-1abca9960e95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:02.655032 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec508c-b53e-477f-81f0-1abca9960e95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:02.656507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec508c-b53e-477f-81f0-1abca9960e95 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:02.675931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 636/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 05:00:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:02.677219 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6eff3-4dfd-4d14-bebd-88290276e0f5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:02.793595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6eff3-4dfd-4d14-bebd-88290276e0f5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:02.835320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14affd3-5775-48b1-98e2-99f9f97aca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:02.836064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14affd3-5775-48b1-98e2-99f9f97aca1b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:02.836344 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14affd3-5775-48b1-98e2-99f9f97aca1b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:02.836767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14affd3-5775-48b1-98e2-99f9f97aca1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:02.837646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14affd3-5775-48b1-98e2-99f9f97aca1b None admin] RBAC: Adding query filter params (role.id=2381dab0bb194ddfaf31c2933c683b71, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=ed835047051142d2bc98bb1564e3a98f) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:02.838137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14affd3-5775-48b1-98e2-99f9f97aca1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:02.839904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14affd3-5775-48b1-98e2-99f9f97aca1b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:02.847065 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 610/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 05:00:02 2022] GET /identity/v3/role_assignments?user.id=ed835047051142d2bc98bb1564e3a98f&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=2381dab0bb194ddfaf31c2933c683b71 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:05.032674 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de58074-319f-4d26-ab12-c6cf910d195f None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:05.033218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de58074-319f-4d26-ab12-c6cf910d195f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:05.033218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de58074-319f-4d26-ab12-c6cf910d195f None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:05.034551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 637/1247] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:00:05.040181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d65a45-bd08-425b-a17e-0378651555bd None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:05.040731 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d65a45-bd08-425b-a17e-0378651555bd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:05.040899 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d65a45-bd08-425b-a17e-0378651555bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:05.049028 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:05.063109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-79d65a45-bd08-425b-a17e-0378651555bd None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:00:05.064343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-79d65a45-bd08-425b-a17e-0378651555bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:00:05.140949 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 611/1248] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:00:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 05:00:05.432839 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de58074-319f-4d26-ab12-c6cf910d195f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:05.453928 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:05.557101 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de58074-319f-4d26-ab12-c6cf910d195f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:05.600020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faeaf81-50ae-4949-82e2-047e45bee7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:05.600653 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faeaf81-50ae-4949-82e2-047e45bee7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:05.600927 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faeaf81-50ae-4949-82e2-047e45bee7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:05.601193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faeaf81-50ae-4949-82e2-047e45bee7d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:05.612297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faeaf81-50ae-4949-82e2-047e45bee7d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-2faeaf81-50ae-4949-82e2-047e45bee7d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 05:00:05.617388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:05.618541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:05.619423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:05.619423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:05.619423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:05.619423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:05.619423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 05:00:05.619423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 05:00:05.619423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 05:00:05.619423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 05:00:05.619423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 05:00:05.619423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 05:00:05.619423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 05:00:05.619423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 05:00:05.619423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 638/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 05:00:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 05:00:05.625710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d65a45-bd08-425b-a17e-0378651555bd None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:05.742359 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d65a45-bd08-425b-a17e-0378651555bd None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:05.777156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:05.784202 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910d44d-4ae3-4559-9f25-f000e821ac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:05.784810 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910d44d-4ae3-4559-9f25-f000e821ac1f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:05.785145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910d44d-4ae3-4559-9f25-f000e821ac1f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:05.785351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910d44d-4ae3-4559-9f25-f000e821ac1f None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:05.786021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910d44d-4ae3-4559-9f25-f000e821ac1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:05.786324 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910d44d-4ae3-4559-9f25-f000e821ac1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:05.787704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910d44d-4ae3-4559-9f25-f000e821ac1f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:05.799706 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 612/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 05:00:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:05.805535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faeaf81-50ae-4949-82e2-047e45bee7d2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:05.896119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:05.922432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faeaf81-50ae-4949-82e2-047e45bee7d2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:05.964975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e796fc7-3a29-433e-afcb-1ba55f02f6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:05.965683 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e796fc7-3a29-433e-afcb-1ba55f02f6db None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:05.965958 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e796fc7-3a29-433e-afcb-1ba55f02f6db None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:05.966227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e796fc7-3a29-433e-afcb-1ba55f02f6db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:05.978601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e796fc7-3a29-433e-afcb-1ba55f02f6db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:05.980931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e796fc7-3a29-433e-afcb-1ba55f02f6db None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-6e796fc7-3a29-433e-afcb-1ba55f02f6db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 05:00:06.002100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:06.003171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 05:00:06.009119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 05:00:06.009119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:06.009119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 05:00:06.009119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 639/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 05:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 05:00:06.009773 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910d44d-4ae3-4559-9f25-f000e821ac1f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:06.132570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910d44d-4ae3-4559-9f25-f000e821ac1f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:06.170245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c0cd-4ffd-4989-b405-cfa889bd990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:06.170852 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c0cd-4ffd-4989-b405-cfa889bd990a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:06.171122 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c0cd-4ffd-4989-b405-cfa889bd990a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:06.171387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c0cd-4ffd-4989-b405-cfa889bd990a None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:06.172094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3c0cd-4ffd-4989-b405-cfa889bd990a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:06.172403 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3c0cd-4ffd-4989-b405-cfa889bd990a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:06.173770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3c0cd-4ffd-4989-b405-cfa889bd990a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:06.186973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 613/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 05:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:06.192905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e796fc7-3a29-433e-afcb-1ba55f02f6db None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:06.310059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e796fc7-3a29-433e-afcb-1ba55f02f6db None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:06.339096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:06.348494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c4ade-ecfa-4992-8fb2-49b6336af991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:06.349161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c4ade-ecfa-4992-8fb2-49b6336af991 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:06.349532 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c4ade-ecfa-4992-8fb2-49b6336af991 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:06.349840 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c4ade-ecfa-4992-8fb2-49b6336af991 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:06.358905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c4ade-ecfa-4992-8fb2-49b6336af991 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:06.360465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c4ade-ecfa-4992-8fb2-49b6336af991 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1e7c4ade-ecfa-4992-8fb2-49b6336af991 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 05:00:06.371693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:06.372865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:06.374861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:06.374861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:06.374861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 05:00:06.374861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 05:00:06.374861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 05:00:06.374861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 05:00:06.374861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 05:00:06.374861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 05:00:06.374861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 05:00:06.374861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 05:00:06.374861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 640/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 05:00:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:06.381651 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c0cd-4ffd-4989-b405-cfa889bd990a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:06.450808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:06.498438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c0cd-4ffd-4989-b405-cfa889bd990a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:06.535416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a220ac2-3940-4d5d-adc1-7a44ac0e913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:06.536150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a220ac2-3940-4d5d-adc1-7a44ac0e913a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:06.536467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a220ac2-3940-4d5d-adc1-7a44ac0e913a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:06.536770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a220ac2-3940-4d5d-adc1-7a44ac0e913a None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:06.537712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a220ac2-3940-4d5d-adc1-7a44ac0e913a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:06.538112 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a220ac2-3940-4d5d-adc1-7a44ac0e913a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:06.539871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a220ac2-3940-4d5d-adc1-7a44ac0e913a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:06.561983 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 614/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Aug 30 05:00:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:06.567883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c4ade-ecfa-4992-8fb2-49b6336af991 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:06.679009 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c4ade-ecfa-4992-8fb2-49b6336af991 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:06.721187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b872ed-dfdb-480d-87a1-d2a601f4c0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:06.721187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b872ed-dfdb-480d-87a1-d2a601f4c0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:06.721187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b872ed-dfdb-480d-87a1-d2a601f4c0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:06.721661 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b872ed-dfdb-480d-87a1-d2a601f4c0f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:06.788354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:06.805587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b872ed-dfdb-480d-87a1-d2a601f4c0f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:06.806296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b872ed-dfdb-480d-87a1-d2a601f4c0f1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:06.923902 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 641/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 05:00:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 05:00:06.930053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a220ac2-3940-4d5d-adc1-7a44ac0e913a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:07.048843 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a220ac2-3940-4d5d-adc1-7a44ac0e913a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:07.063191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:07.084691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8e196-711f-41ff-8003-d3bd86ef7569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:07.085315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8e196-711f-41ff-8003-d3bd86ef7569 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:07.085671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8e196-711f-41ff-8003-d3bd86ef7569 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:07.085896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8e196-711f-41ff-8003-d3bd86ef7569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:07.095932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8e196-711f-41ff-8003-d3bd86ef7569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:07.097451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8e196-711f-41ff-8003-d3bd86ef7569 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-68a8e196-711f-41ff-8003-d3bd86ef7569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 05:00:07.112139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:07.113316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 05:00:07.114579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 05:00:07.114579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:07.114579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:07.114579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 615/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 05:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:07.119008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b872ed-dfdb-480d-87a1-d2a601f4c0f1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:07.221286 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:07.237599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b872ed-dfdb-480d-87a1-d2a601f4c0f1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:07.275155 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5ba5a-3d51-4d9e-a3e8-8cbfd43115f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:07.275759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5ba5a-3d51-4d9e-a3e8-8cbfd43115f9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:07.276096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5ba5a-3d51-4d9e-a3e8-8cbfd43115f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:07.276335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5ba5a-3d51-4d9e-a3e8-8cbfd43115f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:07.276972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5ba5a-3d51-4d9e-a3e8-8cbfd43115f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:07.277327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5ba5a-3d51-4d9e-a3e8-8cbfd43115f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:07.279934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5ba5a-3d51-4d9e-a3e8-8cbfd43115f9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:07.294008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 642/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 05:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:07.300057 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8e196-711f-41ff-8003-d3bd86ef7569 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:07.405355 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8e196-711f-41ff-8003-d3bd86ef7569 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:07.445186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df919eb9-b63f-4b51-9e9c-729b556e304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:07.445840 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df919eb9-b63f-4b51-9e9c-729b556e304b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:07.446088 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df919eb9-b63f-4b51-9e9c-729b556e304b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:07.446351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df919eb9-b63f-4b51-9e9c-729b556e304b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:07.453315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df919eb9-b63f-4b51-9e9c-729b556e304b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:07.454739 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df919eb9-b63f-4b51-9e9c-729b556e304b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:07.466187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-df919eb9-b63f-4b51-9e9c-729b556e304b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 05:00:07.466187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:07.466187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:07.466187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:07.466187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:07.466187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:07.466187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:07.466187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:07.466187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:07.466187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:07.466187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:07.466187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:07.466187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 05:00:07.466187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 05:00:07.466187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:07.467919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:07.469061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 05:00:07.469061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 05:00:07.469061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 05:00:07.469061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 05:00:07.469061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 05:00:07.469061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 05:00:07.469061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 05:00:07.469061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:07.469061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 616/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 05:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:07.473863 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5ba5a-3d51-4d9e-a3e8-8cbfd43115f9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:07.588252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5ba5a-3d51-4d9e-a3e8-8cbfd43115f9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:07.625613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8f7bc-7037-4db2-bd86-f30317359a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:07.626214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8f7bc-7037-4db2-bd86-f30317359a3c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:07.626487 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8f7bc-7037-4db2-bd86-f30317359a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:07.626752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8f7bc-7037-4db2-bd86-f30317359a3c None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:07.627434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8f7bc-7037-4db2-bd86-f30317359a3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:07.627732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8f7bc-7037-4db2-bd86-f30317359a3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:07.629169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8f7bc-7037-4db2-bd86-f30317359a3c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:07.641601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 643/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 05:00:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:07.648067 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df919eb9-b63f-4b51-9e9c-729b556e304b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:07.678602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:07.762817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df919eb9-b63f-4b51-9e9c-729b556e304b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:07.800245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa226d-c74a-4d03-8148-e1ed43e0e53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:07.800852 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa226d-c74a-4d03-8148-e1ed43e0e53a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:07.801130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa226d-c74a-4d03-8148-e1ed43e0e53a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:07.801401 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa226d-c74a-4d03-8148-e1ed43e0e53a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:07.802135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa226d-c74a-4d03-8148-e1ed43e0e53a None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=ed835047051142d2bc98bb1564e3a98f) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:07.802446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa226d-c74a-4d03-8148-e1ed43e0e53a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:07.803881 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa226d-c74a-4d03-8148-e1ed43e0e53a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:07.809466 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 617/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 05:00:07 2022] GET /identity/v3/role_assignments?user.id=ed835047051142d2bc98bb1564e3a98f&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:00:09.765843 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509f717-5d69-4e39-8c80-9130afb3e73b None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:09.766416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509f717-5d69-4e39-8c80-9130afb3e73b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:09.766416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509f717-5d69-4e39-8c80-9130afb3e73b None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:09.767697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 644/1261] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 05:00:09.772909 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d26edb-cf1b-49e9-8bfe-d2762668d286 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:09.773346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d26edb-cf1b-49e9-8bfe-d2762668d286 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:09.773458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d26edb-cf1b-49e9-8bfe-d2762668d286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:09.791544 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e4d26edb-cf1b-49e9-8bfe-d2762668d286 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:00:09.792756 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e4d26edb-cf1b-49e9-8bfe-d2762668d286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:00:09.862521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 618/1262] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:00:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 05:00:10.151061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509f717-5d69-4e39-8c80-9130afb3e73b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:10.162041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:10.279180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509f717-5d69-4e39-8c80-9130afb3e73b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:10.322758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc84a4-cbe7-4857-a7b9-b6ed4363ae48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:10.323410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc84a4-cbe7-4857-a7b9-b6ed4363ae48 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:10.323688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc84a4-cbe7-4857-a7b9-b6ed4363ae48 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:10.323984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc84a4-cbe7-4857-a7b9-b6ed4363ae48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:10.338193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc84a4-cbe7-4857-a7b9-b6ed4363ae48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-bbbc84a4-cbe7-4857-a7b9-b6ed4363ae48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 05:00:10.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:10.345115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:10.349129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:10.349129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:10.349129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:10.349129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:10.349129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 05:00:10.349129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 05:00:10.349129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 05:00:10.349129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 05:00:10.349129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 05:00:10.349129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 05:00:10.349129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 05:00:10.349129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 05:00:10.349129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 645/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 05:00:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:10.351242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d26edb-cf1b-49e9-8bfe-d2762668d286 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:10.370459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:10.465322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d26edb-cf1b-49e9-8bfe-d2762668d286 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:10.517205 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c6d66-a269-4b18-bac6-cef80e512b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:10.518123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c6d66-a269-4b18-bac6-cef80e512b9a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:10.518551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c6d66-a269-4b18-bac6-cef80e512b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:10.518972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c6d66-a269-4b18-bac6-cef80e512b9a None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:10.520098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c6d66-a269-4b18-bac6-cef80e512b9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:10.520558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c6d66-a269-4b18-bac6-cef80e512b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:10.522728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c6d66-a269-4b18-bac6-cef80e512b9a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:10.536253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 619/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 05:00:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:00:10.542099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc84a4-cbe7-4857-a7b9-b6ed4363ae48 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:10.610401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:10.643888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc84a4-cbe7-4857-a7b9-b6ed4363ae48 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:10.681746 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8dfdc-75b5-424b-862a-f285ae7fa26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:10.682361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8dfdc-75b5-424b-862a-f285ae7fa26e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:10.682631 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8dfdc-75b5-424b-862a-f285ae7fa26e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:10.682894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8dfdc-75b5-424b-862a-f285ae7fa26e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:10.693480 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8dfdc-75b5-424b-862a-f285ae7fa26e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:10.694912 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8dfdc-75b5-424b-862a-f285ae7fa26e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-8bb8dfdc-75b5-424b-862a-f285ae7fa26e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 05:00:10.708976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:10.710075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 05:00:10.711358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 05:00:10.711358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:10.711358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 05:00:10.711358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 646/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 05:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:10.715882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c6d66-a269-4b18-bac6-cef80e512b9a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:10.796403 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:10.814934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c6d66-a269-4b18-bac6-cef80e512b9a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:10.848126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945de13-bc09-4239-9d7c-a2c12c5632d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:10.848714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945de13-bc09-4239-9d7c-a2c12c5632d4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:10.848984 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945de13-bc09-4239-9d7c-a2c12c5632d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:10.849252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945de13-bc09-4239-9d7c-a2c12c5632d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:10.849885 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945de13-bc09-4239-9d7c-a2c12c5632d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:10.850180 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945de13-bc09-4239-9d7c-a2c12c5632d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:10.851540 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945de13-bc09-4239-9d7c-a2c12c5632d4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:10.862943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 620/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 05:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:10.868797 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8dfdc-75b5-424b-862a-f285ae7fa26e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:10.971752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8dfdc-75b5-424b-862a-f285ae7fa26e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:10.995400 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:11.010936 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a0f40-f28f-4112-9f1a-219ea7a0afa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:11.011562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a0f40-f28f-4112-9f1a-219ea7a0afa4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:11.011838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a0f40-f28f-4112-9f1a-219ea7a0afa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:11.012150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a0f40-f28f-4112-9f1a-219ea7a0afa4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:11.020712 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a0f40-f28f-4112-9f1a-219ea7a0afa4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:11.022151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a0f40-f28f-4112-9f1a-219ea7a0afa4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-d07a0f40-f28f-4112-9f1a-219ea7a0afa4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 05:00:11.034834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:11.036435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:11.037509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:11.037509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:11.037509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 05:00:11.037509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 05:00:11.037509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 05:00:11.037509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 05:00:11.037509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 05:00:11.037509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 05:00:11.037509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 05:00:11.037509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 05:00:11.037509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 647/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 05:00:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:11.042267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945de13-bc09-4239-9d7c-a2c12c5632d4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:11.145567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945de13-bc09-4239-9d7c-a2c12c5632d4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:11.181473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1372957-c423-48f2-98c5-b7058eb744ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:11.182286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1372957-c423-48f2-98c5-b7058eb744ea None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:11.182428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1372957-c423-48f2-98c5-b7058eb744ea None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:11.182615 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1372957-c423-48f2-98c5-b7058eb744ea None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:11.183363 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1372957-c423-48f2-98c5-b7058eb744ea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:11.183653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1372957-c423-48f2-98c5-b7058eb744ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:11.185631 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1372957-c423-48f2-98c5-b7058eb744ea None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:11.195621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:11.209563 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 621/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Aug 30 05:00:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:11.216068 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a0f40-f28f-4112-9f1a-219ea7a0afa4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:11.320868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a0f40-f28f-4112-9f1a-219ea7a0afa4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:11.354019 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e349624-57de-43de-8b91-abab85f2e30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:11.354644 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e349624-57de-43de-8b91-abab85f2e30d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:11.354921 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e349624-57de-43de-8b91-abab85f2e30d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:11.355191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e349624-57de-43de-8b91-abab85f2e30d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:11.366298 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e349624-57de-43de-8b91-abab85f2e30d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:11.367742 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e349624-57de-43de-8b91-abab85f2e30d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-5e349624-57de-43de-8b91-abab85f2e30d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 05:00:11.382895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:11.384294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 05:00:11.385594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 05:00:11.385594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:11.385594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 05:00:11.385594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 648/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 05:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:11.392527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1372957-c423-48f2-98c5-b7058eb744ea None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:11.507099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1372957-c423-48f2-98c5-b7058eb744ea None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:11.541465 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e95c98-b92e-4fce-b388-aa666af72b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:11.542064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e95c98-b92e-4fce-b388-aa666af72b36 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:11.542336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e95c98-b92e-4fce-b388-aa666af72b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:11.542600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e95c98-b92e-4fce-b388-aa666af72b36 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:11.543243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e95c98-b92e-4fce-b388-aa666af72b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:11.543532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e95c98-b92e-4fce-b388-aa666af72b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:11.545430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e95c98-b92e-4fce-b388-aa666af72b36 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:11.556727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 622/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 05:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:11.563190 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e349624-57de-43de-8b91-abab85f2e30d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:11.594987 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:11.662982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e349624-57de-43de-8b91-abab85f2e30d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:11.696068 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab73e1b-570f-4ede-a560-4f6289e98a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:11.696693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab73e1b-570f-4ede-a560-4f6289e98a23 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:11.696959 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab73e1b-570f-4ede-a560-4f6289e98a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:11.697223 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab73e1b-570f-4ede-a560-4f6289e98a23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:11.703620 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab73e1b-570f-4ede-a560-4f6289e98a23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:11.705066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab73e1b-570f-4ede-a560-4f6289e98a23 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:11.716143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7ab73e1b-570f-4ede-a560-4f6289e98a23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 05:00:11.716143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:11.716143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:11.716143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:11.716143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:11.716143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:11.716143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:11.716143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:11.716143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:11.716143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:11.716143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:11.716143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:11.716143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 05:00:11.716143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 05:00:11.716143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:11.717213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:11.718479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 05:00:11.718479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 05:00:11.718479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 05:00:11.718479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 05:00:11.718479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 05:00:11.718479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 05:00:11.718479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 05:00:11.718479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 05:00:11.718479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 649/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 05:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:11.723191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e95c98-b92e-4fce-b388-aa666af72b36 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:11.780904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:11.823292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e95c98-b92e-4fce-b388-aa666af72b36 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:11.859464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2025c58-8a76-4f87-a60e-4fca27c73bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:11.860085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2025c58-8a76-4f87-a60e-4fca27c73bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:11.860363 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2025c58-8a76-4f87-a60e-4fca27c73bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:11.860636 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2025c58-8a76-4f87-a60e-4fca27c73bd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:11.861321 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2025c58-8a76-4f87-a60e-4fca27c73bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:11.861619 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2025c58-8a76-4f87-a60e-4fca27c73bd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:11.863029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2025c58-8a76-4f87-a60e-4fca27c73bd5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:11.874946 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 623/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 05:00:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:11.881063 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab73e1b-570f-4ede-a560-4f6289e98a23 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:11.970727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:11.979372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab73e1b-570f-4ede-a560-4f6289e98a23 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:12.012163 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078c52e-7a78-440f-a294-5e0ea5badb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:12.012809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078c52e-7a78-440f-a294-5e0ea5badb62 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:12.013080 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078c52e-7a78-440f-a294-5e0ea5badb62 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:12.013344 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078c52e-7a78-440f-a294-5e0ea5badb62 None admin] PATH_INFO: `/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/ed835047051142d2bc98bb1564e3a98f/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:12.015162 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078c52e-7a78-440f-a294-5e0ea5badb62 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8aae17def04cf48190ede4bffefe70, user_id=ed835047051142d2bc98bb1564e3a98f, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:12.016599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078c52e-7a78-440f-a294-5e0ea5badb62 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:12.028744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 650/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Aug 30 05:00:11 2022] PUT /identity/v3/projects/5e8aae17def04cf48190ede4bffefe70/users/ed835047051142d2bc98bb1564e3a98f/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:00:13.924266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad642bc-f5e7-439f-a71c-d583d38eac92 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:13.924826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad642bc-f5e7-439f-a71c-d583d38eac92 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:13.924826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad642bc-f5e7-439f-a71c-d583d38eac92 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:13.926144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 624/1274] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:00:13.931170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dfbe4-1f46-42da-adea-7651f4acdae8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:13.931600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dfbe4-1f46-42da-adea-7651f4acdae8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:13.931700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dfbe4-1f46-42da-adea-7651f4acdae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:13.949749 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fc2dfbe4-1f46-42da-adea-7651f4acdae8 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:00:13.951429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fc2dfbe4-1f46-42da-adea-7651f4acdae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:00:14.016546 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 651/1275] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:00:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 05:00:14.284965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad642bc-f5e7-439f-a71c-d583d38eac92 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:14.383220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad642bc-f5e7-439f-a71c-d583d38eac92 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:14.399750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:14.416552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129239c-1ee8-4202-9be8-555a1c06d800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:14.417165 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129239c-1ee8-4202-9be8-555a1c06d800 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:14.417442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129239c-1ee8-4202-9be8-555a1c06d800 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:14.417710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129239c-1ee8-4202-9be8-555a1c06d800 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:14.428286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129239c-1ee8-4202-9be8-555a1c06d800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e129239c-1ee8-4202-9be8-555a1c06d800 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 05:00:14.433025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:14.434161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:14.435077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:14.435077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:14.435077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:14.435077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:14.435077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 05:00:14.435077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 05:00:14.435077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 05:00:14.435077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 05:00:14.435077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 05:00:14.435077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 05:00:14.435077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 05:00:14.435077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:14.435077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 625/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Aug 30 05:00:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:14.440280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dfbe4-1f46-42da-adea-7651f4acdae8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:14.518277 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:14.537071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dfbe4-1f46-42da-adea-7651f4acdae8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:14.569154 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbddef-0db7-4cbe-b42a-024423bdddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:14.569748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbddef-0db7-4cbe-b42a-024423bdddc6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:14.570027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbddef-0db7-4cbe-b42a-024423bdddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:14.570303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbddef-0db7-4cbe-b42a-024423bdddc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:14.570964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbddef-0db7-4cbe-b42a-024423bdddc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:14.571265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbddef-0db7-4cbe-b42a-024423bdddc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:14.572640 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbddef-0db7-4cbe-b42a-024423bdddc6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:14.580950 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 652/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Aug 30 05:00:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:14.586542 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129239c-1ee8-4202-9be8-555a1c06d800 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:14.684273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129239c-1ee8-4202-9be8-555a1c06d800 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:14.716914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb77b4-0333-4366-ac14-483172e50fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:14.717520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb77b4-0333-4366-ac14-483172e50fbd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:14.717793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb77b4-0333-4366-ac14-483172e50fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:14.718059 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb77b4-0333-4366-ac14-483172e50fbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:14.727796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb77b4-0333-4366-ac14-483172e50fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:14.729277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb77b4-0333-4366-ac14-483172e50fbd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-31eb77b4-0333-4366-ac14-483172e50fbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 05:00:14.743867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:14.749689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 05:00:14.750863 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 05:00:14.750863 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:14.750863 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:14.750863 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 626/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 05:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:14.751178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbddef-0db7-4cbe-b42a-024423bdddc6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:14.849105 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbddef-0db7-4cbe-b42a-024423bdddc6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:14.881962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74def35-b927-4eca-b98d-9ae361b97944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:14.882552 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74def35-b927-4eca-b98d-9ae361b97944 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:14.882829 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74def35-b927-4eca-b98d-9ae361b97944 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:14.883099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74def35-b927-4eca-b98d-9ae361b97944 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:14.883723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74def35-b927-4eca-b98d-9ae361b97944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:14.884049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74def35-b927-4eca-b98d-9ae361b97944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:14.885394 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74def35-b927-4eca-b98d-9ae361b97944 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:14.897290 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 653/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 05:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:14.902900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb77b4-0333-4366-ac14-483172e50fbd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:14.932659 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:15.001337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb77b4-0333-4366-ac14-483172e50fbd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:15.037798 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28030cd-b6f2-4115-97af-9f8198f3efde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:15.038424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28030cd-b6f2-4115-97af-9f8198f3efde None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:15.038696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28030cd-b6f2-4115-97af-9f8198f3efde None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:15.038960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28030cd-b6f2-4115-97af-9f8198f3efde None admin] PATH_INFO: `/v3/users/placement` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:15.046588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28030cd-b6f2-4115-97af-9f8198f3efde None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:15.048033 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28030cd-b6f2-4115-97af-9f8198f3efde None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b28030cd-b6f2-4115-97af-9f8198f3efde None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 05:00:15.058669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:15.059770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:15.061520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:15.061520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:15.061520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 05:00:15.061520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 05:00:15.061520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 05:00:15.061520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 05:00:15.061520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 05:00:15.061520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 05:00:15.061520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 05:00:15.061520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:15.061520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 627/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 05:00:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:15.066012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74def35-b927-4eca-b98d-9ae361b97944 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:15.069773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:15.162358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74def35-b927-4eca-b98d-9ae361b97944 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:15.197724 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b75b5-1b25-46e3-9883-088a23398171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:15.198355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b75b5-1b25-46e3-9883-088a23398171 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:15.198698 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b75b5-1b25-46e3-9883-088a23398171 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:15.198974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b75b5-1b25-46e3-9883-088a23398171 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:15.199981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b75b5-1b25-46e3-9883-088a23398171 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:15.200385 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b75b5-1b25-46e3-9883-088a23398171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:15.202921 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b75b5-1b25-46e3-9883-088a23398171 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:15.221239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 654/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Aug 30 05:00:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:15.227094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28030cd-b6f2-4115-97af-9f8198f3efde None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:15.316062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:15.326094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28030cd-b6f2-4115-97af-9f8198f3efde None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:15.357970 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385fd54-5969-498a-81c6-446b162fda7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:15.358553 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385fd54-5969-498a-81c6-446b162fda7a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:15.358823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385fd54-5969-498a-81c6-446b162fda7a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:15.359086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385fd54-5969-498a-81c6-446b162fda7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:15.422956 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385fd54-5969-498a-81c6-446b162fda7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:15.424332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385fd54-5969-498a-81c6-446b162fda7a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:15.510404 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:15.521047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 628/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Aug 30 05:00:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 05:00:15.526887 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b75b5-1b25-46e3-9883-088a23398171 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:15.588192 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:15.626339 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b75b5-1b25-46e3-9883-088a23398171 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:15.659423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040c1d7-b4cc-4782-8759-d684c2b10143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:15.660079 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040c1d7-b4cc-4782-8759-d684c2b10143 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:15.660432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040c1d7-b4cc-4782-8759-d684c2b10143 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:15.660706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040c1d7-b4cc-4782-8759-d684c2b10143 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:15.670542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040c1d7-b4cc-4782-8759-d684c2b10143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:15.672006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040c1d7-b4cc-4782-8759-d684c2b10143 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b040c1d7-b4cc-4782-8759-d684c2b10143 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 05:00:15.686879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:15.687903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 05:00:15.689285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 05:00:15.689285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 05:00:15.689285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 05:00:15.689285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 655/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 05:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:15.693640 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385fd54-5969-498a-81c6-446b162fda7a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:15.789400 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385fd54-5969-498a-81c6-446b162fda7a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:15.822135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb02eb-a0d3-4c1d-83a6-5bd59684b90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:15.822726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb02eb-a0d3-4c1d-83a6-5bd59684b90d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:15.823001 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb02eb-a0d3-4c1d-83a6-5bd59684b90d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:15.823267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb02eb-a0d3-4c1d-83a6-5bd59684b90d None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:15.823897 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb02eb-a0d3-4c1d-83a6-5bd59684b90d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:15.824222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb02eb-a0d3-4c1d-83a6-5bd59684b90d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:15.826123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb02eb-a0d3-4c1d-83a6-5bd59684b90d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:15.837039 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 629/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Aug 30 05:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:15.842663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040c1d7-b4cc-4782-8759-d684c2b10143 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:15.940582 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040c1d7-b4cc-4782-8759-d684c2b10143 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:15.954352 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:15.976463 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e319d8-569a-4cc8-a8bf-b20692ed8216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:15.977081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e319d8-569a-4cc8-a8bf-b20692ed8216 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:15.977357 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e319d8-569a-4cc8-a8bf-b20692ed8216 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:15.977626 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e319d8-569a-4cc8-a8bf-b20692ed8216 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:15.984773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e319d8-569a-4cc8-a8bf-b20692ed8216 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:15.986213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e319d8-569a-4cc8-a8bf-b20692ed8216 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:16.000603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-10e319d8-569a-4cc8-a8bf-b20692ed8216 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 05:00:16.000603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:16.000603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:16.000603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:16.000603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:16.000603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:16.000603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:16.000603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:16.000603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:16.000603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:16.000603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:16.000603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:16.000603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 05:00:16.000603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 05:00:16.000603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:16.001700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:16.002643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 05:00:16.002643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 05:00:16.002643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 05:00:16.002643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 05:00:16.002643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 05:00:16.002643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 05:00:16.002643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 05:00:16.002643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 30 05:00:16.002643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 656/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Aug 30 05:00:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:16.007558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb02eb-a0d3-4c1d-83a6-5bd59684b90d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:16.057249 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:16.106621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb02eb-a0d3-4c1d-83a6-5bd59684b90d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:16.139667 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e754c1e-2470-473a-859e-beddadb1062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:16.140293 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e754c1e-2470-473a-859e-beddadb1062d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:16.140566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e754c1e-2470-473a-859e-beddadb1062d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:16.140830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e754c1e-2470-473a-859e-beddadb1062d None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:16.141510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e754c1e-2470-473a-859e-beddadb1062d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:16.141808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e754c1e-2470-473a-859e-beddadb1062d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:16.143243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e754c1e-2470-473a-859e-beddadb1062d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:16.154791 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 630/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Aug 30 05:00:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:16.160835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e319d8-569a-4cc8-a8bf-b20692ed8216 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:16.261007 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e319d8-569a-4cc8-a8bf-b20692ed8216 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:16.292681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d8005-0bb9-49fb-82b6-b7a38f5c54e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:16.293265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d8005-0bb9-49fb-82b6-b7a38f5c54e5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:16.293543 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d8005-0bb9-49fb-82b6-b7a38f5c54e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:16.293809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d8005-0bb9-49fb-82b6-b7a38f5c54e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:16.295066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d8005-0bb9-49fb-82b6-b7a38f5c54e5 None admin] RBAC: Adding query filter params (role.id=5af25ecc20f6407189d4fe9923dcef98, scope.project.id=5e8aae17def04cf48190ede4bffefe70, user.id=ed835047051142d2bc98bb1564e3a98f) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:16.295366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d8005-0bb9-49fb-82b6-b7a38f5c54e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:16.296793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d8005-0bb9-49fb-82b6-b7a38f5c54e5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:16.302268 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 657/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Aug 30 05:00:16 2022] GET /identity/v3/role_assignments?user.id=ed835047051142d2bc98bb1564e3a98f&scope.project.id=5e8aae17def04cf48190ede4bffefe70&role.id=5af25ecc20f6407189d4fe9923dcef98 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:18.206805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bfffe-5834-45bc-af82-931550dfc268 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:18.207349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bfffe-5834-45bc-af82-931550dfc268 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:18.207349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bfffe-5834-45bc-af82-931550dfc268 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:18.208712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 631/1288] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:00:18.213638 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8df8cd-f5af-47a2-a31e-27d5b34bba82 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:18.214050 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8df8cd-f5af-47a2-a31e-27d5b34bba82 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:18.214183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8df8cd-f5af-47a2-a31e-27d5b34bba82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:18.232436 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0d8df8cd-f5af-47a2-a31e-27d5b34bba82 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:00:18.233597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0d8df8cd-f5af-47a2-a31e-27d5b34bba82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:00:18.262241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:18.299177 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 658/1289] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:00:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 05:00:18.568803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bfffe-5834-45bc-af82-931550dfc268 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:18.666177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bfffe-5834-45bc-af82-931550dfc268 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:18.676894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:18.699147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa9059-c330-4212-8d8b-f47add5e7632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:18.699753 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa9059-c330-4212-8d8b-f47add5e7632 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:18.700049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa9059-c330-4212-8d8b-f47add5e7632 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:18.700342 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa9059-c330-4212-8d8b-f47add5e7632 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:18.700935 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa9059-c330-4212-8d8b-f47add5e7632 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:18.702279 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa9059-c330-4212-8d8b-f47add5e7632 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-aaaa9059-c330-4212-8d8b-f47add5e7632 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:18.710670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:18.711892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:18.712821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:18.712821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:18.712821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:18.712821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:18.712821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:18.712821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:18.712821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:18.712821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:18.712821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:18.712821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:18.712821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 05:00:18.712821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 05:00:18.712821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 05:00:18.712821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:18.712821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 632/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Aug 30 05:00:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:18.718200 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8df8cd-f5af-47a2-a31e-27d5b34bba82 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:18.815332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8df8cd-f5af-47a2-a31e-27d5b34bba82 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:18.848534 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e93adb-179b-4323-8122-9d965b545cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:18.849134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e93adb-179b-4323-8122-9d965b545cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:18.849414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e93adb-179b-4323-8122-9d965b545cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:18.849687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e93adb-179b-4323-8122-9d965b545cc5 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:18.850311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e93adb-179b-4323-8122-9d965b545cc5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:18.850611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e93adb-179b-4323-8122-9d965b545cc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:18.851990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e93adb-179b-4323-8122-9d965b545cc5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:18.856728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 659/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Aug 30 05:00:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:18.862390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa9059-c330-4212-8d8b-f47add5e7632 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:18.960536 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa9059-c330-4212-8d8b-f47add5e7632 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:18.993179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e9346-019d-4aaa-b1b5-77dab6c3f355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:18.993776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e9346-019d-4aaa-b1b5-77dab6c3f355 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:18.994050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e9346-019d-4aaa-b1b5-77dab6c3f355 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:18.994317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e9346-019d-4aaa-b1b5-77dab6c3f355 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:18.994937 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e9346-019d-4aaa-b1b5-77dab6c3f355 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:18.995233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e9346-019d-4aaa-b1b5-77dab6c3f355 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:18.996629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e9346-019d-4aaa-b1b5-77dab6c3f355 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:19.001747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 633/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Aug 30 05:00:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:20.880648 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc4742-7bdd-4737-a4f8-a6c117cfdac3 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:20.881180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc4742-7bdd-4737-a4f8-a6c117cfdac3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:20.881180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc4742-7bdd-4737-a4f8-a6c117cfdac3 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:20.882516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 660/1293] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:00:20.887863 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4dac5-9dd4-4b12-871a-a019efc74ef0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:20.888329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4dac5-9dd4-4b12-871a-a019efc74ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:20.888438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4dac5-9dd4-4b12-871a-a019efc74ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:20.909214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-26a4dac5-9dd4-4b12-871a-a019efc74ef0 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:00:20.910428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-26a4dac5-9dd4-4b12-871a-a019efc74ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:00:20.940722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:20.977090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 634/1294] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:00:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 05:00:21.257784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc4742-7bdd-4737-a4f8-a6c117cfdac3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:21.289242 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:21.359965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc4742-7bdd-4737-a4f8-a6c117cfdac3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:21.394688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1298b8-f127-4a42-83de-584f2fe11e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:21.395285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1298b8-f127-4a42-83de-584f2fe11e50 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:21.395557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1298b8-f127-4a42-83de-584f2fe11e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:21.395824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1298b8-f127-4a42-83de-584f2fe11e50 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:21.396495 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1298b8-f127-4a42-83de-584f2fe11e50 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:21.398083 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1298b8-f127-4a42-83de-584f2fe11e50 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:21.412820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 661/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Aug 30 05:00:21 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:00:23.307789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5388d33-49a0-4c3e-9d1a-1f3457712d12 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:23.308332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5388d33-49a0-4c3e-9d1a-1f3457712d12 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:23.308332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5388d33-49a0-4c3e-9d1a-1f3457712d12 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:23.310167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 635/1296] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:00:23.315419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d77a3a-63ff-422e-af85-9197298d4ab2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:23.315809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d77a3a-63ff-422e-af85-9197298d4ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:23.316004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d77a3a-63ff-422e-af85-9197298d4ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:23.334322 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e8d77a3a-63ff-422e-af85-9197298d4ab2 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:00:23.335623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e8d77a3a-63ff-422e-af85-9197298d4ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:00:23.409903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 662/1297] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:00:23 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 05:00:23.687631 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5388d33-49a0-4c3e-9d1a-1f3457712d12 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:23.789523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5388d33-49a0-4c3e-9d1a-1f3457712d12 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:23.824612 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffc5c5-1bf9-42b1-af79-d023d08d7f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:23.825251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffc5c5-1bf9-42b1-af79-d023d08d7f5a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:23.825524 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffc5c5-1bf9-42b1-af79-d023d08d7f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:23.825788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffc5c5-1bf9-42b1-af79-d023d08d7f5a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:23.826363 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffc5c5-1bf9-42b1-af79-d023d08d7f5a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:23.827721 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffc5c5-1bf9-42b1-af79-d023d08d7f5a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-40ffc5c5-1bf9-42b1-af79-d023d08d7f5a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:23.836442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:23.837639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:23.838488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:23.838488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:23.838488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:23.838488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:23.838488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:23.838488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:23.838488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:23.838488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:23.838488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:23.838488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:23.838488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 05:00:23.838488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 05:00:23.838488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 05:00:23.838488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:23.838488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 636/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Aug 30 05:00:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:23.844557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d77a3a-63ff-422e-af85-9197298d4ab2 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:23.863805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:23.945206 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d77a3a-63ff-422e-af85-9197298d4ab2 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:23.979055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353e73a-b03b-42d6-870b-2c40c2c5fd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:23.979651 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353e73a-b03b-42d6-870b-2c40c2c5fd2c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:23.980002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353e73a-b03b-42d6-870b-2c40c2c5fd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:23.980212 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353e73a-b03b-42d6-870b-2c40c2c5fd2c None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:23.980843 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353e73a-b03b-42d6-870b-2c40c2c5fd2c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:23.981133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353e73a-b03b-42d6-870b-2c40c2c5fd2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:23.983156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353e73a-b03b-42d6-870b-2c40c2c5fd2c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:23.988504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 663/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Aug 30 05:00:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:23.994783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffc5c5-1bf9-42b1-af79-d023d08d7f5a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:24.028877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:24.100181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffc5c5-1bf9-42b1-af79-d023d08d7f5a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:24.133806 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e74357-f90b-4710-9719-757a699164c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:24.134398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e74357-f90b-4710-9719-757a699164c5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:24.134668 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e74357-f90b-4710-9719-757a699164c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:24.134933 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e74357-f90b-4710-9719-757a699164c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:24.135628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e74357-f90b-4710-9719-757a699164c5 None admin] RBAC: Adding query filter params (interface=public, service_id=d62c1e02b102460dbb0c7b95ca114416, region_id=RegionOne) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:24.135925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e74357-f90b-4710-9719-757a699164c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:24.137330 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e74357-f90b-4710-9719-757a699164c5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:24.142380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 637/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Aug 30 05:00:23 2022] GET /identity/v3/endpoints?service_id=d62c1e02b102460dbb0c7b95ca114416&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:00:24.148229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353e73a-b03b-42d6-870b-2c40c2c5fd2c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:24.234204 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:24.254511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353e73a-b03b-42d6-870b-2c40c2c5fd2c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:24.289490 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bedea-2c95-4914-8599-49c08311219f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:24.290091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bedea-2c95-4914-8599-49c08311219f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:24.290367 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bedea-2c95-4914-8599-49c08311219f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:24.290633 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bedea-2c95-4914-8599-49c08311219f None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:24.291228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bedea-2c95-4914-8599-49c08311219f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:24.292608 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bedea-2c95-4914-8599-49c08311219f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:24.299202 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 664/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Aug 30 05:00:24 2022] GET /identity/v3/services => generated 2191 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:00:26.210079 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196af0ca-f486-4620-b471-c92034937e1d None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:26.210600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196af0ca-f486-4620-b471-c92034937e1d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:26.210600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196af0ca-f486-4620-b471-c92034937e1d None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:26.212004 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 638/1302] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:00:26.217774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6d326-e29e-480e-80a4-c3a3d33b666d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:26.218235 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6d326-e29e-480e-80a4-c3a3d33b666d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:26.218329 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6d326-e29e-480e-80a4-c3a3d33b666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:26.237450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f6e6d326-e29e-480e-80a4-c3a3d33b666d None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:00:26.238580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f6e6d326-e29e-480e-80a4-c3a3d33b666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:00:26.316850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 665/1303] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:00:26 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 05:00:26.591390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196af0ca-f486-4620-b471-c92034937e1d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:26.691152 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:26.698188 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196af0ca-f486-4620-b471-c92034937e1d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:26.733287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62729575-b8b9-444a-9711-a64c43e100d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:26.734226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62729575-b8b9-444a-9711-a64c43e100d7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:26.734675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62729575-b8b9-444a-9711-a64c43e100d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:26.734957 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62729575-b8b9-444a-9711-a64c43e100d7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:26.735570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62729575-b8b9-444a-9711-a64c43e100d7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:26.737979 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62729575-b8b9-444a-9711-a64c43e100d7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-62729575-b8b9-444a-9711-a64c43e100d7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:00:26.753556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 05:00:26.754790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 05:00:26.755648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 05:00:26.755648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 30 05:00:26.755648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 05:00:26.755648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 30 05:00:26.755648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 05:00:26.755648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 05:00:26.755648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 05:00:26.755648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 30 05:00:26.755648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 05:00:26.755648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 30 05:00:26.755648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 05:00:26.755648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 05:00:26.755648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 05:00:26.755648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 30 05:00:26.755648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 639/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Aug 30 05:00:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 05:00:26.760964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6d326-e29e-480e-80a4-c3a3d33b666d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:26.839776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:26.864551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6d326-e29e-480e-80a4-c3a3d33b666d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:26.899322 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c1a6d-fa28-44df-ad53-327509283936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:26.899923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c1a6d-fa28-44df-ad53-327509283936 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:26.900233 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c1a6d-fa28-44df-ad53-327509283936 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:26.900514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c1a6d-fa28-44df-ad53-327509283936 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:26.901143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c1a6d-fa28-44df-ad53-327509283936 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:00:26.901444 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c1a6d-fa28-44df-ad53-327509283936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:26.902807 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c1a6d-fa28-44df-ad53-327509283936 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:26.908570 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 666/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Aug 30 05:00:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:00:26.914628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62729575-b8b9-444a-9711-a64c43e100d7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:27.013672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62729575-b8b9-444a-9711-a64c43e100d7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:27.048060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1a0f1-6e5d-4942-a92c-aa804a94ccf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:27.048658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1a0f1-6e5d-4942-a92c-aa804a94ccf9 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:27.048938 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1a0f1-6e5d-4942-a92c-aa804a94ccf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:27.049207 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1a0f1-6e5d-4942-a92c-aa804a94ccf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:27.049869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1a0f1-6e5d-4942-a92c-aa804a94ccf9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:27.051325 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1a0f1-6e5d-4942-a92c-aa804a94ccf9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:27.070761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 640/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:00:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:00:36.905521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=30 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:37.066629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:32.330166 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006737fb-8ad8-4d6a-b0e3-a634b8ebca7d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:32.331053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006737fb-8ad8-4d6a-b0e3-a634b8ebca7d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:32.331500 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006737fb-8ad8-4d6a-b0e3-a634b8ebca7d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:32.338686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b342934-2270-4b19-b294-ab3c3c7bbb4f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:32.339498 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b342934-2270-4b19-b294-ab3c3c7bbb4f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:32.339928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b342934-2270-4b19-b294-ab3c3c7bbb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:32.343198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 667/1307] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:01:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:01:32.432723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5b342934-2270-4b19-b294-ab3c3c7bbb4f None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:32.433940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5b342934-2270-4b19-b294-ab3c3c7bbb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:32.540117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 641/1308] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:01:32.858153 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5587abb-4846-4a8d-b1da-94a146a5d13b None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:32.858442 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5587abb-4846-4a8d-b1da-94a146a5d13b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:32.858719 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5587abb-4846-4a8d-b1da-94a146a5d13b None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:32.860084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 668/1309] 10.222.0.48 () {54 vars in 965 bytes} [Tue Aug 30 05:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:01:32.866980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f7e50-b197-4535-9820-6ad62481b23c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:32.867442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f7e50-b197-4535-9820-6ad62481b23c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:32.867821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f7e50-b197-4535-9820-6ad62481b23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:32.947498 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-379f7e50-b197-4535-9820-6ad62481b23c None None] MFA Rules not processed for user `4398d5175c8c409789d62c277da35ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:32.948910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-379f7e50-b197-4535-9820-6ad62481b23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:32.972237 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:33.035976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 642/1310] 10.222.0.48 () {58 vars in 1062 bytes} [Tue Aug 30 05:01:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:01:33.048963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5587abb-4846-4a8d-b1da-94a146a5d13b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:33.050821 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a5587abb-4846-4a8d-b1da-94a146a5d13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:33.174781 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5587abb-4846-4a8d-b1da-94a146a5d13b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:33.253867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029f29c-fd0d-4589-8321-a7ec5f5b48f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:33.254538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029f29c-fd0d-4589-8321-a7ec5f5b48f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:33.254824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029f29c-fd0d-4589-8321-a7ec5f5b48f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:33.255093 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029f29c-fd0d-4589-8321-a7ec5f5b48f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:33.256731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9029f29c-fd0d-4589-8321-a7ec5f5b48f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:33.314094 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:33.375268 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029f29c-fd0d-4589-8321-a7ec5f5b48f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:33.377499 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029f29c-fd0d-4589-8321-a7ec5f5b48f7 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:33.401019 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 669/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:01:35.616381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02950a1-5aa1-4370-ba05-f62f04f631c1 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:35.617783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02950a1-5aa1-4370-ba05-f62f04f631c1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:35.618231 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02950a1-5aa1-4370-ba05-f62f04f631c1 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:35.619856 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 643/1312] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:01:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:01:35.625513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1f1f6-57bc-4646-8cc4-6667db9fddf6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:35.626062 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1f1f6-57bc-4646-8cc4-6667db9fddf6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:35.626165 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1f1f6-57bc-4646-8cc4-6667db9fddf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:35.718174 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-89b1f1f6-57bc-4646-8cc4-6667db9fddf6 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:35.719477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-89b1f1f6-57bc-4646-8cc4-6667db9fddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:35.836227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 670/1313] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:01:36.113978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02950a1-5aa1-4370-ba05-f62f04f631c1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:36.115617 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e02950a1-5aa1-4370-ba05-f62f04f631c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:36.230586 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02950a1-5aa1-4370-ba05-f62f04f631c1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:36.302931 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:36.305967 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09147e02-2eb1-459e-b82d-80e88aa88bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:36.306584 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09147e02-2eb1-459e-b82d-80e88aa88bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:36.307045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09147e02-2eb1-459e-b82d-80e88aa88bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:36.307352 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09147e02-2eb1-459e-b82d-80e88aa88bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:36.309410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-09147e02-2eb1-459e-b82d-80e88aa88bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:36.419359 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09147e02-2eb1-459e-b82d-80e88aa88bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:36.420830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09147e02-2eb1-459e-b82d-80e88aa88bc2 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:36.439805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 644/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:01:38.709100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5366f-9f7c-457d-8da1-639dca7a31cb None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:38.709639 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5366f-9f7c-457d-8da1-639dca7a31cb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:38.709639 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5366f-9f7c-457d-8da1-639dca7a31cb None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:38.711017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 671/1315] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:01:38.717630 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072fe60-748d-46ef-8557-a8434597e05c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:38.718060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072fe60-748d-46ef-8557-a8434597e05c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:38.718174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072fe60-748d-46ef-8557-a8434597e05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:38.782628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2072fe60-748d-46ef-8557-a8434597e05c None None] MFA Rules not processed for user `3cf964840139481f9a2810f3576d0b10`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:38.783826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2072fe60-748d-46ef-8557-a8434597e05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:38.835365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:38.882556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 645/1316] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:01:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:01:39.171440 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5366f-9f7c-457d-8da1-639dca7a31cb None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:39.173027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7ec5366f-9f7c-457d-8da1-639dca7a31cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:39.182851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:39.276970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5366f-9f7c-457d-8da1-639dca7a31cb None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:39.349182 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8024529-0589-4e62-8642-6676304d4bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:39.349790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8024529-0589-4e62-8642-6676304d4bba service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:39.350068 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8024529-0589-4e62-8642-6676304d4bba service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:39.350337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8024529-0589-4e62-8642-6676304d4bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:39.352036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f8024529-0589-4e62-8642-6676304d4bba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:39.414081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:39.461919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8024529-0589-4e62-8642-6676304d4bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:39.463350 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8024529-0589-4e62-8642-6676304d4bba service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:39.480978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 672/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:01:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:01:41.940203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bcb9c-bb20-4264-a031-528486aaed59 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:41.940765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bcb9c-bb20-4264-a031-528486aaed59 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:41.940765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bcb9c-bb20-4264-a031-528486aaed59 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:41.942081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 646/1318] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:01:41.947337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0002f5d-c496-45c0-be2b-c760a6992c53 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:41.947762 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0002f5d-c496-45c0-be2b-c760a6992c53 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:41.947889 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0002f5d-c496-45c0-be2b-c760a6992c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:42.013184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a0002f5d-c496-45c0-be2b-c760a6992c53 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:42.014480 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a0002f5d-c496-45c0-be2b-c760a6992c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:42.111390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 673/1319] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:01:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:01:42.397649 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bcb9c-bb20-4264-a031-528486aaed59 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:42.399241 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-410bcb9c-bb20-4264-a031-528486aaed59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:42.504018 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bcb9c-bb20-4264-a031-528486aaed59 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:42.582263 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dc241-12e4-4a45-9bdf-c2c8acde6b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:42.582865 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dc241-12e4-4a45-9bdf-c2c8acde6b35 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:42.583140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dc241-12e4-4a45-9bdf-c2c8acde6b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:42.583407 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dc241-12e4-4a45-9bdf-c2c8acde6b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:42.585061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c46dc241-12e4-4a45-9bdf-c2c8acde6b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:42.593243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:42.703893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46dc241-12e4-4a45-9bdf-c2c8acde6b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:42.705448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46dc241-12e4-4a45-9bdf-c2c8acde6b35 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:42.724141 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 647/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:01:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:01:45.330280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f0eaf-435c-4ee5-9c1d-713270fb7b66 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:45.330831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f0eaf-435c-4ee5-9c1d-713270fb7b66 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:45.330831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f0eaf-435c-4ee5-9c1d-713270fb7b66 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:45.332230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 674/1321] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:01:45.337563 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bdfd9-5224-4da3-ab25-6d59c3011617 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:45.338008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bdfd9-5224-4da3-ab25-6d59c3011617 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:45.338184 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bdfd9-5224-4da3-ab25-6d59c3011617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:45.404155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f70bdfd9-5224-4da3-ab25-6d59c3011617 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:45.405390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f70bdfd9-5224-4da3-ab25-6d59c3011617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:45.465231 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:45.506081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 648/1322] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:01:45.807094 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99109e-b407-42f4-914d-f12c5e26cb58 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:45.807373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99109e-b407-42f4-914d-f12c5e26cb58 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:45.807639 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99109e-b407-42f4-914d-f12c5e26cb58 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:45.809007 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 675/1323] 10.222.0.48 () {54 vars in 965 bytes} [Tue Aug 30 05:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:01:45.814963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ace65f-0d37-49f0-8182-f8715e25b849 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:45.815322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ace65f-0d37-49f0-8182-f8715e25b849 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:45.815683 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ace65f-0d37-49f0-8182-f8715e25b849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:45.892620 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-29ace65f-0d37-49f0-8182-f8715e25b849 None None] MFA Rules not processed for user `4398d5175c8c409789d62c277da35ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:45.893838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-29ace65f-0d37-49f0-8182-f8715e25b849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:45.970923 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 649/1324] 10.222.0.48 () {58 vars in 1062 bytes} [Tue Aug 30 05:01:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:01:45.979766 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99109e-b407-42f4-914d-f12c5e26cb58 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:45.981362 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4b99109e-b407-42f4-914d-f12c5e26cb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:46.001773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:46.090581 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99109e-b407-42f4-914d-f12c5e26cb58 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:46.167202 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fe207-60cd-4136-8500-3932d62dc558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:46.167812 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fe207-60cd-4136-8500-3932d62dc558 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:46.168121 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fe207-60cd-4136-8500-3932d62dc558 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:46.168447 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fe207-60cd-4136-8500-3932d62dc558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:46.170041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-947fe207-60cd-4136-8500-3932d62dc558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:46.244318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:46.286082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fe207-60cd-4136-8500-3932d62dc558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:46.287511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fe207-60cd-4136-8500-3932d62dc558 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:46.306183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 676/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:01:48.498510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f94c57-9652-46cf-b66a-d9e3200d07d2 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:48.499073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f94c57-9652-46cf-b66a-d9e3200d07d2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:48.499073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f94c57-9652-46cf-b66a-d9e3200d07d2 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:48.500440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 650/1326] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:01:48.505635 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2111f4-76ec-4e66-ac59-b7745d0a8741 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:48.506029 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2111f4-76ec-4e66-ac59-b7745d0a8741 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:48.506277 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2111f4-76ec-4e66-ac59-b7745d0a8741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:48.573982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bd2111f4-76ec-4e66-ac59-b7745d0a8741 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:48.575198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bd2111f4-76ec-4e66-ac59-b7745d0a8741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:48.679489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 677/1327] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:01:48.961078 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f94c57-9652-46cf-b66a-d9e3200d07d2 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:48.962649 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f1f94c57-9652-46cf-b66a-d9e3200d07d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:49.027845 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:49.074077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f94c57-9652-46cf-b66a-d9e3200d07d2 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:49.148315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa33dcd-2f7a-4800-9721-71862727dca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:49.148937 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa33dcd-2f7a-4800-9721-71862727dca0 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:49.149191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa33dcd-2f7a-4800-9721-71862727dca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:49.149458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa33dcd-2f7a-4800-9721-71862727dca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:49.151038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2fa33dcd-2f7a-4800-9721-71862727dca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:49.260574 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:49.262985 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa33dcd-2f7a-4800-9721-71862727dca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:49.264547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa33dcd-2f7a-4800-9721-71862727dca0 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:49.283155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 651/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:01:51.242689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f15386-753c-4b3e-ab88-4c3cb21733ab None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:51.242689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f15386-753c-4b3e-ab88-4c3cb21733ab None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:51.243568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f15386-753c-4b3e-ab88-4c3cb21733ab None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:51.244938 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 678/1329] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:01:51.250600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ee75-cd5c-471a-98d9-d50556e8bf6c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:51.251106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ee75-cd5c-471a-98d9-d50556e8bf6c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:51.251216 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ee75-cd5c-471a-98d9-d50556e8bf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:51.326182 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-32f3ee75-cd5c-471a-98d9-d50556e8bf6c None None] MFA Rules not processed for user `3cf964840139481f9a2810f3576d0b10`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:51.327400 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-32f3ee75-cd5c-471a-98d9-d50556e8bf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:51.424272 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 652/1330] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:01:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:01:51.704827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f15386-753c-4b3e-ab88-4c3cb21733ab None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:51.706389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-99f15386-753c-4b3e-ab88-4c3cb21733ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:51.737606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:51.811207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f15386-753c-4b3e-ab88-4c3cb21733ab None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:51.889559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29dba69-1e08-4343-8c24-ce47e654a90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:51.890442 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dba69-1e08-4343-8c24-ce47e654a90d service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:51.890720 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dba69-1e08-4343-8c24-ce47e654a90d service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:51.890986 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dba69-1e08-4343-8c24-ce47e654a90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:51.892637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e29dba69-1e08-4343-8c24-ce47e654a90d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:51.974882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:52.009813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29dba69-1e08-4343-8c24-ce47e654a90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:52.011240 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29dba69-1e08-4343-8c24-ce47e654a90d service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:52.029705 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 679/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:01:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:01:54.408604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34ef3-026e-41ef-9e84-be6df4c7a5ab None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:54.409155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34ef3-026e-41ef-9e84-be6df4c7a5ab None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:54.409155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34ef3-026e-41ef-9e84-be6df4c7a5ab None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:54.410481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 653/1332] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:01:54.416151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80d85b-93cd-490d-bbcd-a9a8215062b5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:54.416553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80d85b-93cd-490d-bbcd-a9a8215062b5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:54.416692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80d85b-93cd-490d-bbcd-a9a8215062b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:54.482323 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7d80d85b-93cd-490d-bbcd-a9a8215062b5 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:54.483701 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7d80d85b-93cd-490d-bbcd-a9a8215062b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:54.580373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 680/1333] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:01:54.861443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b34ef3-026e-41ef-9e84-be6df4c7a5ab None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:54.863025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-84b34ef3-026e-41ef-9e84-be6df4c7a5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:54.932600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:54.967333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b34ef3-026e-41ef-9e84-be6df4c7a5ab None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:55.041127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e504f9-7e28-4570-8628-b8238cff8cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:55.041721 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e504f9-7e28-4570-8628-b8238cff8cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:55.041991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e504f9-7e28-4570-8628-b8238cff8cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:55.042255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e504f9-7e28-4570-8628-b8238cff8cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:55.043822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-32e504f9-7e28-4570-8628-b8238cff8cc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:55.152080 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e504f9-7e28-4570-8628-b8238cff8cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:55.153427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e504f9-7e28-4570-8628-b8238cff8cc0 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:55.163059 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:55.171574 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 654/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:01:57.105860 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d30e0-d59b-49a8-9027-5f0247812ea4 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:57.106385 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d30e0-d59b-49a8-9027-5f0247812ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:57.106385 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d30e0-d59b-49a8-9027-5f0247812ea4 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:57.107730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 681/1335] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:01:57.112931 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f8728-ed8a-442c-816d-dd79efe4cb9b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:57.113355 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f8728-ed8a-442c-816d-dd79efe4cb9b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:57.113479 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f8728-ed8a-442c-816d-dd79efe4cb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:57.178824 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-577f8728-ed8a-442c-816d-dd79efe4cb9b None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:57.180068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-577f8728-ed8a-442c-816d-dd79efe4cb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:57.275490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 655/1336] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:01:57.558516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d30e0-d59b-49a8-9027-5f0247812ea4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:57.560108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0b3d30e0-d59b-49a8-9027-5f0247812ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:57.599481 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:57.661723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d30e0-d59b-49a8-9027-5f0247812ea4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:57.732864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a49aa9-837a-4b56-975f-9dc8b39e1042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:57.733461 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a49aa9-837a-4b56-975f-9dc8b39e1042 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:57.733736 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a49aa9-837a-4b56-975f-9dc8b39e1042 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:57.734002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a49aa9-837a-4b56-975f-9dc8b39e1042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:57.735599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-57a49aa9-837a-4b56-975f-9dc8b39e1042 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:57.821401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:57.846527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a49aa9-837a-4b56-975f-9dc8b39e1042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:57.847963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a49aa9-837a-4b56-975f-9dc8b39e1042 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:57.865465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 682/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:00.122908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3975f-45d5-4e92-91a1-faa16f426254 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:00.123383 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3975f-45d5-4e92-91a1-faa16f426254 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:00.123480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3975f-45d5-4e92-91a1-faa16f426254 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:00.124850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 656/1338] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:00.130023 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfacad-e9cc-4b7e-a41e-524d985f2dfb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:00.130429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfacad-e9cc-4b7e-a41e-524d985f2dfb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:00.130565 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfacad-e9cc-4b7e-a41e-524d985f2dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:00.195624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-68cfacad-e9cc-4b7e-a41e-524d985f2dfb None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:00.196849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-68cfacad-e9cc-4b7e-a41e-524d985f2dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:00.292669 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 683/1339] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:00.576640 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3975f-45d5-4e92-91a1-faa16f426254 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:00.578177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-92e3975f-45d5-4e92-91a1-faa16f426254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:00.658097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:00.687583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3975f-45d5-4e92-91a1-faa16f426254 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:00.761657 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf09f5-ae70-4f91-9cfe-a81c5579aae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:00.762260 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf09f5-ae70-4f91-9cfe-a81c5579aae2 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:00.762535 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf09f5-ae70-4f91-9cfe-a81c5579aae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:00.762801 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf09f5-ae70-4f91-9cfe-a81c5579aae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:00.764433 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-afdf09f5-ae70-4f91-9cfe-a81c5579aae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:00.872932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf09f5-ae70-4f91-9cfe-a81c5579aae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:00.874353 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf09f5-ae70-4f91-9cfe-a81c5579aae2 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:00.892996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 657/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:04.879371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5f26d-af62-4c5d-929a-b4545f2d416c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:04.879931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5f26d-af62-4c5d-929a-b4545f2d416c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:04.879931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5f26d-af62-4c5d-929a-b4545f2d416c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:04.881897 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 684/1341] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:04.887510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c59d63-7d5a-440a-a057-ff85b4f18a80 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:04.888113 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c59d63-7d5a-440a-a057-ff85b4f18a80 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:04.888113 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c59d63-7d5a-440a-a057-ff85b4f18a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:04.893528 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:04.964519 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-43c59d63-7d5a-440a-a057-ff85b4f18a80 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:04.965732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-43c59d63-7d5a-440a-a057-ff85b4f18a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:05.065822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 658/1342] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:02:05.352092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5f26d-af62-4c5d-929a-b4545f2d416c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:05.353695 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7dd5f26d-af62-4c5d-929a-b4545f2d416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:05.405035 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:05.461938 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5f26d-af62-4c5d-929a-b4545f2d416c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:05.536693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52d45d-49f7-4218-b92c-0ef8a8ab211d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:05.537802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52d45d-49f7-4218-b92c-0ef8a8ab211d service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:05.538079 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52d45d-49f7-4218-b92c-0ef8a8ab211d service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:05.538343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52d45d-49f7-4218-b92c-0ef8a8ab211d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:05.540273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-dd52d45d-49f7-4218-b92c-0ef8a8ab211d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:05.635006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:05.651565 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52d45d-49f7-4218-b92c-0ef8a8ab211d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:05.653110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52d45d-49f7-4218-b92c-0ef8a8ab211d service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:05.671723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 685/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:08.249354 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca275a59-e3e1-41d4-a2a0-9bc84fa4ab21 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:08.249884 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca275a59-e3e1-41d4-a2a0-9bc84fa4ab21 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:08.249884 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca275a59-e3e1-41d4-a2a0-9bc84fa4ab21 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:08.251212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 659/1344] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:08.257113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5492aed-cd6f-4ddf-ac62-af46556cc387 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:08.257551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5492aed-cd6f-4ddf-ac62-af46556cc387 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:08.257657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5492aed-cd6f-4ddf-ac62-af46556cc387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:08.326297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b5492aed-cd6f-4ddf-ac62-af46556cc387 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:08.327487 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b5492aed-cd6f-4ddf-ac62-af46556cc387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:08.422179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 686/1345] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:02:08.707931 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca275a59-e3e1-41d4-a2a0-9bc84fa4ab21 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:08.709578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ca275a59-e3e1-41d4-a2a0-9bc84fa4ab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:08.797508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:08.816128 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca275a59-e3e1-41d4-a2a0-9bc84fa4ab21 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:08.902401 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cce98-5f7f-4b5e-8110-1ae2ef9e12b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:08.903023 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cce98-5f7f-4b5e-8110-1ae2ef9e12b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:08.903296 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cce98-5f7f-4b5e-8110-1ae2ef9e12b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:08.903560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cce98-5f7f-4b5e-8110-1ae2ef9e12b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:08.905259 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ee5cce98-5f7f-4b5e-8110-1ae2ef9e12b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:09.015994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cce98-5f7f-4b5e-8110-1ae2ef9e12b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:09.017435 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cce98-5f7f-4b5e-8110-1ae2ef9e12b8 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:09.038691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 660/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:13.023643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e5a75-441d-49b9-8fa7-dbb7fd162464 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:13.024114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e5a75-441d-49b9-8fa7-dbb7fd162464 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:13.024114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e5a75-441d-49b9-8fa7-dbb7fd162464 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:13.027243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 687/1347] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:13.030832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db53f3-c2c6-4eff-b7a5-9663be6423c0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:13.031563 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db53f3-c2c6-4eff-b7a5-9663be6423c0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:13.032047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db53f3-c2c6-4eff-b7a5-9663be6423c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:13.051449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:13.109372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-53db53f3-c2c6-4eff-b7a5-9663be6423c0 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:13.110604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-53db53f3-c2c6-4eff-b7a5-9663be6423c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:13.217590 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 661/1348] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:13.499940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e5a75-441d-49b9-8fa7-dbb7fd162464 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:13.501571 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-454e5a75-441d-49b9-8fa7-dbb7fd162464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:13.566042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:13.612634 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e5a75-441d-49b9-8fa7-dbb7fd162464 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:13.688214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29053a27-1db6-4c1e-b7e8-0c93e40e3aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:13.688818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053a27-1db6-4c1e-b7e8-0c93e40e3aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:13.689087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053a27-1db6-4c1e-b7e8-0c93e40e3aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:13.689359 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053a27-1db6-4c1e-b7e8-0c93e40e3aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:13.690962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-29053a27-1db6-4c1e-b7e8-0c93e40e3aa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:13.799758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:13.804617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29053a27-1db6-4c1e-b7e8-0c93e40e3aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:13.806051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29053a27-1db6-4c1e-b7e8-0c93e40e3aa1 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:13.824341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 688/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:18.848764 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d9dbb-8f41-440e-aef6-0d580052d7f4 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:18.849791 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d9dbb-8f41-440e-aef6-0d580052d7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:18.849995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d9dbb-8f41-440e-aef6-0d580052d7f4 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:18.851609 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 662/1350] 10.222.0.48 () {54 vars in 921 bytes} [Tue Aug 30 05:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:18.858241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e6ac7-5349-4991-a649-37014df91a97 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:18.858706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e6ac7-5349-4991-a649-37014df91a97 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:18.858790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e6ac7-5349-4991-a649-37014df91a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:18.953358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5c5e6ac7-5349-4991-a649-37014df91a97 None None] MFA Rules not processed for user `ed835047051142d2bc98bb1564e3a98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:18.961014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5c5e6ac7-5349-4991-a649-37014df91a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:19.202700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 689/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Aug 30 05:02:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:23.215424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=59 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:23.745410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf27b00-4517-4ca9-9066-126596f5061f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:23.746024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf27b00-4517-4ca9-9066-126596f5061f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:23.746480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf27b00-4517-4ca9-9066-126596f5061f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:23.748072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 663/1352] 10.222.0.48 () {54 vars in 921 bytes} [Tue Aug 30 05:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:23.753531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500e998-049f-4821-b0f8-981eb28f34a9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:23.754218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500e998-049f-4821-b0f8-981eb28f34a9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:23.754218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500e998-049f-4821-b0f8-981eb28f34a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:23.822971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:23.853472 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f500e998-049f-4821-b0f8-981eb28f34a9 None None] MFA Rules not processed for user `ed835047051142d2bc98bb1564e3a98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:23.853927 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f500e998-049f-4821-b0f8-981eb28f34a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:23.986243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 690/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Aug 30 05:02:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:25.390152 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5979ed-cd9a-4950-9915-81e4462d1e33 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:25.390914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5979ed-cd9a-4950-9915-81e4462d1e33 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:25.391375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5979ed-cd9a-4950-9915-81e4462d1e33 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:25.393809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 664/1354] 10.222.0.48 () {54 vars in 921 bytes} [Tue Aug 30 05:02:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:25.399502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f2135-a10b-4df6-aa30-c43aed667d13 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:25.400009 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f2135-a10b-4df6-aa30-c43aed667d13 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:25.400164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f2135-a10b-4df6-aa30-c43aed667d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:25.480271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f28f2135-a10b-4df6-aa30-c43aed667d13 None None] MFA Rules not processed for user `ed835047051142d2bc98bb1564e3a98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:25.481477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f28f2135-a10b-4df6-aa30-c43aed667d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:25.524762 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:25.600808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 691/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Aug 30 05:02:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:28.814945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424075f4-47cf-450f-9e45-3a1f70dc2168 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:28.815501 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424075f4-47cf-450f-9e45-3a1f70dc2168 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:28.815501 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424075f4-47cf-450f-9e45-3a1f70dc2168 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:28.816838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 665/1356] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:28.822843 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db08c5-1ecc-4bf7-a19c-a1d5e68d9732 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:28.823272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db08c5-1ecc-4bf7-a19c-a1d5e68d9732 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:28.823443 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db08c5-1ecc-4bf7-a19c-a1d5e68d9732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:28.900920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-49db08c5-1ecc-4bf7-a19c-a1d5e68d9732 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:28.902128 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-49db08c5-1ecc-4bf7-a19c-a1d5e68d9732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:29.056065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 692/1357] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:29.360285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c74131-b3e0-4a84-9b54-de451cac4f91 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:29.360793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c74131-b3e0-4a84-9b54-de451cac4f91 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:29.361215 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c74131-b3e0-4a84-9b54-de451cac4f91 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:29.362991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 666/1358] 10.222.0.48 () {54 vars in 962 bytes} [Tue Aug 30 05:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:29.385241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fecfc-4bb4-41ce-8ff4-d1b3a275a233 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:29.385521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fecfc-4bb4-41ce-8ff4-d1b3a275a233 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:29.385786 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fecfc-4bb4-41ce-8ff4-d1b3a275a233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:29.411532 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:29.498805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f94fecfc-4bb4-41ce-8ff4-d1b3a275a233 None None] MFA Rules not processed for user `1aa002909502426b80c97dbf05dca008`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:29.500130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f94fecfc-4bb4-41ce-8ff4-d1b3a275a233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:29.638610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 693/1359] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Aug 30 05:02:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:29.648298 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c74131-b3e0-4a84-9b54-de451cac4f91 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:29.649926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-66c74131-b3e0-4a84-9b54-de451cac4f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:29.808671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c74131-b3e0-4a84-9b54-de451cac4f91 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:29.884914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:29.927205 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630a837-1747-4374-a988-002d3b4aeb8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:29.927802 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630a837-1747-4374-a988-002d3b4aeb8e service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:29.928106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630a837-1747-4374-a988-002d3b4aeb8e service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:29.928370 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630a837-1747-4374-a988-002d3b4aeb8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:29.929936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3630a837-1747-4374-a988-002d3b4aeb8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:30.030387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630a837-1747-4374-a988-002d3b4aeb8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:30.032826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630a837-1747-4374-a988-002d3b4aeb8e service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:30.057244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 667/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:32.231888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95692f-b08a-4b2b-a21a-063efcf2aef0 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:32.232424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95692f-b08a-4b2b-a21a-063efcf2aef0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:32.232424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95692f-b08a-4b2b-a21a-063efcf2aef0 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:32.233909 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 694/1361] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:32.240561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3b4a7-d919-4e42-8811-08c543e9756c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:32.241038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3b4a7-d919-4e42-8811-08c543e9756c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:32.241038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3b4a7-d919-4e42-8811-08c543e9756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:32.319018 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f2e3b4a7-d919-4e42-8811-08c543e9756c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:32.319018 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f2e3b4a7-d919-4e42-8811-08c543e9756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:32.366392 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:32.441158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 668/1362] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:32.736067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95692f-b08a-4b2b-a21a-063efcf2aef0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:32.740293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-be95692f-b08a-4b2b-a21a-063efcf2aef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:32.833862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:32.955799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95692f-b08a-4b2b-a21a-063efcf2aef0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:33.104237 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9d7e7-f652-4538-8ece-4721505b7ecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:33.104978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9d7e7-f652-4538-8ece-4721505b7ecc service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:33.105369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9d7e7-f652-4538-8ece-4721505b7ecc service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:33.105736 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9d7e7-f652-4538-8ece-4721505b7ecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:33.107512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-84c9d7e7-f652-4538-8ece-4721505b7ecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:33.136034 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:33.215690 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9d7e7-f652-4538-8ece-4721505b7ecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:33.217344 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9d7e7-f652-4538-8ece-4721505b7ecc service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:33.237691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 695/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:35.713646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df1076-6e7f-49e2-ac65-4ad72efda199 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:35.714230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df1076-6e7f-49e2-ac65-4ad72efda199 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:35.714230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df1076-6e7f-49e2-ac65-4ad72efda199 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:35.715553 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 669/1364] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:35.721206 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f4907-143c-42ea-a43b-f7ed3b858e55 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:35.721654 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f4907-143c-42ea-a43b-f7ed3b858e55 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:35.721755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f4907-143c-42ea-a43b-f7ed3b858e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:35.799880 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-042f4907-143c-42ea-a43b-f7ed3b858e55 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:35.801690 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-042f4907-143c-42ea-a43b-f7ed3b858e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:35.905179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:35.911999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 696/1365] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:36.198473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7db6c-40e0-498b-932e-fb691896a655 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:36.198872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7db6c-40e0-498b-932e-fb691896a655 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:36.199532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7db6c-40e0-498b-932e-fb691896a655 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:36.200397 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 670/1366] 10.222.0.48 () {54 vars in 962 bytes} [Tue Aug 30 05:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:36.207096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601664b6-db49-450c-8a71-2546fcb5297a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:36.208099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601664b6-db49-450c-8a71-2546fcb5297a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:36.208471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601664b6-db49-450c-8a71-2546fcb5297a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:36.293345 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-601664b6-db49-450c-8a71-2546fcb5297a None None] MFA Rules not processed for user `1aa002909502426b80c97dbf05dca008`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:36.294476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-601664b6-db49-450c-8a71-2546fcb5297a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:36.424367 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 697/1367] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Aug 30 05:02:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:36.433120 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7db6c-40e0-498b-932e-fb691896a655 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:36.434390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0bf7db6c-40e0-498b-932e-fb691896a655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:36.602109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7db6c-40e0-498b-932e-fb691896a655 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:36.625527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:36.733796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29694c4-c626-420b-a8ba-9a9b5020cada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:36.734456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29694c4-c626-420b-a8ba-9a9b5020cada service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:36.734734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29694c4-c626-420b-a8ba-9a9b5020cada service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:36.734928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29694c4-c626-420b-a8ba-9a9b5020cada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:36.736687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c29694c4-c626-420b-a8ba-9a9b5020cada service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:36.834043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29694c4-c626-420b-a8ba-9a9b5020cada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:36.835821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29694c4-c626-420b-a8ba-9a9b5020cada service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:36.855319 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 671/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:37.532824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd15aef-0723-438e-97ff-d22ab25a71cf None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:37.533355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd15aef-0723-438e-97ff-d22ab25a71cf None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:37.533355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd15aef-0723-438e-97ff-d22ab25a71cf None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:37.535023 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 698/1369] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:37.542689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe01ef8-d162-4a3c-83d8-8f5ea3d9683b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:37.543012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe01ef8-d162-4a3c-83d8-8f5ea3d9683b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:37.543395 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe01ef8-d162-4a3c-83d8-8f5ea3d9683b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:37.580652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:37.627971 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bfe01ef8-d162-4a3c-83d8-8f5ea3d9683b None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:37.627971 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bfe01ef8-d162-4a3c-83d8-8f5ea3d9683b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:37.734890 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 672/1370] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:38.295239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b156d7-7980-4b8d-91da-aa07a924e756 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:38.295648 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b156d7-7980-4b8d-91da-aa07a924e756 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:38.296066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b156d7-7980-4b8d-91da-aa07a924e756 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:38.297804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 699/1371] 10.222.0.48 () {54 vars in 964 bytes} [Tue Aug 30 05:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:38.304656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cf2de-6b5d-4a12-84a3-a3e3da57271a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:38.304945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cf2de-6b5d-4a12-84a3-a3e3da57271a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:38.305220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cf2de-6b5d-4a12-84a3-a3e3da57271a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:38.390083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9e4cf2de-6b5d-4a12-84a3-a3e3da57271a None None] MFA Rules not processed for user `eee3162303924aaeb91af567f02980e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:38.391233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9e4cf2de-6b5d-4a12-84a3-a3e3da57271a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:38.444301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:38.482953 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 673/1372] 10.222.0.48 () {58 vars in 1061 bytes} [Tue Aug 30 05:02:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:38.491342 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b156d7-7980-4b8d-91da-aa07a924e756 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:38.493129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-37b156d7-7980-4b8d-91da-aa07a924e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:38.550911 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:38.613985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b156d7-7980-4b8d-91da-aa07a924e756 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:38.705179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a82740-9a53-4110-a45b-a3094516d078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:38.705936 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82740-9a53-4110-a45b-a3094516d078 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:38.706428 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82740-9a53-4110-a45b-a3094516d078 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:38.706695 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82740-9a53-4110-a45b-a3094516d078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:38.708557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a9a82740-9a53-4110-a45b-a3094516d078 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:38.848670 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:38.865049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a82740-9a53-4110-a45b-a3094516d078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:38.866476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a82740-9a53-4110-a45b-a3094516d078 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:38.888783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 700/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:38.937532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af43cf6-4456-4a20-8cd4-494666e20fde None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:38.937973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af43cf6-4456-4a20-8cd4-494666e20fde None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:38.938280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af43cf6-4456-4a20-8cd4-494666e20fde None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:38.939691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 674/1374] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:38.945776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82f5a9-a5ab-4216-ab83-b9efd2de585d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:38.946057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82f5a9-a5ab-4216-ab83-b9efd2de585d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:38.946323 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82f5a9-a5ab-4216-ab83-b9efd2de585d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:39.043993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2e82f5a9-a5ab-4216-ab83-b9efd2de585d None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:39.044492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2e82f5a9-a5ab-4216-ab83-b9efd2de585d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:39.159921 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 701/1375] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:39.459571 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af43cf6-4456-4a20-8cd4-494666e20fde None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:39.461248 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2af43cf6-4456-4a20-8cd4-494666e20fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:39.631231 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af43cf6-4456-4a20-8cd4-494666e20fde None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:39.697776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:39.763129 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01b26d-c69c-4190-bd4f-4bf9fc7ff248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:39.763845 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01b26d-c69c-4190-bd4f-4bf9fc7ff248 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:39.764151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01b26d-c69c-4190-bd4f-4bf9fc7ff248 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:39.764424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01b26d-c69c-4190-bd4f-4bf9fc7ff248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:39.766018 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-de01b26d-c69c-4190-bd4f-4bf9fc7ff248 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:39.856859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01b26d-c69c-4190-bd4f-4bf9fc7ff248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:39.858443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01b26d-c69c-4190-bd4f-4bf9fc7ff248 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:39.877332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 675/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:41.843849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fd443-078b-467d-b7f3-555855244923 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:41.844453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fd443-078b-467d-b7f3-555855244923 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:41.844453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fd443-078b-467d-b7f3-555855244923 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:41.845688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 702/1377] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:41.852989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ddfd1-1e5e-4cc4-a800-c6ecb07bcab3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:41.853607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ddfd1-1e5e-4cc4-a800-c6ecb07bcab3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:41.853607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ddfd1-1e5e-4cc4-a800-c6ecb07bcab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:41.924192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-fc5ddfd1-1e5e-4cc4-a800-c6ecb07bcab3 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:41.925412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fc5ddfd1-1e5e-4cc4-a800-c6ecb07bcab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:41.932184 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:42.044223 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 676/1378] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:42.368345 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fd443-078b-467d-b7f3-555855244923 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:42.369879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b09fd443-078b-467d-b7f3-555855244923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:42.443916 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:42.600698 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fd443-078b-467d-b7f3-555855244923 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:42.764242 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c22cb4-ba25-4b3d-87cd-611b4065ba28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:42.764776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c22cb4-ba25-4b3d-87cd-611b4065ba28 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:42.765054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c22cb4-ba25-4b3d-87cd-611b4065ba28 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:42.765324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c22cb4-ba25-4b3d-87cd-611b4065ba28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:42.767089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b2c22cb4-ba25-4b3d-87cd-611b4065ba28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:42.796274 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:42.900334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c22cb4-ba25-4b3d-87cd-611b4065ba28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:42.901957 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c22cb4-ba25-4b3d-87cd-611b4065ba28 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:42.923540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 703/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:44.962595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74d56b-d0e8-4fc9-8ede-454cc0a2a247 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:44.962595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74d56b-d0e8-4fc9-8ede-454cc0a2a247 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:44.964341 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74d56b-d0e8-4fc9-8ede-454cc0a2a247 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:44.967783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 677/1380] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:44.976090 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25e1df-20a2-4a6e-846b-6b6257870709 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:44.976617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25e1df-20a2-4a6e-846b-6b6257870709 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:44.976617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25e1df-20a2-4a6e-846b-6b6257870709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:45.075549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8b25e1df-20a2-4a6e-846b-6b6257870709 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:45.076861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8b25e1df-20a2-4a6e-846b-6b6257870709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:45.192001 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:45.208012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 704/1381] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:45.509197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74d56b-d0e8-4fc9-8ede-454cc0a2a247 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:45.511158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2f74d56b-d0e8-4fc9-8ede-454cc0a2a247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:45.698058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:45.710555 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74d56b-d0e8-4fc9-8ede-454cc0a2a247 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:45.859573 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a272411-787c-4429-9b01-a73df11a0596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:45.860338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a272411-787c-4429-9b01-a73df11a0596 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:45.860793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a272411-787c-4429-9b01-a73df11a0596 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:45.861038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a272411-787c-4429-9b01-a73df11a0596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:45.862723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8a272411-787c-4429-9b01-a73df11a0596 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:45.961914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a272411-787c-4429-9b01-a73df11a0596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:45.963660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a272411-787c-4429-9b01-a73df11a0596 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:45.974893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:45.985139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 678/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:47.995418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e80e7e-2892-49a9-8f8c-72162b14ce56 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:47.996692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e80e7e-2892-49a9-8f8c-72162b14ce56 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:47.996692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e80e7e-2892-49a9-8f8c-72162b14ce56 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:47.998596 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 705/1383] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:48.005420 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe60d6c-2f59-46e6-9afc-47e5a4684542 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:48.005917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe60d6c-2f59-46e6-9afc-47e5a4684542 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:48.006098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe60d6c-2f59-46e6-9afc-47e5a4684542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:48.101486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9fe60d6c-2f59-46e6-9afc-47e5a4684542 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:48.103051 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9fe60d6c-2f59-46e6-9afc-47e5a4684542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:48.234043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 679/1384] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:48.596334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e80e7e-2892-49a9-8f8c-72162b14ce56 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:48.598450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e7e80e7e-2892-49a9-8f8c-72162b14ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:48.776491 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e80e7e-2892-49a9-8f8c-72162b14ce56 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:48.877279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:48.943151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a99409-1670-4904-ac22-6634181e705f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:48.944146 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a99409-1670-4904-ac22-6634181e705f service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:48.944424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a99409-1670-4904-ac22-6634181e705f service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:48.944702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a99409-1670-4904-ac22-6634181e705f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:48.946357 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-24a99409-1670-4904-ac22-6634181e705f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:49.072566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a99409-1670-4904-ac22-6634181e705f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:49.074642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a99409-1670-4904-ac22-6634181e705f service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:49.106644 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 706/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:02:51.677378 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5a58c-41c8-475d-ae82-3269f98453cd None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:51.677964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5a58c-41c8-475d-ae82-3269f98453cd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:51.677964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5a58c-41c8-475d-ae82-3269f98453cd None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:51.679248 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 680/1386] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 05:02:51.685081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a15ed-48e7-4a47-ae75-151599efb8c5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:51.685515 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a15ed-48e7-4a47-ae75-151599efb8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:51.685875 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a15ed-48e7-4a47-ae75-151599efb8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:51.771802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fb2a15ed-48e7-4a47-ae75-151599efb8c5 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:51.773391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fb2a15ed-48e7-4a47-ae75-151599efb8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:51.817254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:51.900358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 707/1387] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:52.190284 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5a58c-41c8-475d-ae82-3269f98453cd None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:52.192375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-27b5a58c-41c8-475d-ae82-3269f98453cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:52.271470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:52.342969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5a58c-41c8-475d-ae82-3269f98453cd None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:52.465495 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1197a8b-61c1-4e9c-a536-2706510faf65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:52.466127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1197a8b-61c1-4e9c-a536-2706510faf65 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:52.466399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1197a8b-61c1-4e9c-a536-2706510faf65 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:52.466662 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1197a8b-61c1-4e9c-a536-2706510faf65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:52.468277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d1197a8b-61c1-4e9c-a536-2706510faf65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:52.508507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:52.563874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1197a8b-61c1-4e9c-a536-2706510faf65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:52.565447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1197a8b-61c1-4e9c-a536-2706510faf65 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:52.586460 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 681/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:54.380255 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bb140-ea80-40ae-8cf5-af20947fbd53 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:54.380818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bb140-ea80-40ae-8cf5-af20947fbd53 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:54.380818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bb140-ea80-40ae-8cf5-af20947fbd53 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:54.382271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 708/1389] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:54.387307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b3140-f4e0-4400-afaf-931264081b2f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:54.387729 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b3140-f4e0-4400-afaf-931264081b2f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:54.388013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b3140-f4e0-4400-afaf-931264081b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:54.456285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ec4b3140-f4e0-4400-afaf-931264081b2f None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:54.458150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ec4b3140-f4e0-4400-afaf-931264081b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:54.539903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196793a-2fb6-4427-bf76-af493a068ecb None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:54.540221 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196793a-2fb6-4427-bf76-af493a068ecb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:54.540652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196793a-2fb6-4427-bf76-af493a068ecb None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:54.542001 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 709/1390] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 05:02:54.547107 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b415698-96ec-4ede-b943-dd69e7d0e12e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:54.547383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b415698-96ec-4ede-b943-dd69e7d0e12e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:54.547652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b415698-96ec-4ede-b943-dd69e7d0e12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:54.557955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 682/1391] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:54.615793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1b415698-96ec-4ede-b943-dd69e7d0e12e None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:54.617055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1b415698-96ec-4ede-b943-dd69e7d0e12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:54.719650 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 710/1392] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:54.870211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804b78-8228-4eb9-8354-f7a300dd4f17 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:54.870490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804b78-8228-4eb9-8354-f7a300dd4f17 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:54.870762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804b78-8228-4eb9-8354-f7a300dd4f17 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:54.872189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 683/1393] 10.222.0.48 () {54 vars in 967 bytes} [Tue Aug 30 05:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:54.877254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea39a-d8e2-43b1-8d5d-81c5cc068db5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:54.877544 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea39a-d8e2-43b1-8d5d-81c5cc068db5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:54.877814 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea39a-d8e2-43b1-8d5d-81c5cc068db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:54.894632 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:54.958105 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-107ea39a-d8e2-43b1-8d5d-81c5cc068db5 None None] MFA Rules not processed for user `77d3889156524b388b761cedfac8ed6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:54.959212 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-107ea39a-d8e2-43b1-8d5d-81c5cc068db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:55.016791 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f804b78-8228-4eb9-8354-f7a300dd4f17 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:55.018308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4f804b78-8228-4eb9-8354-f7a300dd4f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:55.032200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:55.048386 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 711/1394] 10.222.0.48 () {58 vars in 1064 bytes} [Tue Aug 30 05:02:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:02:55.056782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ea39a-d8e2-43b1-8d5d-81c5cc068db5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:55.064337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ea39a-d8e2-43b1-8d5d-81c5cc068db5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:55.146954 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051835c7-4658-4981-b49a-9b9bc33ddf74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d3889156524b388b761cedfac8ed6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:55.147565 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051835c7-4658-4981-b49a-9b9bc33ddf74 service glance] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:55.147843 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051835c7-4658-4981-b49a-9b9bc33ddf74 service glance] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:55.148143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051835c7-4658-4981-b49a-9b9bc33ddf74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:55.149781 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-051835c7-4658-4981-b49a-9b9bc33ddf74 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:55.176422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f804b78-8228-4eb9-8354-f7a300dd4f17 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:55.182620 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:55.268866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:55.272121 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051835c7-4658-4981-b49a-9b9bc33ddf74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:55.273777 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051835c7-4658-4981-b49a-9b9bc33ddf74 service glance] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:55.293061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 712/1395] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:02:55.297889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554a77c-f843-494e-a465-52eb55a15aef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:55.298493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554a77c-f843-494e-a465-52eb55a15aef service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:55.298767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554a77c-f843-494e-a465-52eb55a15aef service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:55.299032 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554a77c-f843-494e-a465-52eb55a15aef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:55.301237 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7554a77c-f843-494e-a465-52eb55a15aef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:55.400005 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554a77c-f843-494e-a465-52eb55a15aef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:55.401610 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554a77c-f843-494e-a465-52eb55a15aef service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:55.419974 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 684/1396] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:02:56.046913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89011c-3e23-4ac4-b23c-5c568ad9ba68 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:56.047375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89011c-3e23-4ac4-b23c-5c568ad9ba68 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:56.047675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89011c-3e23-4ac4-b23c-5c568ad9ba68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:56.119794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1c89011c-3e23-4ac4-b23c-5c568ad9ba68 None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:56.121112 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1c89011c-3e23-4ac4-b23c-5c568ad9ba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:56.210857 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:56.217803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 713/1397] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Aug 30 05:02:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:56.260430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe8931-7515-4c5b-8cd2-61c44d69c56b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:56.260715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe8931-7515-4c5b-8cd2-61c44d69c56b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:56.260985 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe8931-7515-4c5b-8cd2-61c44d69c56b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:56.262463 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 685/1398] 10.222.0.48 () {54 vars in 943 bytes} [Tue Aug 30 05:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:56.268548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0af76-28d3-4e3e-a129-a7bfb76d9651 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:56.268944 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0af76-28d3-4e3e-a129-a7bfb76d9651 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:56.269773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0af76-28d3-4e3e-a129-a7bfb76d9651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:56.345812 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-26b0af76-28d3-4e3e-a129-a7bfb76d9651 None None] MFA Rules not processed for user `a96ac878c106422ebf438a64ca618747`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:56.347002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-26b0af76-28d3-4e3e-a129-a7bfb76d9651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:56.460759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 714/1399] 10.222.0.48 () {58 vars in 1040 bytes} [Tue Aug 30 05:02:56 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:56.470058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe8931-7515-4c5b-8cd2-61c44d69c56b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:56.471627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b0fe8931-7515-4c5b-8cd2-61c44d69c56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:56.570825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:56.611792 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe8931-7515-4c5b-8cd2-61c44d69c56b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:56.716562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e125d-b51f-4fd1-a40a-9d64fa57f923 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:56.717085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e125d-b51f-4fd1-a40a-9d64fa57f923 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:56.717360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e125d-b51f-4fd1-a40a-9d64fa57f923 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:56.717631 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e125d-b51f-4fd1-a40a-9d64fa57f923 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:56.719284 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-448e125d-b51f-4fd1-a40a-9d64fa57f923 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:56.802271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e125d-b51f-4fd1-a40a-9d64fa57f923 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:56.803878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e125d-b51f-4fd1-a40a-9d64fa57f923 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:56.807486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:56.813254 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 686/1400] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:02:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 05:02:57.381299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b7640-d7a7-4bfa-9213-ed212c407803 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:57.381953 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b7640-d7a7-4bfa-9213-ed212c407803 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:57.381953 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b7640-d7a7-4bfa-9213-ed212c407803 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:57.383162 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 715/1401] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:02:57.388279 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7ce18-1959-47fb-be4e-620387051d1d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:57.388562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7ce18-1959-47fb-be4e-620387051d1d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:57.388830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7ce18-1959-47fb-be4e-620387051d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:57.470075 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-92c7ce18-1959-47fb-be4e-620387051d1d None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:57.471313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-92c7ce18-1959-47fb-be4e-620387051d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:57.580613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 687/1402] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:57.872676 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b7640-d7a7-4bfa-9213-ed212c407803 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:57.874499 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d29b7640-d7a7-4bfa-9213-ed212c407803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:57.940347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:58.047701 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b7640-d7a7-4bfa-9213-ed212c407803 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:58.171076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb763b-4c48-4029-b81b-3750b31aac68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:58.171685 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb763b-4c48-4029-b81b-3750b31aac68 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:58.171989 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb763b-4c48-4029-b81b-3750b31aac68 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:58.172262 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb763b-4c48-4029-b81b-3750b31aac68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:58.174024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-69eb763b-4c48-4029-b81b-3750b31aac68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:58.193156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:58.297795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb763b-4c48-4029-b81b-3750b31aac68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:58.300013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb763b-4c48-4029-b81b-3750b31aac68 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:58.321120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 716/1403] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:00.292734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c1b0-6be1-42b0-b776-1aa2d73b7060 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:00.293256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c1b0-6be1-42b0-b776-1aa2d73b7060 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:00.293256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c1b0-6be1-42b0-b776-1aa2d73b7060 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:00.294417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 688/1404] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:00.299861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2ec36-30d2-4087-9dcf-d25a6b3c772b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:00.300369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2ec36-30d2-4087-9dcf-d25a6b3c772b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:00.300464 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2ec36-30d2-4087-9dcf-d25a6b3c772b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:00.380477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e4a2ec36-30d2-4087-9dcf-d25a6b3c772b None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:00.380477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e4a2ec36-30d2-4087-9dcf-d25a6b3c772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:00.480425 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:00.489575 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 717/1405] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:00.792709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c1b0-6be1-42b0-b776-1aa2d73b7060 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:00.795374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a448c1b0-6be1-42b0-b776-1aa2d73b7060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:00.903882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:01.016789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c1b0-6be1-42b0-b776-1aa2d73b7060 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:01.185040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8bce7-98e0-438b-be7b-cd5020bab698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:01.185638 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8bce7-98e0-438b-be7b-cd5020bab698 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:01.185914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8bce7-98e0-438b-be7b-cd5020bab698 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:01.186192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8bce7-98e0-438b-be7b-cd5020bab698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:01.187785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1cb8bce7-98e0-438b-be7b-cd5020bab698 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:01.239449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:01.299473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8bce7-98e0-438b-be7b-cd5020bab698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:01.301697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8bce7-98e0-438b-be7b-cd5020bab698 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:01.322191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 689/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:03.341557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af2d1c-6e4a-4644-b7d0-13047d00e8a3 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:03.342125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af2d1c-6e4a-4644-b7d0-13047d00e8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:03.342125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af2d1c-6e4a-4644-b7d0-13047d00e8a3 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:03.343432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 718/1407] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:03.348842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c316f-8dd3-404c-8730-2293bca13198 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:03.349296 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c316f-8dd3-404c-8730-2293bca13198 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:03.349396 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c316f-8dd3-404c-8730-2293bca13198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:03.427402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f18c316f-8dd3-404c-8730-2293bca13198 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:03.428689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f18c316f-8dd3-404c-8730-2293bca13198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:03.545365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 690/1408] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:03.835370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af2d1c-6e4a-4644-b7d0-13047d00e8a3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:03.836930 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-03af2d1c-6e4a-4644-b7d0-13047d00e8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:04.028830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af2d1c-6e4a-4644-b7d0-13047d00e8a3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:04.114096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:04.182080 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccaaafb-8b37-4e97-97c2-dab73519d480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:04.183031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccaaafb-8b37-4e97-97c2-dab73519d480 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:04.183031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccaaafb-8b37-4e97-97c2-dab73519d480 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:04.183246 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccaaafb-8b37-4e97-97c2-dab73519d480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:04.185027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4ccaaafb-8b37-4e97-97c2-dab73519d480 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:04.296214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccaaafb-8b37-4e97-97c2-dab73519d480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:04.297977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccaaafb-8b37-4e97-97c2-dab73519d480 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:04.321136 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 719/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:13.543312 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=93 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:14.318648 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=65 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:19.305736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb2792-b127-4cf7-a782-9db645587ec7 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:19.306286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb2792-b127-4cf7-a782-9db645587ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:19.306286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb2792-b127-4cf7-a782-9db645587ec7 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:19.307596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 691/1410] 10.222.0.48 () {54 vars in 918 bytes} [Tue Aug 30 05:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:19.312548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed625a-7e72-40fc-a0f6-463fd2a0615c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:19.312946 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed625a-7e72-40fc-a0f6-463fd2a0615c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:19.313086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed625a-7e72-40fc-a0f6-463fd2a0615c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:19.387270 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-17ed625a-7e72-40fc-a0f6-463fd2a0615c None None] MFA Rules not processed for user `ed835047051142d2bc98bb1564e3a98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:19.388504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-17ed625a-7e72-40fc-a0f6-463fd2a0615c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:19.493530 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 720/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Aug 30 05:03:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:19.507964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03f010-a43b-47e1-890a-8eab7158402c None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:19.508248 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03f010-a43b-47e1-890a-8eab7158402c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:19.508539 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03f010-a43b-47e1-890a-8eab7158402c None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:19.509855 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 692/1412] 10.222.0.48 () {54 vars in 918 bytes} [Tue Aug 30 05:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:19.514409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911fb6b-7542-4fcc-94df-f170453fa844 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:19.514696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911fb6b-7542-4fcc-94df-f170453fa844 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:19.514969 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911fb6b-7542-4fcc-94df-f170453fa844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:19.588053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:19.591161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5911fb6b-7542-4fcc-94df-f170453fa844 None None] MFA Rules not processed for user `1aa002909502426b80c97dbf05dca008`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:19.592995 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5911fb6b-7542-4fcc-94df-f170453fa844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:19.708364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 721/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Aug 30 05:03:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:22.115444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c037121-26f9-4847-bb81-65ae767760d1 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:22.116008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c037121-26f9-4847-bb81-65ae767760d1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:22.116128 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c037121-26f9-4847-bb81-65ae767760d1 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:22.117469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 693/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 05:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:22.123025 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0168f-4d1e-46fb-a136-d72e98c8fae8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:22.123470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0168f-4d1e-46fb-a136-d72e98c8fae8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:22.123569 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0168f-4d1e-46fb-a136-d72e98c8fae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:22.190561 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b3e0168f-4d1e-46fb-a136-d72e98c8fae8 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:22.191723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b3e0168f-4d1e-46fb-a136-d72e98c8fae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:22.246537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:22.289606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 722/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 05:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:03:22.581033 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c037121-26f9-4847-bb81-65ae767760d1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:22.582634 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9c037121-26f9-4847-bb81-65ae767760d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:22.726467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c037121-26f9-4847-bb81-65ae767760d1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:22.798197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:22.838645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d774e-9c91-47df-9732-94b5b291b487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:22.839166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d774e-9c91-47df-9732-94b5b291b487 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:22.839559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d774e-9c91-47df-9732-94b5b291b487 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:22.839694 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d774e-9c91-47df-9732-94b5b291b487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:22.841300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7d8d774e-9c91-47df-9732-94b5b291b487 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:22.930154 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d774e-9c91-47df-9732-94b5b291b487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:22.931739 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d774e-9c91-47df-9732-94b5b291b487 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:22.949259 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 694/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:23.843839 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f68d1-c1b2-4fed-b648-807afa551ae8 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:23.844435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f68d1-c1b2-4fed-b648-807afa551ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:23.844435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f68d1-c1b2-4fed-b648-807afa551ae8 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:23.845780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 723/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 05:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:23.850760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537d50c-d4f5-48ba-901e-1031df29139f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:23.851206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537d50c-d4f5-48ba-901e-1031df29139f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:23.851315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537d50c-d4f5-48ba-901e-1031df29139f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:23.925746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3537d50c-d4f5-48ba-901e-1031df29139f None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:23.927466 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3537d50c-d4f5-48ba-901e-1031df29139f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:23.954194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:24.025478 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 695/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 05:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:24.176478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f68d1-c1b2-4fed-b648-807afa551ae8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:24.177994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-974f68d1-c1b2-4fed-b648-807afa551ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:24.325288 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f68d1-c1b2-4fed-b648-807afa551ae8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:24.365742 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:24.437738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725648d-450e-4c01-b3da-6af7da19f88b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:24.438256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725648d-450e-4c01-b3da-6af7da19f88b service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:24.438531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725648d-450e-4c01-b3da-6af7da19f88b service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:24.438796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725648d-450e-4c01-b3da-6af7da19f88b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:24.440409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c725648d-450e-4c01-b3da-6af7da19f88b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:24.529708 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725648d-450e-4c01-b3da-6af7da19f88b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:24.531298 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725648d-450e-4c01-b3da-6af7da19f88b service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:24.550280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 724/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:03:25.430100 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b9cc-c24b-4c4c-bd22-6eafbd4971ae None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:25.430687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b9cc-c24b-4c4c-bd22-6eafbd4971ae None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:25.430687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b9cc-c24b-4c4c-bd22-6eafbd4971ae None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:25.431999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 696/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 05:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:25.436927 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8381f-771e-4afc-8961-9128cf8cdf10 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:25.437364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8381f-771e-4afc-8961-9128cf8cdf10 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:25.437486 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8381f-771e-4afc-8961-9128cf8cdf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:25.492752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:25.514856 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-34f8381f-771e-4afc-8961-9128cf8cdf10 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:25.516103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-34f8381f-771e-4afc-8961-9128cf8cdf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:25.611918 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 725/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 05:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:25.763904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36b9cc-c24b-4c4c-bd22-6eafbd4971ae None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:25.765378 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3a36b9cc-c24b-4c4c-bd22-6eafbd4971ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:25.910118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36b9cc-c24b-4c4c-bd22-6eafbd4971ae None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:25.922316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:26.025869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fca09-8ea0-4baf-abf5-9aa28128bd25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:26.026397 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fca09-8ea0-4baf-abf5-9aa28128bd25 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:26.026670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fca09-8ea0-4baf-abf5-9aa28128bd25 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:26.026936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fca09-8ea0-4baf-abf5-9aa28128bd25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:26.028562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-eb6fca09-8ea0-4baf-abf5-9aa28128bd25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:26.116725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fca09-8ea0-4baf-abf5-9aa28128bd25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:26.118294 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fca09-8ea0-4baf-abf5-9aa28128bd25 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:26.136562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 697/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:03:26.994260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b6d4b-7097-4d36-8a47-fe5befa94560 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:26.994893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b6d4b-7097-4d36-8a47-fe5befa94560 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:26.994893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b6d4b-7097-4d36-8a47-fe5befa94560 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:26.996489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 726/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 05:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:27.001430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc5cb4-521c-4804-873b-a144fff34348 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:27.001836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc5cb4-521c-4804-873b-a144fff34348 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:27.001978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc5cb4-521c-4804-873b-a144fff34348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:27.022565 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:27.078241 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f0dc5cb4-521c-4804-873b-a144fff34348 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:27.079428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f0dc5cb4-521c-4804-873b-a144fff34348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:27.174832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 698/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 05:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:27.325071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b6d4b-7097-4d36-8a47-fe5befa94560 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:27.326395 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b28b6d4b-7097-4d36-8a47-fe5befa94560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:27.434768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:27.471124 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b6d4b-7097-4d36-8a47-fe5befa94560 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:27.583599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d199010-b8f1-4609-95d0-3758c3447650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:27.584153 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d199010-b8f1-4609-95d0-3758c3447650 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:27.584434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d199010-b8f1-4609-95d0-3758c3447650 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:27.584705 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d199010-b8f1-4609-95d0-3758c3447650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:27.586304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6d199010-b8f1-4609-95d0-3758c3447650 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:27.660994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:27.674735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d199010-b8f1-4609-95d0-3758c3447650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:27.676364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d199010-b8f1-4609-95d0-3758c3447650 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:27.695033 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 727/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:28.551460 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80628c28-4eb1-43db-917f-b6ca4ba65799 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:28.552142 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80628c28-4eb1-43db-917f-b6ca4ba65799 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:28.552142 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80628c28-4eb1-43db-917f-b6ca4ba65799 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:28.553399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 699/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 05:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:28.558372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcac8b-a2d7-47b8-b919-afc973d5c0d8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:28.558818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcac8b-a2d7-47b8-b919-afc973d5c0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:28.558920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcac8b-a2d7-47b8-b919-afc973d5c0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:28.635894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-acbcac8b-a2d7-47b8-b919-afc973d5c0d8 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:28.637139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-acbcac8b-a2d7-47b8-b919-afc973d5c0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:28.733082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 728/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 05:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:28.883927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80628c28-4eb1-43db-917f-b6ca4ba65799 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:28.885516 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-80628c28-4eb1-43db-917f-b6ca4ba65799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:28.969131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:29.034524 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80628c28-4eb1-43db-917f-b6ca4ba65799 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:29.149696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8069d4-55cb-4450-b3d7-687c21f63e38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:29.150208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8069d4-55cb-4450-b3d7-687c21f63e38 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:29.150483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8069d4-55cb-4450-b3d7-687c21f63e38 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:29.150752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8069d4-55cb-4450-b3d7-687c21f63e38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:29.152372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0a8069d4-55cb-4450-b3d7-687c21f63e38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:29.200465 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:29.242492 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8069d4-55cb-4450-b3d7-687c21f63e38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:29.244132 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8069d4-55cb-4450-b3d7-687c21f63e38 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:29.262688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 700/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:30.068529 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9b48e-099f-429b-91bb-13c9443fded2 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:30.069080 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9b48e-099f-429b-91bb-13c9443fded2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:30.069080 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9b48e-099f-429b-91bb-13c9443fded2 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:30.070386 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 729/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 05:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 05:03:30.075244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a7f2e-576f-4c5f-baba-54985bd55343 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:30.075671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a7f2e-576f-4c5f-baba-54985bd55343 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:30.075790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a7f2e-576f-4c5f-baba-54985bd55343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:30.151303 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-055a7f2e-576f-4c5f-baba-54985bd55343 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:30.152561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-055a7f2e-576f-4c5f-baba-54985bd55343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:30.256757 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 701/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 05:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:30.406266 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9b48e-099f-429b-91bb-13c9443fded2 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:30.407775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e3f9b48e-099f-429b-91bb-13c9443fded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:30.455693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:30.550252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9b48e-099f-429b-91bb-13c9443fded2 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:30.663227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674da1ee-1ed2-4aea-b169-fb7c6ac2e6e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:30.663828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674da1ee-1ed2-4aea-b169-fb7c6ac2e6e6 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:30.664129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674da1ee-1ed2-4aea-b169-fb7c6ac2e6e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:30.664398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674da1ee-1ed2-4aea-b169-fb7c6ac2e6e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:30.665982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-674da1ee-1ed2-4aea-b169-fb7c6ac2e6e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:30.673897 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:30.759354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674da1ee-1ed2-4aea-b169-fb7c6ac2e6e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:30.760976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674da1ee-1ed2-4aea-b169-fb7c6ac2e6e6 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:30.778466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 730/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:31.585024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccfab4-8940-415c-bff3-c4da1b9e7ebd None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:31.585552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccfab4-8940-415c-bff3-c4da1b9e7ebd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:31.585552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccfab4-8940-415c-bff3-c4da1b9e7ebd None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:31.586896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 702/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 05:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:31.592002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09275ad5-0d2a-4e93-98d6-4e3103a469dc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:31.592520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09275ad5-0d2a-4e93-98d6-4e3103a469dc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:31.592633 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09275ad5-0d2a-4e93-98d6-4e3103a469dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:31.669337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-09275ad5-0d2a-4e93-98d6-4e3103a469dc None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:31.670538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-09275ad5-0d2a-4e93-98d6-4e3103a469dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:31.737276 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:31.766434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 731/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 05:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:31.918995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dccfab4-8940-415c-bff3-c4da1b9e7ebd None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:31.920567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2dccfab4-8940-415c-bff3-c4da1b9e7ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:31.937883 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:32.066026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dccfab4-8940-415c-bff3-c4da1b9e7ebd None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:32.153528 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:32.180313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5d7a1-376f-4434-8ac3-0c8d46149319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:32.180853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5d7a1-376f-4434-8ac3-0c8d46149319 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:32.181128 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5d7a1-376f-4434-8ac3-0c8d46149319 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:32.181399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5d7a1-376f-4434-8ac3-0c8d46149319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:32.182996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-52e5d7a1-376f-4434-8ac3-0c8d46149319 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:32.273686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5d7a1-376f-4434-8ac3-0c8d46149319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:32.275286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5d7a1-376f-4434-8ac3-0c8d46149319 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:32.293302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 703/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:33.104005 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b7d61-4068-4e80-b8cd-943af181c98e None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:33.104551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b7d61-4068-4e80-b8cd-943af181c98e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:33.104653 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b7d61-4068-4e80-b8cd-943af181c98e None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:33.105992 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 732/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 05:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:33.110797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3b79e-6be1-41f3-8671-3213eb20e75c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:33.111245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3b79e-6be1-41f3-8671-3213eb20e75c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:33.111360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3b79e-6be1-41f3-8671-3213eb20e75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:33.188244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f1e3b79e-6be1-41f3-8671-3213eb20e75c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:33.189554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f1e3b79e-6be1-41f3-8671-3213eb20e75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:33.231113 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:33.285379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 704/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 05:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:33.434670 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b7d61-4068-4e80-b8cd-943af181c98e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:33.436180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bc6b7d61-4068-4e80-b8cd-943af181c98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:33.582210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b7d61-4068-4e80-b8cd-943af181c98e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:33.636421 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:33.694560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651ed24-1f88-4fe8-8b50-3f64eafd6011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:33.695091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651ed24-1f88-4fe8-8b50-3f64eafd6011 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:33.695370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651ed24-1f88-4fe8-8b50-3f64eafd6011 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:33.695639 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651ed24-1f88-4fe8-8b50-3f64eafd6011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:33.697256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d651ed24-1f88-4fe8-8b50-3f64eafd6011 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:33.786705 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651ed24-1f88-4fe8-8b50-3f64eafd6011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:33.788398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651ed24-1f88-4fe8-8b50-3f64eafd6011 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:33.806662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 733/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:03:34.616030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea65300-2c76-49fa-a178-4f5022a271ba None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:34.616565 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea65300-2c76-49fa-a178-4f5022a271ba None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:34.616696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea65300-2c76-49fa-a178-4f5022a271ba None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:34.618046 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 705/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 05:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:34.623498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5954d0-6c96-45fe-a2da-ee11eb112443 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:34.623910 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5954d0-6c96-45fe-a2da-ee11eb112443 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:34.624069 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5954d0-6c96-45fe-a2da-ee11eb112443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:34.700985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ee5954d0-6c96-45fe-a2da-ee11eb112443 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:34.702238 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ee5954d0-6c96-45fe-a2da-ee11eb112443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:34.704396 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:34.803709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 734/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 05:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:34.951635 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea65300-2c76-49fa-a178-4f5022a271ba None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:34.953207 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2ea65300-2c76-49fa-a178-4f5022a271ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:35.103706 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea65300-2c76-49fa-a178-4f5022a271ba None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:35.131534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:35.218794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4b973-58b7-4ab8-ad55-54b072200688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:35.219449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4b973-58b7-4ab8-ad55-54b072200688 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:35.219726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4b973-58b7-4ab8-ad55-54b072200688 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:35.220016 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4b973-58b7-4ab8-ad55-54b072200688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:35.221600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8bd4b973-58b7-4ab8-ad55-54b072200688 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:35.311437 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4b973-58b7-4ab8-ad55-54b072200688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:35.313055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4b973-58b7-4ab8-ad55-54b072200688 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:35.331251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 706/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:37.139335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfd22b-af56-4c95-86f8-94831dfefae7 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:37.139889 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfd22b-af56-4c95-86f8-94831dfefae7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:37.140056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfd22b-af56-4c95-86f8-94831dfefae7 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:37.141324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 735/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 05:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:37.147070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca951d-8347-4c4b-bf9e-8cef72a5977c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:37.147503 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca951d-8347-4c4b-bf9e-8cef72a5977c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:37.147617 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca951d-8347-4c4b-bf9e-8cef72a5977c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:37.188266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:37.214957 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-afca951d-8347-4c4b-bf9e-8cef72a5977c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:37.216432 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-afca951d-8347-4c4b-bf9e-8cef72a5977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:37.312350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 707/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 05:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:37.596858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfd22b-af56-4c95-86f8-94831dfefae7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:37.598431 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2bbfd22b-af56-4c95-86f8-94831dfefae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:37.700780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfd22b-af56-4c95-86f8-94831dfefae7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:37.733024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:37.775045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f7244-d9aa-469d-8b3c-88dccb6ec72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:37.775648 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f7244-d9aa-469d-8b3c-88dccb6ec72c service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:37.775921 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f7244-d9aa-469d-8b3c-88dccb6ec72c service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:37.776221 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f7244-d9aa-469d-8b3c-88dccb6ec72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:37.777826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ee7f7244-d9aa-469d-8b3c-88dccb6ec72c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:37.885761 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f7244-d9aa-469d-8b3c-88dccb6ec72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:37.887182 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f7244-d9aa-469d-8b3c-88dccb6ec72c service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:37.904784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 736/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:40.015162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ef058-cb1d-4ffe-bad2-e5038df990d2 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:40.015691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ef058-cb1d-4ffe-bad2-e5038df990d2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:40.015691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ef058-cb1d-4ffe-bad2-e5038df990d2 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:40.017070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 708/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 05:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:40.022373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1314d2c-9db8-4fd8-a694-ae5c5104f4a6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:40.022793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1314d2c-9db8-4fd8-a694-ae5c5104f4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:40.022929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1314d2c-9db8-4fd8-a694-ae5c5104f4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:40.090828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c1314d2c-9db8-4fd8-a694-ae5c5104f4a6 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:40.092101 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c1314d2c-9db8-4fd8-a694-ae5c5104f4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:40.105185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:40.190225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 737/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 05:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:40.476858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ef058-cb1d-4ffe-bad2-e5038df990d2 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:40.478412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3d9ef058-cb1d-4ffe-bad2-e5038df990d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:40.582212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ef058-cb1d-4ffe-bad2-e5038df990d2 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:40.594655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:40.656155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d266069-a69b-4df6-8118-6ecfc034137e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:40.656755 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d266069-a69b-4df6-8118-6ecfc034137e service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:40.657030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d266069-a69b-4df6-8118-6ecfc034137e service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:40.657296 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d266069-a69b-4df6-8118-6ecfc034137e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:40.658893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8d266069-a69b-4df6-8118-6ecfc034137e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:40.767308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d266069-a69b-4df6-8118-6ecfc034137e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:40.768690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d266069-a69b-4df6-8118-6ecfc034137e service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:40.786431 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 709/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:43.098130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef22799-0c59-44f6-a6ca-4406d9b136c9 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:43.098709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef22799-0c59-44f6-a6ca-4406d9b136c9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:43.098709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef22799-0c59-44f6-a6ca-4406d9b136c9 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:43.100056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 738/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 05:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:43.105336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422a086-d349-4be2-9b5a-73823f7c1411 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:43.105765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422a086-d349-4be2-9b5a-73823f7c1411 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:43.105866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422a086-d349-4be2-9b5a-73823f7c1411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:43.157225 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:43.175745 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5422a086-d349-4be2-9b5a-73823f7c1411 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:43.176984 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5422a086-d349-4be2-9b5a-73823f7c1411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:43.275587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 710/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 05:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:43.561433 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef22799-0c59-44f6-a6ca-4406d9b136c9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:43.563018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cef22799-0c59-44f6-a6ca-4406d9b136c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:43.665230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef22799-0c59-44f6-a6ca-4406d9b136c9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:43.705236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:43.739052 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d512fe-eafc-4135-a7c1-1e938508186d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:43.739650 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d512fe-eafc-4135-a7c1-1e938508186d service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:43.739930 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d512fe-eafc-4135-a7c1-1e938508186d service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:43.740780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d512fe-eafc-4135-a7c1-1e938508186d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:43.742380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-02d512fe-eafc-4135-a7c1-1e938508186d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:43.850148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d512fe-eafc-4135-a7c1-1e938508186d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:43.851576 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d512fe-eafc-4135-a7c1-1e938508186d service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:43.870010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 739/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:45.904410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993888a6-df22-4e56-9760-e4541b0dc39b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:45.904982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993888a6-df22-4e56-9760-e4541b0dc39b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:45.904982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993888a6-df22-4e56-9760-e4541b0dc39b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:45.906302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 711/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 05:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:45.911435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edbf8a-051a-41f0-adc0-9f7cf1e0d823 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:45.911829 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edbf8a-051a-41f0-adc0-9f7cf1e0d823 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:45.912579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edbf8a-051a-41f0-adc0-9f7cf1e0d823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:45.977794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-28edbf8a-051a-41f0-adc0-9f7cf1e0d823 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:45.978993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-28edbf8a-051a-41f0-adc0-9f7cf1e0d823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:46.000932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:46.078003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 740/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 05:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:46.356948 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993888a6-df22-4e56-9760-e4541b0dc39b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:46.358552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-993888a6-df22-4e56-9760-e4541b0dc39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:46.462007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993888a6-df22-4e56-9760-e4541b0dc39b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:46.481377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:46.536158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad656de-ce52-43e6-9c7c-fe6e57687e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:46.536769 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad656de-ce52-43e6-9c7c-fe6e57687e41 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:46.537048 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad656de-ce52-43e6-9c7c-fe6e57687e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:46.537321 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad656de-ce52-43e6-9c7c-fe6e57687e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:46.538928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-aad656de-ce52-43e6-9c7c-fe6e57687e41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:46.646208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad656de-ce52-43e6-9c7c-fe6e57687e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:46.647669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad656de-ce52-43e6-9c7c-fe6e57687e41 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:46.665384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 712/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:48.635388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb43c8e-2cce-4672-bdca-7eb3258a8563 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:48.635992 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb43c8e-2cce-4672-bdca-7eb3258a8563 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:48.635992 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb43c8e-2cce-4672-bdca-7eb3258a8563 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:48.637463 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 741/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 05:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:48.642973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03904cfa-bf92-4919-aff9-43c51518b5e3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:48.643362 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03904cfa-bf92-4919-aff9-43c51518b5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:48.643515 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03904cfa-bf92-4919-aff9-43c51518b5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:48.705838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:48.708607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-03904cfa-bf92-4919-aff9-43c51518b5e3 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:48.711024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-03904cfa-bf92-4919-aff9-43c51518b5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:48.808950 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 713/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 05:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:49.096096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb43c8e-2cce-4672-bdca-7eb3258a8563 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:49.097684 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1eb43c8e-2cce-4672-bdca-7eb3258a8563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:49.201874 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb43c8e-2cce-4672-bdca-7eb3258a8563 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:49.255738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:49.283150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f73f4-2daa-42ec-b7c0-f4a50abf4771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:49.283756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f73f4-2daa-42ec-b7c0-f4a50abf4771 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:49.284063 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f73f4-2daa-42ec-b7c0-f4a50abf4771 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:49.284341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f73f4-2daa-42ec-b7c0-f4a50abf4771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:49.285955 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bf4f73f4-2daa-42ec-b7c0-f4a50abf4771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:49.393476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f73f4-2daa-42ec-b7c0-f4a50abf4771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:49.394904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f73f4-2daa-42ec-b7c0-f4a50abf4771 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:49.413583 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 742/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:51.407927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0685e-c870-44bb-a30a-f170ee0fea21 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:51.408525 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0685e-c870-44bb-a30a-f170ee0fea21 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:51.408525 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0685e-c870-44bb-a30a-f170ee0fea21 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:51.409842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 714/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 05:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:51.415508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac085013-7052-4b27-b61c-295c6388784e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:51.415924 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac085013-7052-4b27-b61c-295c6388784e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:51.416097 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac085013-7052-4b27-b61c-295c6388784e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:51.485732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ac085013-7052-4b27-b61c-295c6388784e None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:51.486952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ac085013-7052-4b27-b61c-295c6388784e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:51.516342 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:51.583607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 743/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 05:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:51.864520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0685e-c870-44bb-a30a-f170ee0fea21 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:51.866688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-edb0685e-c870-44bb-a30a-f170ee0fea21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:51.967516 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0685e-c870-44bb-a30a-f170ee0fea21 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:51.997071 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:52.042667 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c665f-295d-4cc9-af02-66ac9370a57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:52.043276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c665f-295d-4cc9-af02-66ac9370a57b service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:52.043552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c665f-295d-4cc9-af02-66ac9370a57b service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:52.043824 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c665f-295d-4cc9-af02-66ac9370a57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:52.045472 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fb4c665f-295d-4cc9-af02-66ac9370a57b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:52.153349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c665f-295d-4cc9-af02-66ac9370a57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:52.154672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c665f-295d-4cc9-af02-66ac9370a57b service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:52.173151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 715/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:54.134650 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7699af-5628-4e68-98c2-68de372b13bb None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:54.135209 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7699af-5628-4e68-98c2-68de372b13bb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:54.135209 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7699af-5628-4e68-98c2-68de372b13bb None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:54.136602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 744/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 05:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:54.141783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c269be1-d8b1-48a4-b30e-72e5028fd463 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:54.142197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c269be1-d8b1-48a4-b30e-72e5028fd463 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:54.142322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c269be1-d8b1-48a4-b30e-72e5028fd463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:54.208500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1c269be1-d8b1-48a4-b30e-72e5028fd463 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:54.209929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1c269be1-d8b1-48a4-b30e-72e5028fd463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:54.218654 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:54.308954 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 716/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 05:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:03:54.587225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7699af-5628-4e68-98c2-68de372b13bb None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:54.588801 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6e7699af-5628-4e68-98c2-68de372b13bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:54.692044 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7699af-5628-4e68-98c2-68de372b13bb None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:54.750107 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:54.769510 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55794f23-2544-4f37-b17f-6f94406173c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:54.770119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55794f23-2544-4f37-b17f-6f94406173c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:54.770391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55794f23-2544-4f37-b17f-6f94406173c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:54.770656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55794f23-2544-4f37-b17f-6f94406173c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:54.772303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-55794f23-2544-4f37-b17f-6f94406173c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:54.880625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55794f23-2544-4f37-b17f-6f94406173c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:54.882062 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55794f23-2544-4f37-b17f-6f94406173c9 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:54.900564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 745/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:56.853420 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e66d5-2da6-4044-9fe3-5e14e56a3caf None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:56.853963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e66d5-2da6-4044-9fe3-5e14e56a3caf None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:56.853963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e66d5-2da6-4044-9fe3-5e14e56a3caf None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:56.855344 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 717/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 05:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:56.860756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be576f5a-05de-4a25-800e-1ba259c8d4b8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:56.861191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be576f5a-05de-4a25-800e-1ba259c8d4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:56.861306 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be576f5a-05de-4a25-800e-1ba259c8d4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:56.927438 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-be576f5a-05de-4a25-800e-1ba259c8d4b8 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:56.928692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-be576f5a-05de-4a25-800e-1ba259c8d4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:56.967186 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:57.026478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 746/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 05:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:03:57.311813 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e66d5-2da6-4044-9fe3-5e14e56a3caf None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:57.313365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5b5e66d5-2da6-4044-9fe3-5e14e56a3caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:57.416204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e66d5-2da6-4044-9fe3-5e14e56a3caf None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:57.453692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:57.489412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001aee9f-da16-41a4-8d55-a6a4d4e6c286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:57.490007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001aee9f-da16-41a4-8d55-a6a4d4e6c286 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:57.490280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001aee9f-da16-41a4-8d55-a6a4d4e6c286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:57.490545 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001aee9f-da16-41a4-8d55-a6a4d4e6c286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:57.492206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-001aee9f-da16-41a4-8d55-a6a4d4e6c286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:57.600329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001aee9f-da16-41a4-8d55-a6a4d4e6c286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:57.601789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001aee9f-da16-41a4-8d55-a6a4d4e6c286 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:57.619843 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 718/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:59.587189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e65182-5903-4099-b1af-3f7c16378ce4 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:59.587795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e65182-5903-4099-b1af-3f7c16378ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:59.587795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e65182-5903-4099-b1af-3f7c16378ce4 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:59.589099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 747/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 05:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:03:59.594271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261195c-8d7b-4c47-b986-b35c8cab5308 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:59.594729 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261195c-8d7b-4c47-b986-b35c8cab5308 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:59.594835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261195c-8d7b-4c47-b986-b35c8cab5308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:59.660851 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5261195c-8d7b-4c47-b986-b35c8cab5308 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:03:59.661971 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5261195c-8d7b-4c47-b986-b35c8cab5308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:59.679774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:59.759122 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 719/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 05:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:04:00.045028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e65182-5903-4099-b1af-3f7c16378ce4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:04:00.046571 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-36e65182-5903-4099-b1af-3f7c16378ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:00.150694 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e65182-5903-4099-b1af-3f7c16378ce4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:04:00.218742 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:00.225671 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5eabc-2bee-4ad4-9d2e-3c2f426e5453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:04:00.226825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5eabc-2bee-4ad4-9d2e-3c2f426e5453 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:00.227100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5eabc-2bee-4ad4-9d2e-3c2f426e5453 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:00.227365 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5eabc-2bee-4ad4-9d2e-3c2f426e5453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:00.229003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cdf5eabc-2bee-4ad4-9d2e-3c2f426e5453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:00.336040 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5eabc-2bee-4ad4-9d2e-3c2f426e5453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:04:00.337398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5eabc-2bee-4ad4-9d2e-3c2f426e5453 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:04:00.355317 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 748/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:04:02.278324 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9da95a-81dd-4268-bbd4-2bde4d12d283 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:02.278839 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9da95a-81dd-4268-bbd4-2bde4d12d283 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:02.278839 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9da95a-81dd-4268-bbd4-2bde4d12d283 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:02.280211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 720/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 05:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:04:02.285347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600d681-724f-4802-9663-1d6c2a6fa90a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:02.285757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600d681-724f-4802-9663-1d6c2a6fa90a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:02.285886 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600d681-724f-4802-9663-1d6c2a6fa90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:02.350584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d600d681-724f-4802-9663-1d6c2a6fa90a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:04:02.351812 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d600d681-724f-4802-9663-1d6c2a6fa90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:02.399755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:02.448568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 749/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 05:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:04:02.740008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9da95a-81dd-4268-bbd4-2bde4d12d283 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:04:02.741583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4d9da95a-81dd-4268-bbd4-2bde4d12d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:02.861567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9da95a-81dd-4268-bbd4-2bde4d12d283 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:04:02.909041 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:02.936252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef308e-a0b0-42c2-85ec-db9d5fbe27fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:04:02.936859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef308e-a0b0-42c2-85ec-db9d5fbe27fe service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:02.937188 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef308e-a0b0-42c2-85ec-db9d5fbe27fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:02.937466 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef308e-a0b0-42c2-85ec-db9d5fbe27fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:02.939071 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a3ef308e-a0b0-42c2-85ec-db9d5fbe27fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:03.048805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef308e-a0b0-42c2-85ec-db9d5fbe27fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:04:03.050230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef308e-a0b0-42c2-85ec-db9d5fbe27fe service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:04:03.069135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 721/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:04:12.446761 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=22 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:13.066903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=66 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:22.582046 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40734358-1f21-4af7-98e3-294d6742abb9 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:22.582648 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40734358-1f21-4af7-98e3-294d6742abb9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:22.582648 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40734358-1f21-4af7-98e3-294d6742abb9 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:22.583923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 750/1471] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:04:22.589622 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afd634-6349-40c3-a4ff-d53c4a909f05 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:22.590068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afd634-6349-40c3-a4ff-d53c4a909f05 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:22.590176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afd634-6349-40c3-a4ff-d53c4a909f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:22.656840 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-65afd634-6349-40c3-a4ff-d53c4a909f05 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:04:22.658085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-65afd634-6349-40c3-a4ff-d53c4a909f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:22.754172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 722/1472] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:04:23.048630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c28cf4-0f7b-492c-8f3b-5002b67cac88 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:23.048915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c28cf4-0f7b-492c-8f3b-5002b67cac88 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:23.049185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c28cf4-0f7b-492c-8f3b-5002b67cac88 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:23.050557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 751/1473] 10.222.0.48 () {54 vars in 967 bytes} [Tue Aug 30 05:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:04:23.055844 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdae2e-e8d8-4b79-9eb8-e3b643bc3bbb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:23.056157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdae2e-e8d8-4b79-9eb8-e3b643bc3bbb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:23.056425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdae2e-e8d8-4b79-9eb8-e3b643bc3bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:23.132530 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-20bdae2e-e8d8-4b79-9eb8-e3b643bc3bbb None None] MFA Rules not processed for user `77d3889156524b388b761cedfac8ed6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:04:23.134378 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-20bdae2e-e8d8-4b79-9eb8-e3b643bc3bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:23.154419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:23.214413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 723/1474] 10.222.0.48 () {58 vars in 1064 bytes} [Tue Aug 30 05:04:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:04:23.222069 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c28cf4-0f7b-492c-8f3b-5002b67cac88 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:04:23.223574 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f5c28cf4-0f7b-492c-8f3b-5002b67cac88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:23.327701 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c28cf4-0f7b-492c-8f3b-5002b67cac88 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:04:23.400486 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671adf6f-e5aa-4518-83a7-bf1d955688fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d3889156524b388b761cedfac8ed6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:04:23.401092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671adf6f-e5aa-4518-83a7-bf1d955688fd service glance] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:23.401369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671adf6f-e5aa-4518-83a7-bf1d955688fd service glance] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:23.401640 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671adf6f-e5aa-4518-83a7-bf1d955688fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:23.403244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-671adf6f-e5aa-4518-83a7-bf1d955688fd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:23.457995 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:23.515080 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671adf6f-e5aa-4518-83a7-bf1d955688fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:04:23.516567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671adf6f-e5aa-4518-83a7-bf1d955688fd service glance] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:04:23.652398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 752/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:04:25.647151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6517fb-c291-460e-9ac8-eb94713f43ca None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:25.647713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6517fb-c291-460e-9ac8-eb94713f43ca None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:25.647713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6517fb-c291-460e-9ac8-eb94713f43ca None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:25.649618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 724/1476] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:04:25.655054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d959b-1ddf-4bc8-bb94-87811f16a2cb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:25.655465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d959b-1ddf-4bc8-bb94-87811f16a2cb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:25.655605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d959b-1ddf-4bc8-bb94-87811f16a2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:25.721083 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-126d959b-1ddf-4bc8-bb94-87811f16a2cb None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:04:25.722293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-126d959b-1ddf-4bc8-bb94-87811f16a2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:25.817338 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 753/1477] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:04:26.089247 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6517fb-c291-460e-9ac8-eb94713f43ca None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:04:26.090812 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1d6517fb-c291-460e-9ac8-eb94713f43ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:26.216290 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6517fb-c291-460e-9ac8-eb94713f43ca None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:04:26.264966 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:26.309917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452ffc4-eacc-4ec4-96d4-5c403ebdd1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:04:26.310601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452ffc4-eacc-4ec4-96d4-5c403ebdd1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:26.310903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452ffc4-eacc-4ec4-96d4-5c403ebdd1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:26.311218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452ffc4-eacc-4ec4-96d4-5c403ebdd1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:26.311857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452ffc4-eacc-4ec4-96d4-5c403ebdd1a8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:04:26.313691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-8452ffc4-eacc-4ec4-96d4-5c403ebdd1a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 05:04:26.313691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 30 05:04:26.313691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: Aug 30 05:04:26.314866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452ffc4-eacc-4ec4-96d4-5c403ebdd1a8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:04:26.334250 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 725/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Aug 30 05:04:26 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:04:28.281732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8dc2f-c459-4f0b-8c09-1a4b6e931aed None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:28.282429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8dc2f-c459-4f0b-8c09-1a4b6e931aed None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:28.282429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8dc2f-c459-4f0b-8c09-1a4b6e931aed None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:28.283492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 754/1479] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:04:28.288860 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452b3ed-187d-4cef-9b96-43154a2e0d68 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:28.289335 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452b3ed-187d-4cef-9b96-43154a2e0d68 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:28.289482 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452b3ed-187d-4cef-9b96-43154a2e0d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:28.365274 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5452b3ed-187d-4cef-9b96-43154a2e0d68 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:04:28.366886 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5452b3ed-187d-4cef-9b96-43154a2e0d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:28.467664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 726/1480] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:04:28.758586 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8dc2f-c459-4f0b-8c09-1a4b6e931aed None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:04:28.760332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-48e8dc2f-c459-4f0b-8c09-1a4b6e931aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:28.770100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:28.909790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8dc2f-c459-4f0b-8c09-1a4b6e931aed None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:04:28.997023 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:29.031360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a82b0f-8750-41f6-847b-e0db6b62f682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:04:29.031970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a82b0f-8750-41f6-847b-e0db6b62f682 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:29.032255 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a82b0f-8750-41f6-847b-e0db6b62f682 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:29.032515 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a82b0f-8750-41f6-847b-e0db6b62f682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:29.034107 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-20a82b0f-8750-41f6-847b-e0db6b62f682 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:29.122831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a82b0f-8750-41f6-847b-e0db6b62f682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:04:29.124689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a82b0f-8750-41f6-847b-e0db6b62f682 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:04:29.142101 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 755/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:04:31.275137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4871b2e-0c2c-4831-9a9e-20c7153e0829 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:31.275755 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4871b2e-0c2c-4831-9a9e-20c7153e0829 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:31.275755 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4871b2e-0c2c-4831-9a9e-20c7153e0829 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:31.277085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 727/1482] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:04:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:04:31.282340 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a0206-0199-4ddc-bea2-0eb9d57c8009 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:31.282766 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a0206-0199-4ddc-bea2-0eb9d57c8009 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:31.282871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a0206-0199-4ddc-bea2-0eb9d57c8009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:31.348683 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4d8a0206-0199-4ddc-bea2-0eb9d57c8009 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:04:31.349923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4d8a0206-0199-4ddc-bea2-0eb9d57c8009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:31.396387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:31.446923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 756/1483] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:04:31.735565 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4871b2e-0c2c-4831-9a9e-20c7153e0829 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:04:31.737149 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d4871b2e-0c2c-4831-9a9e-20c7153e0829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:31.761953 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:31.841303 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4871b2e-0c2c-4831-9a9e-20c7153e0829 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:04:31.914405 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7ba4a-067c-4020-9fae-e4bd48be82d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:04:31.915009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7ba4a-067c-4020-9fae-e4bd48be82d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:31.915279 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7ba4a-067c-4020-9fae-e4bd48be82d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:31.915540 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7ba4a-067c-4020-9fae-e4bd48be82d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:31.917169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-aad7ba4a-067c-4020-9fae-e4bd48be82d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:31.996521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:32.037864 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7ba4a-067c-4020-9fae-e4bd48be82d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:04:32.039297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7ba4a-067c-4020-9fae-e4bd48be82d5 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:04:32.057665 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 728/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:04:34.056150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de2f7c-5f06-42d9-952f-e66916f3c0e6 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:34.056700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de2f7c-5f06-42d9-952f-e66916f3c0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:34.056700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de2f7c-5f06-42d9-952f-e66916f3c0e6 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:34.058007 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 757/1485] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:04:34.063207 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48478f3-3490-4bdc-a559-b76764464323 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:34.063640 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48478f3-3490-4bdc-a559-b76764464323 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:34.063746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48478f3-3490-4bdc-a559-b76764464323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:34.135095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b48478f3-3490-4bdc-a559-b76764464323 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:04:34.136394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b48478f3-3490-4bdc-a559-b76764464323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:34.237592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 729/1486] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:04:34.542749 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de2f7c-5f06-42d9-952f-e66916f3c0e6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:04:34.544320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e9de2f7c-5f06-42d9-952f-e66916f3c0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:34.646199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de2f7c-5f06-42d9-952f-e66916f3c0e6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:04:34.719372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:34.721354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0c1f5-9a90-4784-abe8-3cc2fa0df099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:04:34.721973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0c1f5-9a90-4784-abe8-3cc2fa0df099 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:34.722438 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0c1f5-9a90-4784-abe8-3cc2fa0df099 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:34.722877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0c1f5-9a90-4784-abe8-3cc2fa0df099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:34.724692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-30d0c1f5-9a90-4784-abe8-3cc2fa0df099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:34.835383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0c1f5-9a90-4784-abe8-3cc2fa0df099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:04:34.837362 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0c1f5-9a90-4784-abe8-3cc2fa0df099 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:04:34.854970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 758/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:04:36.859078 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0971d-6239-4df0-ad2f-e85628fcfa55 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:36.859662 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0971d-6239-4df0-ad2f-e85628fcfa55 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:36.859662 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0971d-6239-4df0-ad2f-e85628fcfa55 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:36.861029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 730/1488] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:04:36.866134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1405257-7f0a-4605-a362-43541db529bf None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:36.866581 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1405257-7f0a-4605-a362-43541db529bf None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:36.866695 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1405257-7f0a-4605-a362-43541db529bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:36.934165 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c1405257-7f0a-4605-a362-43541db529bf None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:04:36.935358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c1405257-7f0a-4605-a362-43541db529bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:36.987242 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:37.031041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 759/1489] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:04:37.334270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0971d-6239-4df0-ad2f-e85628fcfa55 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:04:37.337000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-eed0971d-6239-4df0-ad2f-e85628fcfa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:37.376924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:37.444306 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0971d-6239-4df0-ad2f-e85628fcfa55 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:04:37.517250 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536aa524-38fc-451c-bda8-639a15880a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:04:37.517848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536aa524-38fc-451c-bda8-639a15880a2f service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:37.518120 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536aa524-38fc-451c-bda8-639a15880a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:37.518381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536aa524-38fc-451c-bda8-639a15880a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:37.519995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-536aa524-38fc-451c-bda8-639a15880a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:37.601085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:37.633990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536aa524-38fc-451c-bda8-639a15880a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:04:37.635514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536aa524-38fc-451c-bda8-639a15880a2f service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:04:37.654269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 731/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:04:39.847377 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44411655-776b-46c9-b1f8-5d9fdd5b0964 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:39.847988 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44411655-776b-46c9-b1f8-5d9fdd5b0964 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:39.847988 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44411655-776b-46c9-b1f8-5d9fdd5b0964 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:39.849260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 760/1491] 10.222.0.48 () {54 vars in 927 bytes} [Tue Aug 30 05:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:04:39.854476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e250fa-e089-4e62-8ff1-c9a0a6a956cc None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:39.854891 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e250fa-e089-4e62-8ff1-c9a0a6a956cc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:39.854991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e250fa-e089-4e62-8ff1-c9a0a6a956cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:39.922367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b9e250fa-e089-4e62-8ff1-c9a0a6a956cc None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:04:39.923604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b9e250fa-e089-4e62-8ff1-c9a0a6a956cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:40.020943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 732/1492] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Aug 30 05:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:04:40.307351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44411655-776b-46c9-b1f8-5d9fdd5b0964 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:04:40.308935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-44411655-776b-46c9-b1f8-5d9fdd5b0964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:40.410018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44411655-776b-46c9-b1f8-5d9fdd5b0964 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:04:40.486748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f84f72-7b4f-47ab-a782-47a39fedb25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:04:40.487393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f84f72-7b4f-47ab-a782-47a39fedb25c service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:40.487757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f84f72-7b4f-47ab-a782-47a39fedb25c service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:40.488158 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f84f72-7b4f-47ab-a782-47a39fedb25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:40.490314 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-91f84f72-7b4f-47ab-a782-47a39fedb25c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:40.500845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:40.600723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f84f72-7b4f-47ab-a782-47a39fedb25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:04:40.602164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f84f72-7b4f-47ab-a782-47a39fedb25c service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:04:40.623252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 761/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:04:50.019145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=82 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:50.619127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=50 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:01.262812 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738888b-b7a5-4b82-9229-b823e1e977dc None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:01.263375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738888b-b7a5-4b82-9229-b823e1e977dc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:01.263375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738888b-b7a5-4b82-9229-b823e1e977dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:01.338411 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4738888b-b7a5-4b82-9229-b823e1e977dc None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:06:01.339620 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4738888b-b7a5-4b82-9229-b823e1e977dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:01.434874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 733/1494] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:06:01.442883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968798-5afe-472f-be04-b35b0c0e4b8f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:01.443410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968798-5afe-472f-be04-b35b0c0e4b8f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:01.443642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968798-5afe-472f-be04-b35b0c0e4b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:01.528396 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b7968798-5afe-472f-be04-b35b0c0e4b8f None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:06:01.529531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b7968798-5afe-472f-be04-b35b0c0e4b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:01.628976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 762/1495] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:06:01.633603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738888b-b7a5-4b82-9229-b823e1e977dc None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:01.634837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4738888b-b7a5-4b82-9229-b823e1e977dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:01.646184 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738888b-b7a5-4b82-9229-b823e1e977dc None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:01.720552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:01.760947 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172b393-98fe-4c97-8517-bac16aa79e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:01.761563 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172b393-98fe-4c97-8517-bac16aa79e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:01.761834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172b393-98fe-4c97-8517-bac16aa79e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:01.762099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172b393-98fe-4c97-8517-bac16aa79e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:01.762740 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172b393-98fe-4c97-8517-bac16aa79e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:06:01.763031 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172b393-98fe-4c97-8517-bac16aa79e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:01.764071 dv-cinder-853910-4-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-a172b393-98fe-4c97-8517-bac16aa79e1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 05:06:01.764071 dv-cinder-853910-4-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 30 05:06:01.764071 dv-cinder-853910-4-smb devstack@keystone.service[81675]: Aug 30 05:06:01.764976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172b393-98fe-4c97-8517-bac16aa79e1d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:01.777737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 734/1496] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:06:01.786084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7968798-5afe-472f-be04-b35b0c0e4b8f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:01.796130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7968798-5afe-472f-be04-b35b0c0e4b8f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:01.862044 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:01.897658 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a8dde-1591-4479-a08b-0a24cb6bb7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:01.898260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a8dde-1591-4479-a08b-0a24cb6bb7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:01.898532 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a8dde-1591-4479-a08b-0a24cb6bb7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:01.898798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a8dde-1591-4479-a08b-0a24cb6bb7e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:01.899436 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a8dde-1591-4479-a08b-0a24cb6bb7e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:01.901745 dv-cinder-853910-4-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-1c0a8dde-1591-4479-a08b-0a24cb6bb7e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 05:06:01.901745 dv-cinder-853910-4-smb devstack@keystone.service[81676]: warnings.warn(msg) Aug 30 05:06:01.901745 dv-cinder-853910-4-smb devstack@keystone.service[81676]: Aug 30 05:06:01.902921 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a8dde-1591-4479-a08b-0a24cb6bb7e2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:01.958873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 763/1497] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:06:01 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:06:01.963062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172b393-98fe-4c97-8517-bac16aa79e1d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:01.964612 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a172b393-98fe-4c97-8517-bac16aa79e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:01.998401 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172b393-98fe-4c97-8517-bac16aa79e1d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:02.093237 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1744d5-ea8a-4f79-a58e-d0438d80cfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:02.093753 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1744d5-ea8a-4f79-a58e-d0438d80cfe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:02.094030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1744d5-ea8a-4f79-a58e-d0438d80cfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:02.094301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1744d5-ea8a-4f79-a58e-d0438d80cfe1 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:02.094939 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1744d5-ea8a-4f79-a58e-d0438d80cfe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:02.095957 dv-cinder-853910-4-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-dd1744d5-ea8a-4f79-a58e-d0438d80cfe1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 05:06:02.095957 dv-cinder-853910-4-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 30 05:06:02.095957 dv-cinder-853910-4-smb devstack@keystone.service[81675]: Aug 30 05:06:02.097184 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1744d5-ea8a-4f79-a58e-d0438d80cfe1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:02.139938 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 735/1498] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:06:01 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:06:02.144068 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a8dde-1591-4479-a08b-0a24cb6bb7e2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:02.145593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1c0a8dde-1591-4479-a08b-0a24cb6bb7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:02.206261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a8dde-1591-4479-a08b-0a24cb6bb7e2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:02.291800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:02.302873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89917b9-22e9-4935-9b3a-83c648d763b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:02.303473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89917b9-22e9-4935-9b3a-83c648d763b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:02.303744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89917b9-22e9-4935-9b3a-83c648d763b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:02.304041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89917b9-22e9-4935-9b3a-83c648d763b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:02.304671 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89917b9-22e9-4935-9b3a-83c648d763b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:02.305665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-b89917b9-22e9-4935-9b3a-83c648d763b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 05:06:02.305665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: warnings.warn(msg) Aug 30 05:06:02.305665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: Aug 30 05:06:02.306571 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89917b9-22e9-4935-9b3a-83c648d763b5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:02.318599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 764/1499] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:06:02.322667 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1744d5-ea8a-4f79-a58e-d0438d80cfe1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:02.324211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dd1744d5-ea8a-4f79-a58e-d0438d80cfe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:02.335420 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1744d5-ea8a-4f79-a58e-d0438d80cfe1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:02.361656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:02.431387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc5c34-e147-4b7d-b859-9ebff163a505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:02.432008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc5c34-e147-4b7d-b859-9ebff163a505 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:02.432286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc5c34-e147-4b7d-b859-9ebff163a505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:02.432553 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc5c34-e147-4b7d-b859-9ebff163a505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:02.433192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc5c34-e147-4b7d-b859-9ebff163a505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:02.434204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-52bc5c34-e147-4b7d-b859-9ebff163a505 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 05:06:02.434204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 30 05:06:02.434204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: Aug 30 05:06:02.435093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc5c34-e147-4b7d-b859-9ebff163a505 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:02.447704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 736/1500] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:06:02.451973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89917b9-22e9-4935-9b3a-83c648d763b5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:02.453541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b89917b9-22e9-4935-9b3a-83c648d763b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:02.486236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89917b9-22e9-4935-9b3a-83c648d763b5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:02.578640 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22993db-6933-4ed4-a01a-d921655adda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:02.579288 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22993db-6933-4ed4-a01a-d921655adda1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:02.579560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22993db-6933-4ed4-a01a-d921655adda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:02.579824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22993db-6933-4ed4-a01a-d921655adda1 admin admin] PATH_INFO: `/v3/projects/833e1d6d2bea4ad887ffd6bc4c7cdca4/users/f7f3cdb600c340439cda7ff5967b717b/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:02.601535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22993db-6933-4ed4-a01a-d921655adda1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=833e1d6d2bea4ad887ffd6bc4c7cdca4, user_id=f7f3cdb600c340439cda7ff5967b717b, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:02.602548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-e22993db-6933-4ed4-a01a-d921655adda1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 05:06:02.602548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: warnings.warn(msg) Aug 30 05:06:02.602548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: Aug 30 05:06:02.604565 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22993db-6933-4ed4-a01a-d921655adda1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:02.629042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 765/1501] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:06:02 2022] PUT /identity/v3/projects/833e1d6d2bea4ad887ffd6bc4c7cdca4/users/f7f3cdb600c340439cda7ff5967b717b/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:06:02.641599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecb943-c510-44e2-b0b6-8237808a2935 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:02.641887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecb943-c510-44e2-b0b6-8237808a2935 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:02.642161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecb943-c510-44e2-b0b6-8237808a2935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:02.698481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-33ecb943-c510-44e2-b0b6-8237808a2935 None None] MFA Rules not processed for user `f7f3cdb600c340439cda7ff5967b717b`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:06:02.699670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-33ecb943-c510-44e2-b0b6-8237808a2935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:02.779151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 737/1502] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:06:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:06:02.792308 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e57d3-ac8d-418a-8c6e-6f038d51ed43 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:02.792591 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e57d3-ac8d-418a-8c6e-6f038d51ed43 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:02.792859 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e57d3-ac8d-418a-8c6e-6f038d51ed43 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:02.794170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 766/1503] 10.222.0.48 () {54 vars in 964 bytes} [Tue Aug 30 05:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:06:02.799022 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a5603-c0ba-4944-880c-0c634c7c491a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:02.799308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a5603-c0ba-4944-880c-0c634c7c491a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:02.799577 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a5603-c0ba-4944-880c-0c634c7c491a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:02.832049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:02.996327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-db8a5603-c0ba-4944-880c-0c634c7c491a None None] MFA Rules not processed for user `eee3162303924aaeb91af567f02980e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:06:02.997553 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-db8a5603-c0ba-4944-880c-0c634c7c491a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:03.073926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 738/1504] 10.222.0.48 () {58 vars in 1061 bytes} [Tue Aug 30 05:06:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:06:03.081811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e57d3-ac8d-418a-8c6e-6f038d51ed43 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:03.083337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a88e57d3-ac8d-418a-8c6e-6f038d51ed43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:03.132404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:03.186544 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e57d3-ac8d-418a-8c6e-6f038d51ed43 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:03.258994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837054eb-d289-4ad7-abfa-b3e6e460f9a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:03.259526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837054eb-d289-4ad7-abfa-b3e6e460f9a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:03.259804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837054eb-d289-4ad7-abfa-b3e6e460f9a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:03.260101 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837054eb-d289-4ad7-abfa-b3e6e460f9a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:03.261699 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-837054eb-d289-4ad7-abfa-b3e6e460f9a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:03.359204 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837054eb-d289-4ad7-abfa-b3e6e460f9a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:03.360660 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837054eb-d289-4ad7-abfa-b3e6e460f9a3 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:03.364129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:03.379916 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 767/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:06:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:06:03.424169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a614f7-6d7d-4b12-bfa5-161f614bc05a None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:03.424613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a614f7-6d7d-4b12-bfa5-161f614bc05a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:03.424724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a614f7-6d7d-4b12-bfa5-161f614bc05a None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:03.425945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 739/1506] 10.222.0.48 () {52 vars in 830 bytes} [Tue Aug 30 05:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:06:03.429531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837054eb-d289-4ad7-abfa-b3e6e460f9a3 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:03.430783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-837054eb-d289-4ad7-abfa-b3e6e460f9a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:03.530406 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837054eb-d289-4ad7-abfa-b3e6e460f9a3 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:03.624542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45005a4e-5a8e-4b0c-8685-b2b2ee595df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:03.625157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45005a4e-5a8e-4b0c-8685-b2b2ee595df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:03.625433 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45005a4e-5a8e-4b0c-8685-b2b2ee595df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:03.625705 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45005a4e-5a8e-4b0c-8685-b2b2ee595df5 admin admin] PATH_INFO: `/v3/users/f7f3cdb600c340439cda7ff5967b717b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:03.638028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45005a4e-5a8e-4b0c-8685-b2b2ee595df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f3cdb600c340439cda7ff5967b717b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:03.639053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-45005a4e-5a8e-4b0c-8685-b2b2ee595df5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 05:06:03.639053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: warnings.warn(msg) Aug 30 05:06:03.639053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: Aug 30 05:06:03.640444 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45005a4e-5a8e-4b0c-8685-b2b2ee595df5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:03.650470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:03.707373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-45005a4e-5a8e-4b0c-8685-b2b2ee595df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f3cdb600c340439cda7ff5967b717b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:03.724638 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-45005a4e-5a8e-4b0c-8685-b2b2ee595df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f3cdb600c340439cda7ff5967b717b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:03.734435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-45005a4e-5a8e-4b0c-8685-b2b2ee595df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f3cdb600c340439cda7ff5967b717b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:03.734883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-45005a4e-5a8e-4b0c-8685-b2b2ee595df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f3cdb600c340439cda7ff5967b717b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:03.758513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-45005a4e-5a8e-4b0c-8685-b2b2ee595df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f3cdb600c340439cda7ff5967b717b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:03.764407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 768/1507] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:06:03 2022] DELETE /identity/v3/users/f7f3cdb600c340439cda7ff5967b717b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:06:03.768727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beabd46-5132-4cdf-857e-80be1eb458e2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:03.769008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beabd46-5132-4cdf-857e-80be1eb458e2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:03.769279 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beabd46-5132-4cdf-857e-80be1eb458e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:03.828327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8beabd46-5132-4cdf-857e-80be1eb458e2 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:06:03.829463 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8beabd46-5132-4cdf-857e-80be1eb458e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:03.903369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:03.916881 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 740/1508] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:06:03.926637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45005a4e-5a8e-4b0c-8685-b2b2ee595df5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:03.928054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-45005a4e-5a8e-4b0c-8685-b2b2ee595df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:04.027434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45005a4e-5a8e-4b0c-8685-b2b2ee595df5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:04.081305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:04.103000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909af43-a0a8-4270-ad3f-89cc3d392e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:04.103612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909af43-a0a8-4270-ad3f-89cc3d392e92 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:04.103882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909af43-a0a8-4270-ad3f-89cc3d392e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:04.104183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909af43-a0a8-4270-ad3f-89cc3d392e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:04.105857 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9909af43-a0a8-4270-ad3f-89cc3d392e92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:04.223151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909af43-a0a8-4270-ad3f-89cc3d392e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:04.224620 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909af43-a0a8-4270-ad3f-89cc3d392e92 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:04.242794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 769/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:06:04.606385 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beabd46-5132-4cdf-857e-80be1eb458e2 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:04.607611 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8beabd46-5132-4cdf-857e-80be1eb458e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:04.618963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beabd46-5132-4cdf-857e-80be1eb458e2 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:04.716809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87a47f-a042-4b8f-8961-80a632a20728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:04.717444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87a47f-a042-4b8f-8961-80a632a20728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:04.717720 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87a47f-a042-4b8f-8961-80a632a20728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:04.717991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87a47f-a042-4b8f-8961-80a632a20728 admin admin] PATH_INFO: `/v3/projects/833e1d6d2bea4ad887ffd6bc4c7cdca4` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:04.728403 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87a47f-a042-4b8f-8961-80a632a20728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=833e1d6d2bea4ad887ffd6bc4c7cdca4)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:04.729419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-3c87a47f-a042-4b8f-8961-80a632a20728 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 05:06:04.729419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 30 05:06:04.729419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: Aug 30 05:06:04.730599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87a47f-a042-4b8f-8961-80a632a20728 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:04.789134 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3c87a47f-a042-4b8f-8961-80a632a20728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '833e1d6d2bea4ad887ffd6bc4c7cdca4', 'request_id': 'req-3c87a47f-a042-4b8f-8961-80a632a20728'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:04.803091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3c87a47f-a042-4b8f-8961-80a632a20728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '833e1d6d2bea4ad887ffd6bc4c7cdca4', 'request_id': 'req-3c87a47f-a042-4b8f-8961-80a632a20728'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:04.809474 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3c87a47f-a042-4b8f-8961-80a632a20728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '833e1d6d2bea4ad887ffd6bc4c7cdca4', 'request_id': 'req-3c87a47f-a042-4b8f-8961-80a632a20728'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:04.836072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3c87a47f-a042-4b8f-8961-80a632a20728 admin admin] The token cache is being invalidate because project 833e1d6d2bea4ad887ffd6bc4c7cdca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:06:04.836364 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3c87a47f-a042-4b8f-8961-80a632a20728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:04.836871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3c87a47f-a042-4b8f-8961-80a632a20728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:04.838710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 741/1510] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:06:04 2022] DELETE /identity/v3/projects/833e1d6d2bea4ad887ffd6bc4c7cdca4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:06:14.240513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=62 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:14.834102 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:34.806417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43580246-a6bf-490e-8e7d-1ea50db616b1 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:34.806938 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43580246-a6bf-490e-8e7d-1ea50db616b1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:34.807043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43580246-a6bf-490e-8e7d-1ea50db616b1 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:34.808407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 770/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 05:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:07:34.813872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33162554-84b1-4dd8-8037-45eaf792ed03 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:34.814362 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33162554-84b1-4dd8-8037-45eaf792ed03 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:34.814468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33162554-84b1-4dd8-8037-45eaf792ed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:34.894442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-33162554-84b1-4dd8-8037-45eaf792ed03 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:07:34.895639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-33162554-84b1-4dd8-8037-45eaf792ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:34.998494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 742/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 05:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:07:35.152270 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43580246-a6bf-490e-8e7d-1ea50db616b1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:07:35.155009 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-43580246-a6bf-490e-8e7d-1ea50db616b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:35.273860 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43580246-a6bf-490e-8e7d-1ea50db616b1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:07:35.280156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf937d56-19c4-484d-8a41-5bd9526afe38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:07:35.280757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf937d56-19c4-484d-8a41-5bd9526afe38 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:35.281042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf937d56-19c4-484d-8a41-5bd9526afe38 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:35.281304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf937d56-19c4-484d-8a41-5bd9526afe38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:35.289181 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf937d56-19c4-484d-8a41-5bd9526afe38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:07:35.290744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf937d56-19c4-484d-8a41-5bd9526afe38 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:07:35.300778 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 771/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:07:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:07:36.139539 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40400d42-b5e9-4776-9d4e-d48315bdad1d None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:36.140121 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40400d42-b5e9-4776-9d4e-d48315bdad1d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:36.140121 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40400d42-b5e9-4776-9d4e-d48315bdad1d None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:36.141454 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 743/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 05:07:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:07:36.146385 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61e5e9-1297-463f-90d5-7235e930662a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:36.146828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61e5e9-1297-463f-90d5-7235e930662a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:36.146934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61e5e9-1297-463f-90d5-7235e930662a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:36.167576 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5a61e5e9-1297-463f-90d5-7235e930662a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:07:36.168803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5a61e5e9-1297-463f-90d5-7235e930662a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:36.176596 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 772/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 05:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:07:36.327624 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40400d42-b5e9-4776-9d4e-d48315bdad1d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:07:36.342199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40400d42-b5e9-4776-9d4e-d48315bdad1d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:07:36.347475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea908bf3-2323-4f11-ae2c-8a0e61f7d942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:07:36.348094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea908bf3-2323-4f11-ae2c-8a0e61f7d942 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:36.348369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea908bf3-2323-4f11-ae2c-8a0e61f7d942 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:36.348640 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea908bf3-2323-4f11-ae2c-8a0e61f7d942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:36.356513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea908bf3-2323-4f11-ae2c-8a0e61f7d942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:07:36.358097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea908bf3-2323-4f11-ae2c-8a0e61f7d942 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:07:36.367185 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 744/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:07:37.201976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2ac78-ad16-423a-945f-704a4b2f915d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:37.202513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2ac78-ad16-423a-945f-704a4b2f915d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:37.202513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2ac78-ad16-423a-945f-704a4b2f915d None None] PATH_INFO: `/v3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:37.203803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 773/1517] 10.222.0.33 () {54 vars in 925 bytes} [Tue Aug 30 05:07:37 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:07:37.209814 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c30a5-48e0-4ea3-b96d-137011722d85 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:37.210244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c30a5-48e0-4ea3-b96d-137011722d85 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:37.210352 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c30a5-48e0-4ea3-b96d-137011722d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:37.269867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-402c30a5-48e0-4ea3-b96d-137011722d85 None None] MFA Rules not processed for user `ed835047051142d2bc98bb1564e3a98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:07:37.271074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-402c30a5-48e0-4ea3-b96d-137011722d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:37.287271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:37.346467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 745/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Aug 30 05:07:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:07:41.158312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c701d07-f592-43ea-9c9d-3218431d482f None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:41.158851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c701d07-f592-43ea-9c9d-3218431d482f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:41.158851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c701d07-f592-43ea-9c9d-3218431d482f None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:41.160118 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 774/1519] 10.222.0.48 () {54 vars in 961 bytes} [Tue Aug 30 05:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:07:41.165364 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd6cc9-ec58-47c3-b837-90d22d442f81 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:41.165756 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd6cc9-ec58-47c3-b837-90d22d442f81 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:41.166042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd6cc9-ec58-47c3-b837-90d22d442f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:41.185770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4acd6cc9-ec58-47c3-b837-90d22d442f81 None None] MFA Rules not processed for user `ed835047051142d2bc98bb1564e3a98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:07:41.186955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4acd6cc9-ec58-47c3-b837-90d22d442f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:41.195640 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 746/1520] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Aug 30 05:07:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:07:41.203197 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c701d07-f592-43ea-9c9d-3218431d482f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:07:41.216564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c701d07-f592-43ea-9c9d-3218431d482f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:07:41.222794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae597aa-5a2a-4205-af76-83f584f8cbef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed835047051142d2bc98bb1564e3a98f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:07:41.223382 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae597aa-5a2a-4205-af76-83f584f8cbef service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:41.223660 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae597aa-5a2a-4205-af76-83f584f8cbef service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:41.223978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae597aa-5a2a-4205-af76-83f584f8cbef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:41.232252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae597aa-5a2a-4205-af76-83f584f8cbef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:07:41.234476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae597aa-5a2a-4205-af76-83f584f8cbef service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:07:41.243912 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 775/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:07:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:07:47.599324 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752318e-b615-4f66-824d-301aa0dca4f2 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:47.599904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752318e-b615-4f66-824d-301aa0dca4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:47.599904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752318e-b615-4f66-824d-301aa0dca4f2 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:47.601263 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 747/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 05:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:07:47.605982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a92bd-5423-4827-8ec8-6fad5af25779 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:47.606382 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a92bd-5423-4827-8ec8-6fad5af25779 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:47.606521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a92bd-5423-4827-8ec8-6fad5af25779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:47.626105 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d33a92bd-5423-4827-8ec8-6fad5af25779 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:07:47.627286 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d33a92bd-5423-4827-8ec8-6fad5af25779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:47.635243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 776/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 05:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:07:47.794137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752318e-b615-4f66-824d-301aa0dca4f2 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:07:47.809390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752318e-b615-4f66-824d-301aa0dca4f2 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:07:47.814754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a81695-8e28-4d10-b66c-83c5d98a45a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:07:47.815353 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a81695-8e28-4d10-b66c-83c5d98a45a4 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:47.815625 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a81695-8e28-4d10-b66c-83c5d98a45a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:47.815893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a81695-8e28-4d10-b66c-83c5d98a45a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:47.824456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a81695-8e28-4d10-b66c-83c5d98a45a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:07:47.826041 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a81695-8e28-4d10-b66c-83c5d98a45a4 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:07:47.836203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 748/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:07:48.668495 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862254b7-ffff-432c-b080-dd477dc57337 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:48.669096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862254b7-ffff-432c-b080-dd477dc57337 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:48.669096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862254b7-ffff-432c-b080-dd477dc57337 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:48.670935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 777/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 05:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:07:48.675963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78be1d8-4513-4fb2-ada8-e34d3e3c9e73 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:48.676364 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78be1d8-4513-4fb2-ada8-e34d3e3c9e73 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:48.676519 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78be1d8-4513-4fb2-ada8-e34d3e3c9e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:48.695523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d78be1d8-4513-4fb2-ada8-e34d3e3c9e73 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:07:48.696823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d78be1d8-4513-4fb2-ada8-e34d3e3c9e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:48.704715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 749/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 05:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:07:48.857153 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862254b7-ffff-432c-b080-dd477dc57337 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:07:48.871936 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862254b7-ffff-432c-b080-dd477dc57337 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:07:48.878061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588f443-b5e0-46c2-b6bf-84a29da64c97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:07:48.878650 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588f443-b5e0-46c2-b6bf-84a29da64c97 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:48.878925 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588f443-b5e0-46c2-b6bf-84a29da64c97 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:48.879195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588f443-b5e0-46c2-b6bf-84a29da64c97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:48.887932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588f443-b5e0-46c2-b6bf-84a29da64c97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:07:48.889661 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588f443-b5e0-46c2-b6bf-84a29da64c97 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:07:48.901578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 778/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:07:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:07:52.669873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3593724-f754-49b4-bfc9-9f41f08a1b5f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:52.671049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3593724-f754-49b4-bfc9-9f41f08a1b5f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:52.671049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3593724-f754-49b4-bfc9-9f41f08a1b5f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:52.672392 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 750/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 05:07:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:07:52.678209 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d83f28-8b53-4f35-8f23-3d26b4c542e0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:52.678716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d83f28-8b53-4f35-8f23-3d26b4c542e0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:52.678716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d83f28-8b53-4f35-8f23-3d26b4c542e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:52.699169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-53d83f28-8b53-4f35-8f23-3d26b4c542e0 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:07:52.700481 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-53d83f28-8b53-4f35-8f23-3d26b4c542e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:52.711572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 779/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 05:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:07:53.010939 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3593724-f754-49b4-bfc9-9f41f08a1b5f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:07:53.012679 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c3593724-f754-49b4-bfc9-9f41f08a1b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:53.101948 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3593724-f754-49b4-bfc9-9f41f08a1b5f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:07:53.105971 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa26f4-2d6f-4ff8-b863-4fa9dc65efa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:07:53.106655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa26f4-2d6f-4ff8-b863-4fa9dc65efa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:53.106979 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa26f4-2d6f-4ff8-b863-4fa9dc65efa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:53.107291 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa26f4-2d6f-4ff8-b863-4fa9dc65efa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:53.118679 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa26f4-2d6f-4ff8-b863-4fa9dc65efa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:07:53.120407 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa26f4-2d6f-4ff8-b863-4fa9dc65efa9 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:07:53.131628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 751/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:07:55.079134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259392a1-ccc9-42bf-9191-9f8535913d7a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:55.079692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259392a1-ccc9-42bf-9191-9f8535913d7a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:55.079692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259392a1-ccc9-42bf-9191-9f8535913d7a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:55.081049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 780/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 05:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:07:55.086288 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f9af-cd76-4446-849b-f4281cb4f8d9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:55.086686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f9af-cd76-4446-849b-f4281cb4f8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:55.086863 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f9af-cd76-4446-849b-f4281cb4f8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:55.106989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7a26f9af-cd76-4446-849b-f4281cb4f8d9 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:07:55.108298 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7a26f9af-cd76-4446-849b-f4281cb4f8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:55.116022 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 752/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 05:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:07:55.412496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259392a1-ccc9-42bf-9191-9f8535913d7a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:07:55.423238 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259392a1-ccc9-42bf-9191-9f8535913d7a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:07:55.426756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0109f-e04d-4da1-8942-01606f157445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:07:55.427344 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0109f-e04d-4da1-8942-01606f157445 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:55.427620 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0109f-e04d-4da1-8942-01606f157445 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:55.427889 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0109f-e04d-4da1-8942-01606f157445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:55.437020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0109f-e04d-4da1-8942-01606f157445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:07:55.438429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0109f-e04d-4da1-8942-01606f157445 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:07:55.447579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 781/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:07:58.878266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d77065-f9d7-4456-a4f6-cd2611eaf5a2 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:58.878832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d77065-f9d7-4456-a4f6-cd2611eaf5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:58.878832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d77065-f9d7-4456-a4f6-cd2611eaf5a2 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:58.880172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 753/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 05:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:07:58.885699 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3798c-8ed3-4560-9d7f-11da0040ccb6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:58.886087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3798c-8ed3-4560-9d7f-11da0040ccb6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:58.886237 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3798c-8ed3-4560-9d7f-11da0040ccb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:58.906050 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-51d3798c-8ed3-4560-9d7f-11da0040ccb6 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:07:58.907256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-51d3798c-8ed3-4560-9d7f-11da0040ccb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:58.915120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 782/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 05:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:07:59.471248 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d77065-f9d7-4456-a4f6-cd2611eaf5a2 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:07:59.472988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-01d77065-f9d7-4456-a4f6-cd2611eaf5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:59.537604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:59.553147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d77065-f9d7-4456-a4f6-cd2611eaf5a2 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:07:59.557034 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67f4f-2bcf-426b-a2f4-918cd48d411a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:07:59.557629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67f4f-2bcf-426b-a2f4-918cd48d411a service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:59.557908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67f4f-2bcf-426b-a2f4-918cd48d411a service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:59.558209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67f4f-2bcf-426b-a2f4-918cd48d411a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:59.567974 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67f4f-2bcf-426b-a2f4-918cd48d411a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:07:59.569406 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67f4f-2bcf-426b-a2f4-918cd48d411a service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:07:59.579360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 754/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:08:01.521181 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f40c-e06a-4119-94e0-96b84ecc04a6 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:08:01.521726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f40c-e06a-4119-94e0-96b84ecc04a6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:08:01.521726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f40c-e06a-4119-94e0-96b84ecc04a6 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:08:01.523040 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 783/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 05:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:08:01.528413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37a7ef-0f02-4158-b766-83e86a07a392 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:08:01.528999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37a7ef-0f02-4158-b766-83e86a07a392 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:08:01.528999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37a7ef-0f02-4158-b766-83e86a07a392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:08:01.548812 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4f37a7ef-0f02-4158-b766-83e86a07a392 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:08:01.550021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4f37a7ef-0f02-4158-b766-83e86a07a392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:08:01.557828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 755/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 05:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:08:02.106827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f40c-e06a-4119-94e0-96b84ecc04a6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:08:02.108586 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9a68f40c-e06a-4119-94e0-96b84ecc04a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:08:02.125335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f40c-e06a-4119-94e0-96b84ecc04a6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:08:02.128867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e4c94-240d-4136-8e5b-0ad5b9dda916 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:08:02.129476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e4c94-240d-4136-8e5b-0ad5b9dda916 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:08:02.129751 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e4c94-240d-4136-8e5b-0ad5b9dda916 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:08:02.130019 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e4c94-240d-4136-8e5b-0ad5b9dda916 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:08:02.140505 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e4c94-240d-4136-8e5b-0ad5b9dda916 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:08:02.141920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e4c94-240d-4136-8e5b-0ad5b9dda916 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:08:02.151491 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 784/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:08:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:08:11.543767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=11 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:12.147135 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:28.919975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc86ef-f3af-40e5-acb5-09c695e71b49 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:28.920628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc86ef-f3af-40e5-acb5-09c695e71b49 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:28.920628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc86ef-f3af-40e5-acb5-09c695e71b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:28.947455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bbbc86ef-f3af-40e5-acb5-09c695e71b49 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:28.948744 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bbbc86ef-f3af-40e5-acb5-09c695e71b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:28.959392 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 756/1540] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:28.967786 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510aca0-5abb-4df7-8776-47522e381173 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:28.968390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510aca0-5abb-4df7-8776-47522e381173 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:28.968390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510aca0-5abb-4df7-8776-47522e381173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:28.993706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0510aca0-5abb-4df7-8776-47522e381173 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:28.994940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0510aca0-5abb-4df7-8776-47522e381173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:29.012523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 785/1541] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:29.017217 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc86ef-f3af-40e5-acb5-09c695e71b49 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.041402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc86ef-f3af-40e5-acb5-09c695e71b49 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.046031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee613b-483f-469f-ba25-7bdce20973db None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.046367 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee613b-483f-469f-ba25-7bdce20973db None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.046592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee613b-483f-469f-ba25-7bdce20973db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.051340 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3cfe8-84ad-4ab0-86a5-ac04951930f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.051988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3cfe8-84ad-4ab0-86a5-ac04951930f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.052269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3cfe8-84ad-4ab0-86a5-ac04951930f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.052542 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3cfe8-84ad-4ab0-86a5-ac04951930f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.053201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3cfe8-84ad-4ab0-86a5-ac04951930f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:09:29.053502 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3cfe8-84ad-4ab0-86a5-ac04951930f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.055139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3cfe8-84ad-4ab0-86a5-ac04951930f4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.073056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7aee613b-483f-469f-ba25-7bdce20973db None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:29.074423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7aee613b-483f-469f-ba25-7bdce20973db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:29.076003 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 757/1542] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:09:29.091379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ae16e-d141-4704-bf31-6d7c818cb218 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.091714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ae16e-d141-4704-bf31-6d7c818cb218 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.091940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ae16e-d141-4704-bf31-6d7c818cb218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.094630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 786/1543] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:09:29.096195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee613b-483f-469f-ba25-7bdce20973db None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.110043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee613b-483f-469f-ba25-7bdce20973db None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.115850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94908a-3f6c-4cc5-b207-6ea4cddd582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.116503 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94908a-3f6c-4cc5-b207-6ea4cddd582c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.116780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94908a-3f6c-4cc5-b207-6ea4cddd582c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.117051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94908a-3f6c-4cc5-b207-6ea4cddd582c admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.117766 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94908a-3f6c-4cc5-b207-6ea4cddd582c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.119690 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94908a-3f6c-4cc5-b207-6ea4cddd582c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.132802 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-127ae16e-d141-4704-bf31-6d7c818cb218 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:29.134143 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-127ae16e-d141-4704-bf31-6d7c818cb218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:29.161789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 758/1544] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:29.163511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ab45-e40d-4c61-add3-22e503b12e4e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.163801 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ab45-e40d-4c61-add3-22e503b12e4e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.164107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ab45-e40d-4c61-add3-22e503b12e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.185972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 787/1545] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:29.189052 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9b93b-47fd-4cf4-b5a8-de93eb728d09 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.189344 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9b93b-47fd-4cf4-b5a8-de93eb728d09 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.189623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9b93b-47fd-4cf4-b5a8-de93eb728d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.193574 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9247ab45-e40d-4c61-add3-22e503b12e4e None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:29.194806 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9247ab45-e40d-4c61-add3-22e503b12e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:29.227812 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3fc9b93b-47fd-4cf4-b5a8-de93eb728d09 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:29.229093 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3fc9b93b-47fd-4cf4-b5a8-de93eb728d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:29.277791 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 759/1546] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:29.281695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39b63e-7fa5-4725-838a-a12dac91baca None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.281695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39b63e-7fa5-4725-838a-a12dac91baca None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.281695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39b63e-7fa5-4725-838a-a12dac91baca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.300654 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7d39b63e-7fa5-4725-838a-a12dac91baca None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:29.301875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7d39b63e-7fa5-4725-838a-a12dac91baca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:29.310317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 760/1547] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:29.311659 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cb9ff-ed3f-401c-9395-fe85e1866946 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.311961 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cb9ff-ed3f-401c-9395-fe85e1866946 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.312240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cb9ff-ed3f-401c-9395-fe85e1866946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.317954 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 788/1548] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:29.317954 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9b93b-47fd-4cf4-b5a8-de93eb728d09 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.327178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9b93b-47fd-4cf4-b5a8-de93eb728d09 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.332448 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f0200-9b5a-40af-823b-7f99786e2606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.332636 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bc2cb9ff-ed3f-401c-9395-fe85e1866946 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:29.333051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f0200-9b5a-40af-823b-7f99786e2606 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.333327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f0200-9b5a-40af-823b-7f99786e2606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.333597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f0200-9b5a-40af-823b-7f99786e2606 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.333734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bc2cb9ff-ed3f-401c-9395-fe85e1866946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:29.334224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f0200-9b5a-40af-823b-7f99786e2606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.335259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-b04f0200-9b5a-40af-823b-7f99786e2606 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 05:09:29.335259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: warnings.warn(msg) Aug 30 05:09:29.335259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: Aug 30 05:09:29.336500 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f0200-9b5a-40af-823b-7f99786e2606 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.342026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 761/1549] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:29.343375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc20a7a-6f91-40df-9316-688e4160e0db None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.343518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc20a7a-6f91-40df-9316-688e4160e0db None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.343751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc20a7a-6f91-40df-9316-688e4160e0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.362247 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 789/1550] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/users => generated 287 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:29.363195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b36e32-39a0-4118-b41f-8a3eeafecca3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.363482 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b36e32-39a0-4118-b41f-8a3eeafecca3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.363762 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b36e32-39a0-4118-b41f-8a3eeafecca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.366802 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-cdc20a7a-6f91-40df-9316-688e4160e0db None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:29.368107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cdc20a7a-6f91-40df-9316-688e4160e0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:29.376217 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 762/1551] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:29.384706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a8b36e32-39a0-4118-b41f-8a3eeafecca3 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:29.384931 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc20a7a-6f91-40df-9316-688e4160e0db None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.385929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a8b36e32-39a0-4118-b41f-8a3eeafecca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:29.394563 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 790/1552] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:29.395781 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83004e0-b4b9-426b-8266-e912b828ddd2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.396093 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83004e0-b4b9-426b-8266-e912b828ddd2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.396364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83004e0-b4b9-426b-8266-e912b828ddd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.397494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc20a7a-6f91-40df-9316-688e4160e0db None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.402883 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c25fc-5092-4c5b-bc76-9b287085a7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.403511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c25fc-5092-4c5b-bc76-9b287085a7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.403790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c25fc-5092-4c5b-bc76-9b287085a7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.404101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c25fc-5092-4c5b-bc76-9b287085a7c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.404765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c25fc-5092-4c5b-bc76-9b287085a7c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:09:29.405070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c25fc-5092-4c5b-bc76-9b287085a7c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.406687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c25fc-5092-4c5b-bc76-9b287085a7c6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.417909 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d83004e0-b4b9-426b-8266-e912b828ddd2 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:29.419242 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d83004e0-b4b9-426b-8266-e912b828ddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:29.419573 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 763/1553] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:09:29.420900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b07ada-22d7-4c52-bb95-bd87ed6d303a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.421209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b07ada-22d7-4c52-bb95-bd87ed6d303a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.421446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b07ada-22d7-4c52-bb95-bd87ed6d303a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.433735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 791/1554] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:29.440973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15717b2-b50f-4a83-aeaf-bfb7bc391092 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.441172 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15717b2-b50f-4a83-aeaf-bfb7bc391092 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.441516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15717b2-b50f-4a83-aeaf-bfb7bc391092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.461762 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f15717b2-b50f-4a83-aeaf-bfb7bc391092 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:29.462156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-87b07ada-22d7-4c52-bb95-bd87ed6d303a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:29.462964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f15717b2-b50f-4a83-aeaf-bfb7bc391092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:29.463351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-87b07ada-22d7-4c52-bb95-bd87ed6d303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:29.473275 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 764/1555] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:29.477595 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 792/1556] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:29.477754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b07ada-22d7-4c52-bb95-bd87ed6d303a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.477857 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15717b2-b50f-4a83-aeaf-bfb7bc391092 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.488033 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15717b2-b50f-4a83-aeaf-bfb7bc391092 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.492847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d6b8f-9201-4ef5-be73-62ebac5c8ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.493492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d6b8f-9201-4ef5-be73-62ebac5c8ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.493769 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d6b8f-9201-4ef5-be73-62ebac5c8ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.494039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d6b8f-9201-4ef5-be73-62ebac5c8ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.494686 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d6b8f-9201-4ef5-be73-62ebac5c8ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.496346 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d6b8f-9201-4ef5-be73-62ebac5c8ff6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.496719 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b07ada-22d7-4c52-bb95-bd87ed6d303a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.502407 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd01df-2208-4f4d-bdea-984d40b5c9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.503219 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd01df-2208-4f4d-bdea-984d40b5c9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.503497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd01df-2208-4f4d-bdea-984d40b5c9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.503768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd01df-2208-4f4d-bdea-984d40b5c9d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.504515 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd01df-2208-4f4d-bdea-984d40b5c9d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:09:29.505046 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd01df-2208-4f4d-bdea-984d40b5c9d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.506808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd01df-2208-4f4d-bdea-984d40b5c9d8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.510985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 793/1557] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:29.512685 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50a74d-90a5-4e4c-8dbd-46389e04ce4a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.512970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50a74d-90a5-4e4c-8dbd-46389e04ce4a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.513245 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50a74d-90a5-4e4c-8dbd-46389e04ce4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.521579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 765/1558] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:09:29.525671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ef8f2-e5e6-483e-b05e-e567503d097a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.525875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ef8f2-e5e6-483e-b05e-e567503d097a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.526048 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ef8f2-e5e6-483e-b05e-e567503d097a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.533826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ac50a74d-90a5-4e4c-8dbd-46389e04ce4a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:29.535044 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ac50a74d-90a5-4e4c-8dbd-46389e04ce4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:29.543181 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 794/1559] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:29.543995 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50a74d-90a5-4e4c-8dbd-46389e04ce4a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.546995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5b2ef8f2-e5e6-483e-b05e-e567503d097a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:29.548194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5b2ef8f2-e5e6-483e-b05e-e567503d097a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:29.553586 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50a74d-90a5-4e4c-8dbd-46389e04ce4a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.556329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 766/1560] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:29.557532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a2fd1-2a33-4b92-b478-09c909b0b7ea None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.557816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a2fd1-2a33-4b92-b478-09c909b0b7ea None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.558069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a2fd1-2a33-4b92-b478-09c909b0b7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.558351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249772f-a388-449c-9b57-83796f80d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.558969 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249772f-a388-449c-9b57-83796f80d3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.559246 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249772f-a388-449c-9b57-83796f80d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.559519 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249772f-a388-449c-9b57-83796f80d3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.563167 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249772f-a388-449c-9b57-83796f80d3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.568138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249772f-a388-449c-9b57-83796f80d3f4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.582368 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0f9a2fd1-2a33-4b92-b478-09c909b0b7ea None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:29.583559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0f9a2fd1-2a33-4b92-b478-09c909b0b7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:29.591304 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 767/1561] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:29.592196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a2fd1-2a33-4b92-b478-09c909b0b7ea None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.601926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a2fd1-2a33-4b92-b478-09c909b0b7ea None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.607062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eb291-4a5e-4daa-8f7a-fea35f1f7345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.607682 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eb291-4a5e-4daa-8f7a-fea35f1f7345 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.607973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eb291-4a5e-4daa-8f7a-fea35f1f7345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.608266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eb291-4a5e-4daa-8f7a-fea35f1f7345 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.608919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4eb291-4a5e-4daa-8f7a-fea35f1f7345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:09:29.609221 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4eb291-4a5e-4daa-8f7a-fea35f1f7345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.610833 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4eb291-4a5e-4daa-8f7a-fea35f1f7345 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.614650 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 795/1562] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/projects => generated 355 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:29.614650 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249772f-a388-449c-9b57-83796f80d3f4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.624088 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 768/1563] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:09:29.624888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eb291-4a5e-4daa-8f7a-fea35f1f7345 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.635625 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eb291-4a5e-4daa-8f7a-fea35f1f7345 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.662041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:29.683929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249772f-a388-449c-9b57-83796f80d3f4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.689064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:29.689845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59795155-8b8c-43ea-a1cd-81c0b12aef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.690496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59795155-8b8c-43ea-a1cd-81c0b12aef14 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.690788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59795155-8b8c-43ea-a1cd-81c0b12aef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.691124 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59795155-8b8c-43ea-a1cd-81c0b12aef14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.691777 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59795155-8b8c-43ea-a1cd-81c0b12aef14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:09:29.692237 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59795155-8b8c-43ea-a1cd-81c0b12aef14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.693281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-59795155-8b8c-43ea-a1cd-81c0b12aef14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 05:09:29.693281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: warnings.warn(msg) Aug 30 05:09:29.693281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: Aug 30 05:09:29.694194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59795155-8b8c-43ea-a1cd-81c0b12aef14 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.696497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21712acb-9262-40a4-8d0f-00592ec332d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.697660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21712acb-9262-40a4-8d0f-00592ec332d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.697926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21712acb-9262-40a4-8d0f-00592ec332d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.698196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21712acb-9262-40a4-8d0f-00592ec332d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.698845 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21712acb-9262-40a4-8d0f-00592ec332d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.700485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21712acb-9262-40a4-8d0f-00592ec332d6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.717265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 796/1564] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:09:29.717265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59795155-8b8c-43ea-a1cd-81c0b12aef14 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.717578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 769/1565] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:29.717578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21712acb-9262-40a4-8d0f-00592ec332d6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.718720 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59795155-8b8c-43ea-a1cd-81c0b12aef14 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.724813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89056ff0-fb80-4663-8bc8-b03373b745f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.725002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21712acb-9262-40a4-8d0f-00592ec332d6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.725430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89056ff0-fb80-4663-8bc8-b03373b745f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.725709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89056ff0-fb80-4663-8bc8-b03373b745f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.725982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89056ff0-fb80-4663-8bc8-b03373b745f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.726621 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89056ff0-fb80-4663-8bc8-b03373b745f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.728580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89056ff0-fb80-4663-8bc8-b03373b745f8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.729857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc572e-6476-40ac-bbb2-79c9afa14c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.730461 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc572e-6476-40ac-bbb2-79c9afa14c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.730739 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc572e-6476-40ac-bbb2-79c9afa14c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.731008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc572e-6476-40ac-bbb2-79c9afa14c09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.731688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc572e-6476-40ac-bbb2-79c9afa14c09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:09:29.732030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc572e-6476-40ac-bbb2-79c9afa14c09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.733858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc572e-6476-40ac-bbb2-79c9afa14c09 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.750672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 770/1566] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:09:29.752887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc572e-6476-40ac-bbb2-79c9afa14c09 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.769536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 797/1567] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:29.769536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89056ff0-fb80-4663-8bc8-b03373b745f8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.772764 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc572e-6476-40ac-bbb2-79c9afa14c09 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.834682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89056ff0-fb80-4663-8bc8-b03373b745f8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.839461 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be63a7-6d1b-4fc5-b88a-4354cd7bfafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.839906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb70fa-e922-4adb-9299-a0f3daee3d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.840138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be63a7-6d1b-4fc5-b88a-4354cd7bfafd admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.840417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be63a7-6d1b-4fc5-b88a-4354cd7bfafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.840531 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb70fa-e922-4adb-9299-a0f3daee3d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.840690 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be63a7-6d1b-4fc5-b88a-4354cd7bfafd admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.840790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb70fa-e922-4adb-9299-a0f3daee3d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.841049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb70fa-e922-4adb-9299-a0f3daee3d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.841341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be63a7-6d1b-4fc5-b88a-4354cd7bfafd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:09:29.841642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be63a7-6d1b-4fc5-b88a-4354cd7bfafd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.841930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb70fa-e922-4adb-9299-a0f3daee3d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:09:29.842251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb70fa-e922-4adb-9299-a0f3daee3d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.843249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be63a7-6d1b-4fc5-b88a-4354cd7bfafd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.843808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb70fa-e922-4adb-9299-a0f3daee3d90 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.855581 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 798/1568] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:09:29.865520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 771/1569] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:09:29.865735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be63a7-6d1b-4fc5-b88a-4354cd7bfafd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.865849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb70fa-e922-4adb-9299-a0f3daee3d90 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.867441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be63a7-6d1b-4fc5-b88a-4354cd7bfafd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.872768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1537733-b02b-4498-a9d2-419f541df657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.873379 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1537733-b02b-4498-a9d2-419f541df657 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.873659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1537733-b02b-4498-a9d2-419f541df657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.873932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1537733-b02b-4498-a9d2-419f541df657 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.874563 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1537733-b02b-4498-a9d2-419f541df657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.875192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb70fa-e922-4adb-9299-a0f3daee3d90 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.876544 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1537733-b02b-4498-a9d2-419f541df657 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.880376 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61d530-deaa-41cd-bfa3-7c9db36601e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.880972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61d530-deaa-41cd-bfa3-7c9db36601e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.881521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61d530-deaa-41cd-bfa3-7c9db36601e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.881797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61d530-deaa-41cd-bfa3-7c9db36601e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.882386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61d530-deaa-41cd-bfa3-7c9db36601e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.883388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-8b61d530-deaa-41cd-bfa3-7c9db36601e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 05:09:29.883388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 30 05:09:29.883388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: Aug 30 05:09:29.884972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61d530-deaa-41cd-bfa3-7c9db36601e0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:29.899990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 799/1570] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/users => generated 278 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:29.900930 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1537733-b02b-4498-a9d2-419f541df657 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.912791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1537733-b02b-4498-a9d2-419f541df657 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.917235 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 772/1571] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:29.917235 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61d530-deaa-41cd-bfa3-7c9db36601e0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:29.977099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20b253-8495-4d00-87c6-206cecab9122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.978411 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20b253-8495-4d00-87c6-206cecab9122 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.978702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20b253-8495-4d00-87c6-206cecab9122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.978969 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20b253-8495-4d00-87c6-206cecab9122 admin admin] PATH_INFO: `/v3/projects/ca8431144ea04bb78f1d28a4747ecc55/users/cb24f570361347a4b8fb78d6c4623172/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.979437 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61d530-deaa-41cd-bfa3-7c9db36601e0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:29.984198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb455c-4147-4550-b742-03afb4f2f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:29.984969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb455c-4147-4550-b742-03afb4f2f446 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:29.985246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb455c-4147-4550-b742-03afb4f2f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:29.985515 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb455c-4147-4550-b742-03afb4f2f446 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:29.987137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb455c-4147-4550-b742-03afb4f2f446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:29.988661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb455c-4147-4550-b742-03afb4f2f446 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.004277 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20b253-8495-4d00-87c6-206cecab9122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8431144ea04bb78f1d28a4747ecc55, user_id=cb24f570361347a4b8fb78d6c4623172, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.007252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20b253-8495-4d00-87c6-206cecab9122 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.018558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 773/1572] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:29 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:30.019403 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb455c-4147-4550-b742-03afb4f2f446 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.022827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 800/1573] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:29 2022] PUT /identity/v3/projects/ca8431144ea04bb78f1d28a4747ecc55/users/cb24f570361347a4b8fb78d6c4623172/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:30.023679 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20b253-8495-4d00-87c6-206cecab9122 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.037614 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:30.068467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:30.091849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20b253-8495-4d00-87c6-206cecab9122 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.092648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb455c-4147-4550-b742-03afb4f2f446 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.096524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e3f1c-24df-4e0d-9621-fdea8304d1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.097131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e3f1c-24df-4e0d-9621-fdea8304d1ea admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.097283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9ea73-3646-4b30-80dd-b24f898d73d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.097431 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e3f1c-24df-4e0d-9621-fdea8304d1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.097663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e3f1c-24df-4e0d-9621-fdea8304d1ea admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.097891 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9ea73-3646-4b30-80dd-b24f898d73d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.098167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9ea73-3646-4b30-80dd-b24f898d73d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.098438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9ea73-3646-4b30-80dd-b24f898d73d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.098919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e3f1c-24df-4e0d-9621-fdea8304d1ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.099068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9ea73-3646-4b30-80dd-b24f898d73d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.100881 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e3f1c-24df-4e0d-9621-fdea8304d1ea admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.101019 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9ea73-3646-4b30-80dd-b24f898d73d7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.124856 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 801/1574] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:30 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:30.125823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e3f1c-24df-4e0d-9621-fdea8304d1ea admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.132064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 774/1575] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:30 2022] POST /identity/v3/projects => generated 393 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:30.133222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9ea73-3646-4b30-80dd-b24f898d73d7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.139768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e3f1c-24df-4e0d-9621-fdea8304d1ea admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.204163 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9ea73-3646-4b30-80dd-b24f898d73d7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.208893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7c0b8-9c6c-458a-aaf2-45226be38e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.209072 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514db2f0-8ebf-475e-8ccd-8f443b2a95f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.209503 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7c0b8-9c6c-458a-aaf2-45226be38e61 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.209629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514db2f0-8ebf-475e-8ccd-8f443b2a95f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.209777 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514db2f0-8ebf-475e-8ccd-8f443b2a95f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.209877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7c0b8-9c6c-458a-aaf2-45226be38e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.210043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7c0b8-9c6c-458a-aaf2-45226be38e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.210153 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514db2f0-8ebf-475e-8ccd-8f443b2a95f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.210676 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514db2f0-8ebf-475e-8ccd-8f443b2a95f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.210801 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7c0b8-9c6c-458a-aaf2-45226be38e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.212584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514db2f0-8ebf-475e-8ccd-8f443b2a95f7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.212718 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7c0b8-9c6c-458a-aaf2-45226be38e61 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.248873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 802/1576] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:30 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:30.249077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 775/1577] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:30 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:30.249282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514db2f0-8ebf-475e-8ccd-8f443b2a95f7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.249379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7c0b8-9c6c-458a-aaf2-45226be38e61 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.316735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7c0b8-9c6c-458a-aaf2-45226be38e61 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.319577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514db2f0-8ebf-475e-8ccd-8f443b2a95f7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.321589 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948762a3-8569-4e4a-917c-9788792dc023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.322197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948762a3-8569-4e4a-917c-9788792dc023 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.322475 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948762a3-8569-4e4a-917c-9788792dc023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.322752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948762a3-8569-4e4a-917c-9788792dc023 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.323566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948762a3-8569-4e4a-917c-9788792dc023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.325373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948762a3-8569-4e4a-917c-9788792dc023 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.326877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71477e29-c2a2-4bc0-b0b6-4e503e350919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.327873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71477e29-c2a2-4bc0-b0b6-4e503e350919 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.328373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71477e29-c2a2-4bc0-b0b6-4e503e350919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.328829 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71477e29-c2a2-4bc0-b0b6-4e503e350919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.329918 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71477e29-c2a2-4bc0-b0b6-4e503e350919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.332451 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71477e29-c2a2-4bc0-b0b6-4e503e350919 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.346560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 803/1578] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:30.346560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71477e29-c2a2-4bc0-b0b6-4e503e350919 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.348316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 776/1579] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:30 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:30.349573 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa3861-eeec-40ba-9b8d-b2ac0138e0b0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.349858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa3861-eeec-40ba-9b8d-b2ac0138e0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.350130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa3861-eeec-40ba-9b8d-b2ac0138e0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.357200 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71477e29-c2a2-4bc0-b0b6-4e503e350919 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.363495 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324c69e-ed55-448b-a107-260ca32b9e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.364195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324c69e-ed55-448b-a107-260ca32b9e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.364474 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324c69e-ed55-448b-a107-260ca32b9e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.364743 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324c69e-ed55-448b-a107-260ca32b9e66 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.365381 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324c69e-ed55-448b-a107-260ca32b9e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.367350 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324c69e-ed55-448b-a107-260ca32b9e66 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.381446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-42fa3861-eeec-40ba-9b8d-b2ac0138e0b0 None None] MFA Rules not processed for user `cb24f570361347a4b8fb78d6c4623172`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:30.382762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-42fa3861-eeec-40ba-9b8d-b2ac0138e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:30.391586 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 804/1580] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:30 2022] POST /identity/v3/users => generated 282 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:30.392544 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324c69e-ed55-448b-a107-260ca32b9e66 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.399201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:30.403099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324c69e-ed55-448b-a107-260ca32b9e66 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.410280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc25ed8-d286-43bf-af71-92f600e2a504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.410896 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc25ed8-d286-43bf-af71-92f600e2a504 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.411176 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc25ed8-d286-43bf-af71-92f600e2a504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.411453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc25ed8-d286-43bf-af71-92f600e2a504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.412121 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc25ed8-d286-43bf-af71-92f600e2a504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.413449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:30.414773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc25ed8-d286-43bf-af71-92f600e2a504 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.432902 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 805/1581] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:30.434078 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc25ed8-d286-43bf-af71-92f600e2a504 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.444175 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc25ed8-d286-43bf-af71-92f600e2a504 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.448846 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55606c4-0d8d-4fdb-9a0d-6414ade48818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.449447 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55606c4-0d8d-4fdb-9a0d-6414ade48818 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.449719 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55606c4-0d8d-4fdb-9a0d-6414ade48818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.449984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55606c4-0d8d-4fdb-9a0d-6414ade48818 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.450600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55606c4-0d8d-4fdb-9a0d-6414ade48818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.452550 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55606c4-0d8d-4fdb-9a0d-6414ade48818 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.456386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 777/1582] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:30.457314 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa3861-eeec-40ba-9b8d-b2ac0138e0b0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.473520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa3861-eeec-40ba-9b8d-b2ac0138e0b0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.476417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 806/1583] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:30 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:30.477402 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55606c4-0d8d-4fdb-9a0d-6414ade48818 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.478809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441a223-b573-4935-bd87-ca2acfe667b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.479491 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441a223-b573-4935-bd87-ca2acfe667b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.479764 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441a223-b573-4935-bd87-ca2acfe667b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.480064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441a223-b573-4935-bd87-ca2acfe667b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.480720 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441a223-b573-4935-bd87-ca2acfe667b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.482642 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441a223-b573-4935-bd87-ca2acfe667b7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.487926 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55606c4-0d8d-4fdb-9a0d-6414ade48818 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.493502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a9081-2ad4-40ef-ab91-a25fd71aa76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.493852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a9081-2ad4-40ef-ab91-a25fd71aa76c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.494264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a9081-2ad4-40ef-ab91-a25fd71aa76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.494619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a9081-2ad4-40ef-ab91-a25fd71aa76c admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.495374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a9081-2ad4-40ef-ab91-a25fd71aa76c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.497623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a9081-2ad4-40ef-ab91-a25fd71aa76c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.504822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 778/1584] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:30 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:30.508363 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441a223-b573-4935-bd87-ca2acfe667b7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.519049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441a223-b573-4935-bd87-ca2acfe667b7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.521154 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 807/1585] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:30 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:30.522045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a9081-2ad4-40ef-ab91-a25fd71aa76c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.523924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c95f3-ba6c-4db5-ac39-6e015fc15b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.524561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c95f3-ba6c-4db5-ac39-6e015fc15b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.524835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c95f3-ba6c-4db5-ac39-6e015fc15b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.525101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c95f3-ba6c-4db5-ac39-6e015fc15b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.525740 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c95f3-ba6c-4db5-ac39-6e015fc15b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.527339 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c95f3-ba6c-4db5-ac39-6e015fc15b42 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.532127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a9081-2ad4-40ef-ab91-a25fd71aa76c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.538255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 779/1586] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:30.541567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a68a4-d3dc-4e2d-a201-34d72dbda51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.541674 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c95f3-ba6c-4db5-ac39-6e015fc15b42 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.541753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a68a4-d3dc-4e2d-a201-34d72dbda51b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.541753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a68a4-d3dc-4e2d-a201-34d72dbda51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.541753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a68a4-d3dc-4e2d-a201-34d72dbda51b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.541753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a68a4-d3dc-4e2d-a201-34d72dbda51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.543353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a68a4-d3dc-4e2d-a201-34d72dbda51b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.549820 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c95f3-ba6c-4db5-ac39-6e015fc15b42 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.554550 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c51b3-7c81-484e-99f1-1f283da6c52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.555180 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c51b3-7c81-484e-99f1-1f283da6c52e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.555352 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 808/1587] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:30.555830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c51b3-7c81-484e-99f1-1f283da6c52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.556206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c51b3-7c81-484e-99f1-1f283da6c52e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.556316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a68a4-d3dc-4e2d-a201-34d72dbda51b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.556866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c51b3-7c81-484e-99f1-1f283da6c52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.558572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c51b3-7c81-484e-99f1-1f283da6c52e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.568318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a68a4-d3dc-4e2d-a201-34d72dbda51b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.573103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 780/1588] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:30.573103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c51b3-7c81-484e-99f1-1f283da6c52e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.573363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc44f5c-64eb-430d-a8a8-02f7ad61734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.573969 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc44f5c-64eb-430d-a8a8-02f7ad61734e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.574245 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc44f5c-64eb-430d-a8a8-02f7ad61734e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.574557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc44f5c-64eb-430d-a8a8-02f7ad61734e admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.575316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc44f5c-64eb-430d-a8a8-02f7ad61734e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.576971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc44f5c-64eb-430d-a8a8-02f7ad61734e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.581760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c51b3-7c81-484e-99f1-1f283da6c52e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.586500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b4e91-2141-4d6d-8fed-c7fb270ceede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.587102 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b4e91-2141-4d6d-8fed-c7fb270ceede admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.587290 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 809/1589] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:30.588098 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc44f5c-64eb-430d-a8a8-02f7ad61734e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.590993 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b4e91-2141-4d6d-8fed-c7fb270ceede admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.591137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b4e91-2141-4d6d-8fed-c7fb270ceede admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.591703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b4e91-2141-4d6d-8fed-c7fb270ceede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.593655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b4e91-2141-4d6d-8fed-c7fb270ceede admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.599058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc44f5c-64eb-430d-a8a8-02f7ad61734e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.604927 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e3faf-142a-46a2-9e47-89685e3d56ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.606148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e3faf-142a-46a2-9e47-89685e3d56ea admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.606737 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e3faf-142a-46a2-9e47-89685e3d56ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.607065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e3faf-142a-46a2-9e47-89685e3d56ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.607743 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e3faf-142a-46a2-9e47-89685e3d56ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.609492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e3faf-142a-46a2-9e47-89685e3d56ea admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.624815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 810/1590] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:30.624815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e3faf-142a-46a2-9e47-89685e3d56ea admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.630565 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 781/1591] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:30 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:30.630565 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b4e91-2141-4d6d-8fed-c7fb270ceede admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.632875 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e3faf-142a-46a2-9e47-89685e3d56ea admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.692307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f9a04-45ac-41bc-83eb-bddde04c322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.693018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f9a04-45ac-41bc-83eb-bddde04c322c admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.693300 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f9a04-45ac-41bc-83eb-bddde04c322c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.693573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f9a04-45ac-41bc-83eb-bddde04c322c admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.694216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f9a04-45ac-41bc-83eb-bddde04c322c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.695832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f9a04-45ac-41bc-83eb-bddde04c322c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.696744 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b4e91-2141-4d6d-8fed-c7fb270ceede admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.701474 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bba37-c111-48fe-9714-c82c3cf6e26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.702132 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bba37-c111-48fe-9714-c82c3cf6e26e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.702408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bba37-c111-48fe-9714-c82c3cf6e26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.702673 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bba37-c111-48fe-9714-c82c3cf6e26e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.703310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bba37-c111-48fe-9714-c82c3cf6e26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.705677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bba37-c111-48fe-9714-c82c3cf6e26e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.709776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 811/1592] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:30.709776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f9a04-45ac-41bc-83eb-bddde04c322c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.719253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 782/1593] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:30.719253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bba37-c111-48fe-9714-c82c3cf6e26e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.719567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f9a04-45ac-41bc-83eb-bddde04c322c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.723382 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d92412-2de2-4247-ae88-df4dd8b38df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.724082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d92412-2de2-4247-ae88-df4dd8b38df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.724361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d92412-2de2-4247-ae88-df4dd8b38df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.724634 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d92412-2de2-4247-ae88-df4dd8b38df1 admin admin] PATH_INFO: `/v3/projects/71d98362fed842ae9ff1a049e4f17ef4/users/5aecba0b55a841659b054c9e4fa84089/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.727519 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bba37-c111-48fe-9714-c82c3cf6e26e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.732155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7df03-67ea-45c8-88dc-68755fdb650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.732752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7df03-67ea-45c8-88dc-68755fdb650f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.733030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7df03-67ea-45c8-88dc-68755fdb650f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.733298 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7df03-67ea-45c8-88dc-68755fdb650f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.733950 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7df03-67ea-45c8-88dc-68755fdb650f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.735538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7df03-67ea-45c8-88dc-68755fdb650f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.741365 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d92412-2de2-4247-ae88-df4dd8b38df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d98362fed842ae9ff1a049e4f17ef4, user_id=5aecba0b55a841659b054c9e4fa84089, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.744841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d92412-2de2-4247-ae88-df4dd8b38df1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.746878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 783/1594] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:30.747703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7df03-67ea-45c8-88dc-68755fdb650f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.758749 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7df03-67ea-45c8-88dc-68755fdb650f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.759053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 812/1595] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:30 2022] PUT /identity/v3/projects/71d98362fed842ae9ff1a049e4f17ef4/users/5aecba0b55a841659b054c9e4fa84089/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:30.761272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d92412-2de2-4247-ae88-df4dd8b38df1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.814665 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:30.827903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a2c1d-ed04-4c08-9951-d1c12dab5bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.828339 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a2c1d-ed04-4c08-9951-d1c12dab5bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.828645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a2c1d-ed04-4c08-9951-d1c12dab5bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.828925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a2c1d-ed04-4c08-9951-d1c12dab5bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.829574 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a2c1d-ed04-4c08-9951-d1c12dab5bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.831730 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a2c1d-ed04-4c08-9951-d1c12dab5bf5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.833421 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:30.837402 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d92412-2de2-4247-ae88-df4dd8b38df1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.842842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 784/1596] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:30.843823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a2c1d-ed04-4c08-9951-d1c12dab5bf5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.847899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730cb32-38b4-41c5-8209-d02982dfc583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.848797 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730cb32-38b4-41c5-8209-d02982dfc583 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.849876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730cb32-38b4-41c5-8209-d02982dfc583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.849876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730cb32-38b4-41c5-8209-d02982dfc583 admin admin] PATH_INFO: `/v3/projects/c9e6ba2d4c574792a4383d4f0c902ef4/users/30a180efbf754d458ed13e4401296bb2/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.854245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a2c1d-ed04-4c08-9951-d1c12dab5bf5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.859668 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44c893-2f23-4b43-9e33-82fadcaa2fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.860300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44c893-2f23-4b43-9e33-82fadcaa2fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.860569 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44c893-2f23-4b43-9e33-82fadcaa2fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.860835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44c893-2f23-4b43-9e33-82fadcaa2fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.861554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44c893-2f23-4b43-9e33-82fadcaa2fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.863411 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44c893-2f23-4b43-9e33-82fadcaa2fcf admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.867338 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730cb32-38b4-41c5-8209-d02982dfc583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e6ba2d4c574792a4383d4f0c902ef4, user_id=30a180efbf754d458ed13e4401296bb2, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.870031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730cb32-38b4-41c5-8209-d02982dfc583 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.873649 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 785/1597] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:30.874863 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44c893-2f23-4b43-9e33-82fadcaa2fcf admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.886484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44c893-2f23-4b43-9e33-82fadcaa2fcf admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.887448 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 813/1598] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:30 2022] PUT /identity/v3/projects/c9e6ba2d4c574792a4383d4f0c902ef4/users/30a180efbf754d458ed13e4401296bb2/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:30.888446 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730cb32-38b4-41c5-8209-d02982dfc583 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.949809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d53bce-1a8b-4bc8-850f-8220a10d828e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.950422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d53bce-1a8b-4bc8-850f-8220a10d828e admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.950700 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d53bce-1a8b-4bc8-850f-8220a10d828e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.950980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d53bce-1a8b-4bc8-850f-8220a10d828e admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.951724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d53bce-1a8b-4bc8-850f-8220a10d828e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.953731 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d53bce-1a8b-4bc8-850f-8220a10d828e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.954623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730cb32-38b4-41c5-8209-d02982dfc583 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.959966 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336076f-4e85-4794-89df-f06ad3212d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.960578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336076f-4e85-4794-89df-f06ad3212d3c admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.960856 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336076f-4e85-4794-89df-f06ad3212d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.961124 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336076f-4e85-4794-89df-f06ad3212d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.961761 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336076f-4e85-4794-89df-f06ad3212d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.963359 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336076f-4e85-4794-89df-f06ad3212d3c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.974386 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 814/1599] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:30.975370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336076f-4e85-4794-89df-f06ad3212d3c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.980086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 786/1600] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:30 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:30.981155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d53bce-1a8b-4bc8-850f-8220a10d828e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:30.985728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336076f-4e85-4794-89df-f06ad3212d3c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:30.990605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a561d9-0bbd-4dd8-b110-71a0d219e596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:30.991240 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a561d9-0bbd-4dd8-b110-71a0d219e596 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:30.991487 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a561d9-0bbd-4dd8-b110-71a0d219e596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:30.991755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a561d9-0bbd-4dd8-b110-71a0d219e596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:30.992421 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a561d9-0bbd-4dd8-b110-71a0d219e596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:30.994010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a561d9-0bbd-4dd8-b110-71a0d219e596 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:30.996565 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d53bce-1a8b-4bc8-850f-8220a10d828e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:31.003365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a04e2-a2cc-4004-b3fb-2c49cc8d1a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:31.004142 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a04e2-a2cc-4004-b3fb-2c49cc8d1a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.004422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a04e2-a2cc-4004-b3fb-2c49cc8d1a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.004747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a04e2-a2cc-4004-b3fb-2c49cc8d1a06 admin admin] PATH_INFO: `/v3/projects/851ad9d4f2ad4df9b3c8d16a383a08e1/users/dd803cc555584e95baf795337a36ad6c/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.009139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 815/1601] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:31.009139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb5adf-dcd3-49df-b7fe-be25f8107d3d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.009139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb5adf-dcd3-49df-b7fe-be25f8107d3d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.009139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb5adf-dcd3-49df-b7fe-be25f8107d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.026540 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a04e2-a2cc-4004-b3fb-2c49cc8d1a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=851ad9d4f2ad4df9b3c8d16a383a08e1, user_id=dd803cc555584e95baf795337a36ad6c, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:31.027964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-eb5a04e2-a2cc-4004-b3fb-2c49cc8d1a06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 05:09:31.027964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 30 05:09:31.027964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: Aug 30 05:09:31.031504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a04e2-a2cc-4004-b3fb-2c49cc8d1a06 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:31.041376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bcdb5adf-dcd3-49df-b7fe-be25f8107d3d None None] MFA Rules not processed for user `5aecba0b55a841659b054c9e4fa84089`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:31.042583 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bcdb5adf-dcd3-49df-b7fe-be25f8107d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:31.047429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 787/1602] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:30 2022] PUT /identity/v3/projects/851ad9d4f2ad4df9b3c8d16a383a08e1/users/dd803cc555584e95baf795337a36ad6c/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:31.048382 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a04e2-a2cc-4004-b3fb-2c49cc8d1a06 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:31.114873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a04e2-a2cc-4004-b3fb-2c49cc8d1a06 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:31.117057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 816/1603] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:31.117996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb5adf-dcd3-49df-b7fe-be25f8107d3d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:31.123087 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064dae3-37ec-4487-9c7b-1f497de3eaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:31.123762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064dae3-37ec-4487-9c7b-1f497de3eaca admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.124083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064dae3-37ec-4487-9c7b-1f497de3eaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.124358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064dae3-37ec-4487-9c7b-1f497de3eaca admin admin] PATH_INFO: `/v3/projects/1c5d8915a91e46a884db1384d958dc3b/users/af2f7b33cdb84406b1c20eaeb8de286d/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.128820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb5adf-dcd3-49df-b7fe-be25f8107d3d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:31.133724 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b1033-fd53-452b-a7da-1bcf68d32c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:31.134384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b1033-fd53-452b-a7da-1bcf68d32c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.134660 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b1033-fd53-452b-a7da-1bcf68d32c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.134933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b1033-fd53-452b-a7da-1bcf68d32c30 admin admin] PATH_INFO: `/v3/projects/4071c0d10b154953a613ca3faf8db28d/users/b0e4c582fefb4b92b0a2e10652de62f7/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.142354 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064dae3-37ec-4487-9c7b-1f497de3eaca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5d8915a91e46a884db1384d958dc3b, user_id=af2f7b33cdb84406b1c20eaeb8de286d, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:31.145742 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064dae3-37ec-4487-9c7b-1f497de3eaca admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:31.153514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b1033-fd53-452b-a7da-1bcf68d32c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4071c0d10b154953a613ca3faf8db28d, user_id=b0e4c582fefb4b92b0a2e10652de62f7, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:31.156309 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b1033-fd53-452b-a7da-1bcf68d32c30 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:31.161461 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 788/1604] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:31 2022] PUT /identity/v3/projects/1c5d8915a91e46a884db1384d958dc3b/users/af2f7b33cdb84406b1c20eaeb8de286d/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:31.162767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b38bb8-584c-400e-8134-af475f9cdcdf None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.163089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b38bb8-584c-400e-8134-af475f9cdcdf None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.163455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b38bb8-584c-400e-8134-af475f9cdcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.175414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 817/1605] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:31 2022] PUT /identity/v3/projects/4071c0d10b154953a613ca3faf8db28d/users/b0e4c582fefb4b92b0a2e10652de62f7/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:31.175414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b1033-fd53-452b-a7da-1bcf68d32c30 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:31.191875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-99b38bb8-584c-400e-8134-af475f9cdcdf None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:31.193130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-99b38bb8-584c-400e-8134-af475f9cdcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:31.213144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:31.216336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:31.246340 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b1033-fd53-452b-a7da-1bcf68d32c30 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:31.251369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a1b17-a61c-4086-9b4b-13f0ab84ffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:31.252615 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a1b17-a61c-4086-9b4b-13f0ab84ffb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.252889 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a1b17-a61c-4086-9b4b-13f0ab84ffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.253158 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a1b17-a61c-4086-9b4b-13f0ab84ffb1 admin admin] PATH_INFO: `/v3/projects/43768b6cd0c640eea5c48c1e56335dd9/users/2acc523ae31d45178ad24310030ba0e5/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.268975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a1b17-a61c-4086-9b4b-13f0ab84ffb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43768b6cd0c640eea5c48c1e56335dd9, user_id=2acc523ae31d45178ad24310030ba0e5, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:31.271076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 789/1606] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:31.271578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a1b17-a61c-4086-9b4b-13f0ab84ffb1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:31.272151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b38bb8-584c-400e-8134-af475f9cdcdf None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:31.285474 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b38bb8-584c-400e-8134-af475f9cdcdf None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:31.286750 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 818/1607] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:31 2022] PUT /identity/v3/projects/43768b6cd0c640eea5c48c1e56335dd9/users/2acc523ae31d45178ad24310030ba0e5/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:31.288871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a1b17-a61c-4086-9b4b-13f0ab84ffb1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:31.343329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b0648-835e-417b-ae39-4579691e894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:31.343933 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b0648-835e-417b-ae39-4579691e894b admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.344232 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b0648-835e-417b-ae39-4579691e894b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.344502 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b0648-835e-417b-ae39-4579691e894b admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.345147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b0648-835e-417b-ae39-4579691e894b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:31.346809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b0648-835e-417b-ae39-4579691e894b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:31.360386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 790/1608] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:31.360386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81540c58-aa0f-48d0-81cc-f0dc26da6338 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.360386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81540c58-aa0f-48d0-81cc-f0dc26da6338 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.360386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81540c58-aa0f-48d0-81cc-f0dc26da6338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.366812 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a1b17-a61c-4086-9b4b-13f0ab84ffb1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:31.372399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afe428-98b8-437a-ae56-84a0c788d833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:31.373071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afe428-98b8-437a-ae56-84a0c788d833 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.373351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afe428-98b8-437a-ae56-84a0c788d833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.373623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afe428-98b8-437a-ae56-84a0c788d833 admin admin] PATH_INFO: `/v3/projects/7ecf819b4c6d4eda90cec9a989fe3a29/users/8c48a0f56a484813af66d8b691c79113/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.381484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-81540c58-aa0f-48d0-81cc-f0dc26da6338 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:31.382715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-81540c58-aa0f-48d0-81cc-f0dc26da6338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:31.389934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afe428-98b8-437a-ae56-84a0c788d833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ecf819b4c6d4eda90cec9a989fe3a29, user_id=8c48a0f56a484813af66d8b691c79113, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:31.390325 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 791/1609] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:31.393022 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afe428-98b8-437a-ae56-84a0c788d833 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:31.393170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81540c58-aa0f-48d0-81cc-f0dc26da6338 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:31.403379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81540c58-aa0f-48d0-81cc-f0dc26da6338 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:31.411646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 819/1610] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:31 2022] PUT /identity/v3/projects/7ecf819b4c6d4eda90cec9a989fe3a29/users/8c48a0f56a484813af66d8b691c79113/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:31.413311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867d53f-fce1-4cdd-aedd-ee520786245d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.413592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867d53f-fce1-4cdd-aedd-ee520786245d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.413859 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867d53f-fce1-4cdd-aedd-ee520786245d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.432889 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4867d53f-fce1-4cdd-aedd-ee520786245d None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:31.434092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4867d53f-fce1-4cdd-aedd-ee520786245d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:31.464590 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3f273-d588-48d5-9e14-6bb198b01109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:31.465210 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3f273-d588-48d5-9e14-6bb198b01109 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.465487 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3f273-d588-48d5-9e14-6bb198b01109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.465755 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3f273-d588-48d5-9e14-6bb198b01109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.466393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3f273-d588-48d5-9e14-6bb198b01109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:31.468332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3f273-d588-48d5-9e14-6bb198b01109 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:31.497737 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 820/1611] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:31.501421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 792/1612] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:31 2022] POST /identity/v3/projects => generated 355 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:31.501421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3f273-d588-48d5-9e14-6bb198b01109 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:31.502450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b04de-4678-4f6e-a872-618e71d0194e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.502450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b04de-4678-4f6e-a872-618e71d0194e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.502450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b04de-4678-4f6e-a872-618e71d0194e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.505168 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-60b3f273-d588-48d5-9e14-6bb198b01109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:31.530784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0f5b04de-4678-4f6e-a872-618e71d0194e None None] MFA Rules not processed for user `af2f7b33cdb84406b1c20eaeb8de286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:31.531903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0f5b04de-4678-4f6e-a872-618e71d0194e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:31.548550 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:31.560255 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:31.569022 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3f273-d588-48d5-9e14-6bb198b01109 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:31.573471 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805388b7-ae0a-45b8-a377-8f1bd81b1c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:31.574261 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805388b7-ae0a-45b8-a377-8f1bd81b1c66 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.574557 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805388b7-ae0a-45b8-a377-8f1bd81b1c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.574836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805388b7-ae0a-45b8-a377-8f1bd81b1c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.603553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 821/1613] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:31.604837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697a503-1ded-4e7e-a00a-944ba2d3156d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.605117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697a503-1ded-4e7e-a00a-944ba2d3156d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.605383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697a503-1ded-4e7e-a00a-944ba2d3156d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.634423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0697a503-1ded-4e7e-a00a-944ba2d3156d None None] MFA Rules not processed for user `2acc523ae31d45178ad24310030ba0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:31.635649 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0697a503-1ded-4e7e-a00a-944ba2d3156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:31.643665 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805388b7-ae0a-45b8-a377-8f1bd81b1c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:31.645212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805388b7-ae0a-45b8-a377-8f1bd81b1c66 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:31.655451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 793/1614] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:31.656306 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805388b7-ae0a-45b8-a377-8f1bd81b1c66 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:31.665993 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805388b7-ae0a-45b8-a377-8f1bd81b1c66 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:31.673236 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d0d5b-c92a-4cc7-9fa2-fba4f1adbe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:31.674518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d0d5b-c92a-4cc7-9fa2-fba4f1adbe7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.674846 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d0d5b-c92a-4cc7-9fa2-fba4f1adbe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.675116 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d0d5b-c92a-4cc7-9fa2-fba4f1adbe7a admin admin] PATH_INFO: `/v3/projects/b854c8cb9dc5493e97e3d34bec1d2db9/users/6b739831eb5c43f4ade05972ada8a8e3/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.694863 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d0d5b-c92a-4cc7-9fa2-fba4f1adbe7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b854c8cb9dc5493e97e3d34bec1d2db9, user_id=6b739831eb5c43f4ade05972ada8a8e3, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:31.697777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d0d5b-c92a-4cc7-9fa2-fba4f1adbe7a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:31.710117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 822/1615] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:31.716267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 794/1616] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:31 2022] PUT /identity/v3/projects/b854c8cb9dc5493e97e3d34bec1d2db9/users/6b739831eb5c43f4ade05972ada8a8e3/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:31.716267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c95c3-0d10-4064-acff-fcd75b7baa80 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.716267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c95c3-0d10-4064-acff-fcd75b7baa80 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.716267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c95c3-0d10-4064-acff-fcd75b7baa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.722487 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697a503-1ded-4e7e-a00a-944ba2d3156d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:31.732579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697a503-1ded-4e7e-a00a-944ba2d3156d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:31.738736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-145c95c3-0d10-4064-acff-fcd75b7baa80 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:31.740308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-145c95c3-0d10-4064-acff-fcd75b7baa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:31.802278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b340052-ad0d-4370-9131-e1543399039d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:31.803037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b340052-ad0d-4370-9131-e1543399039d service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.803318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b340052-ad0d-4370-9131-e1543399039d service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.803584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b340052-ad0d-4370-9131-e1543399039d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.812740 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 795/1617] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:31.813592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c95c3-0d10-4064-acff-fcd75b7baa80 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:31.823705 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c95c3-0d10-4064-acff-fcd75b7baa80 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:31.829508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44ffef-4b0c-40cb-804a-8a7ef0b3d3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:31.830298 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44ffef-4b0c-40cb-804a-8a7ef0b3d3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.830653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44ffef-4b0c-40cb-804a-8a7ef0b3d3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.830993 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44ffef-4b0c-40cb-804a-8a7ef0b3d3e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.831694 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44ffef-4b0c-40cb-804a-8a7ef0b3d3e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:31.834090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44ffef-4b0c-40cb-804a-8a7ef0b3d3e5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:31.869130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 796/1618] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:31 2022] POST /identity/v3/users => generated 284 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:31.870353 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44ffef-4b0c-40cb-804a-8a7ef0b3d3e5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:31.886533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44ffef-4b0c-40cb-804a-8a7ef0b3d3e5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:31.889319 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b340052-ad0d-4370-9131-e1543399039d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:31.890312 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c5f09-0cea-4175-aef9-dbe82d9acfbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:31.890761 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b340052-ad0d-4370-9131-e1543399039d service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:31.891012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c5f09-0cea-4175-aef9-dbe82d9acfbb service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.891291 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c5f09-0cea-4175-aef9-dbe82d9acfbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.892001 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c5f09-0cea-4175-aef9-dbe82d9acfbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.903984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 823/1619] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:31.903984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b340052-ad0d-4370-9131-e1543399039d service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:31.905404 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c5f09-0cea-4175-aef9-dbe82d9acfbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:31.907179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c5f09-0cea-4175-aef9-dbe82d9acfbb service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:31.916291 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b340052-ad0d-4370-9131-e1543399039d service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:31.918427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 797/1620] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:31.918916 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c5f09-0cea-4175-aef9-dbe82d9acfbb service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:31.923432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb2fd8-8cc4-46e0-845e-d6a793dbcc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:31.924738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb2fd8-8cc4-46e0-845e-d6a793dbcc22 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.924957 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb2fd8-8cc4-46e0-845e-d6a793dbcc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.925850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb2fd8-8cc4-46e0-845e-d6a793dbcc22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.926490 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb2fd8-8cc4-46e0-845e-d6a793dbcc22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:31.928866 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb2fd8-8cc4-46e0-845e-d6a793dbcc22 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:31.929146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c5f09-0cea-4175-aef9-dbe82d9acfbb service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:31.933930 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:31.935046 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761411e-95d4-4025-a457-9ace48c25319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:31.936163 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761411e-95d4-4025-a457-9ace48c25319 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.936163 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761411e-95d4-4025-a457-9ace48c25319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.936373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761411e-95d4-4025-a457-9ace48c25319 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.937046 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761411e-95d4-4025-a457-9ace48c25319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:31.938716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761411e-95d4-4025-a457-9ace48c25319 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:31.950442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 798/1621] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:31.951613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa42d6-77dc-45be-b4ec-6a02f6f74226 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:31.951987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa42d6-77dc-45be-b4ec-6a02f6f74226 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:31.952324 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa42d6-77dc-45be-b4ec-6a02f6f74226 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:31.954709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 799/1622] 10.222.0.48 () {54 vars in 962 bytes} [Tue Aug 30 05:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:09:31.957158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa42d6-77dc-45be-b4ec-6a02f6f74226 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:31.963602 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 824/1623] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:31 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:31.964482 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb2fd8-8cc4-46e0-845e-d6a793dbcc22 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:31.973199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa42d6-77dc-45be-b4ec-6a02f6f74226 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:31.999572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:32.044949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb2fd8-8cc4-46e0-845e-d6a793dbcc22 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:32.045547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d4b3e-3519-4067-a9bc-0d17c2a3e37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:32.046213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4b3e-3519-4067-a9bc-0d17c2a3e37c service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:32.046765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4b3e-3519-4067-a9bc-0d17c2a3e37c service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:32.046921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4b3e-3519-4067-a9bc-0d17c2a3e37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:32.051412 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc3ec0-e519-4251-b787-173090564e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:32.052164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc3ec0-e519-4251-b787-173090564e4a admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:32.052655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc3ec0-e519-4251-b787-173090564e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:32.053064 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc3ec0-e519-4251-b787-173090564e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:32.053942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc3ec0-e519-4251-b787-173090564e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:32.056292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc3ec0-e519-4251-b787-173090564e4a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:32.060209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d4b3e-3519-4067-a9bc-0d17c2a3e37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:32.062208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d4b3e-3519-4067-a9bc-0d17c2a3e37c service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:32.071674 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 825/1624] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:32.071674 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc3ec0-e519-4251-b787-173090564e4a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:32.081570 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc3ec0-e519-4251-b787-173090564e4a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:32.082238 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 800/1625] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:32.083698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099a16d-23a3-41cf-9a13-221b0d8b2176 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:32.084433 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099a16d-23a3-41cf-9a13-221b0d8b2176 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:32.084433 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099a16d-23a3-41cf-9a13-221b0d8b2176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:32.100309 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6595d0-5d66-43f4-b796-8569f8a2eebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:32.101372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6595d0-5d66-43f4-b796-8569f8a2eebd admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:32.102684 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6595d0-5d66-43f4-b796-8569f8a2eebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:32.103218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6595d0-5d66-43f4-b796-8569f8a2eebd admin admin] PATH_INFO: `/v3/projects/b854c8cb9dc5493e97e3d34bec1d2db9/users/6b739831eb5c43f4ade05972ada8a8e3/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:32.106720 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6595d0-5d66-43f4-b796-8569f8a2eebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b854c8cb9dc5493e97e3d34bec1d2db9, user_id=6b739831eb5c43f4ade05972ada8a8e3, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:32.112399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6595d0-5d66-43f4-b796-8569f8a2eebd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:32.139607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 826/1626] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:32 2022] PUT /identity/v3/projects/b854c8cb9dc5493e97e3d34bec1d2db9/users/6b739831eb5c43f4ade05972ada8a8e3/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:32.141156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6595d0-5d66-43f4-b796-8569f8a2eebd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:32.148697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6099a16d-23a3-41cf-9a13-221b0d8b2176 None None] MFA Rules not processed for user `1aa002909502426b80c97dbf05dca008`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:32.150506 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6099a16d-23a3-41cf-9a13-221b0d8b2176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:32.274108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6595d0-5d66-43f4-b796-8569f8a2eebd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:32.281205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f549e6-965b-473b-b4b2-780d6f9882cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:32.282106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f549e6-965b-473b-b4b2-780d6f9882cd admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:32.282446 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f549e6-965b-473b-b4b2-780d6f9882cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:32.282794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f549e6-965b-473b-b4b2-780d6f9882cd admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:32.283798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f549e6-965b-473b-b4b2-780d6f9882cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:32.285975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f549e6-965b-473b-b4b2-780d6f9882cd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:32.322716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 827/1627] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:32 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:32.324048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f549e6-965b-473b-b4b2-780d6f9882cd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:32.328406 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 801/1628] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Aug 30 05:09:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:32.329784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e453d88-a9d7-4502-af40-a8225e2f40b6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:32.330077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e453d88-a9d7-4502-af40-a8225e2f40b6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:32.334170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e453d88-a9d7-4502-af40-a8225e2f40b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:32.346962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f549e6-965b-473b-b4b2-780d6f9882cd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:32.358426 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b058e-6edc-4023-8536-8e60ab6f6920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:32.359916 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b058e-6edc-4023-8536-8e60ab6f6920 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:32.360593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b058e-6edc-4023-8536-8e60ab6f6920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:32.361968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b058e-6edc-4023-8536-8e60ab6f6920 admin admin] PATH_INFO: `/v3/projects/fb6cdf17123343759ceb4e689d3c5e1d/users/378febc80d2546f6bf2ecba0c2e33a58/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:32.391775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b058e-6edc-4023-8536-8e60ab6f6920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6cdf17123343759ceb4e689d3c5e1d, user_id=378febc80d2546f6bf2ecba0c2e33a58, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:32.396835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b058e-6edc-4023-8536-8e60ab6f6920 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:32.415321 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4e453d88-a9d7-4502-af40-a8225e2f40b6 None None] MFA Rules not processed for user `6b739831eb5c43f4ade05972ada8a8e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:32.418077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4e453d88-a9d7-4502-af40-a8225e2f40b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:32.422435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 828/1629] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:32 2022] PUT /identity/v3/projects/fb6cdf17123343759ceb4e689d3c5e1d/users/378febc80d2546f6bf2ecba0c2e33a58/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:32.424485 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b058e-6edc-4023-8536-8e60ab6f6920 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:32.487117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:32.525666 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 802/1630] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:32.526709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e453d88-a9d7-4502-af40-a8225e2f40b6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:32.570483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:32.601136 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b058e-6edc-4023-8536-8e60ab6f6920 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:32.620301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ab3d9-402b-441f-9d97-4b2108fe8c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:32.623184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ab3d9-402b-441f-9d97-4b2108fe8c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:32.625074 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ab3d9-402b-441f-9d97-4b2108fe8c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:32.627065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ab3d9-402b-441f-9d97-4b2108fe8c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:32.628522 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ab3d9-402b-441f-9d97-4b2108fe8c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:32.632883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ab3d9-402b-441f-9d97-4b2108fe8c07 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:32.643111 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e453d88-a9d7-4502-af40-a8225e2f40b6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:32.649271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653644a-94fc-44e1-96f0-7d6a4a4c7352 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:32.649976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653644a-94fc-44e1-96f0-7d6a4a4c7352 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:32.650312 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653644a-94fc-44e1-96f0-7d6a4a4c7352 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:32.650653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653644a-94fc-44e1-96f0-7d6a4a4c7352 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:32.654280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 829/1631] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:32.655499 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ab3d9-402b-441f-9d97-4b2108fe8c07 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:32.671019 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ab3d9-402b-441f-9d97-4b2108fe8c07 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:32.679837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6edf31-362b-4178-920a-59c2a6a0f959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:32.680946 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6edf31-362b-4178-920a-59c2a6a0f959 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:32.681469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6edf31-362b-4178-920a-59c2a6a0f959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:32.681946 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6edf31-362b-4178-920a-59c2a6a0f959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:32.683509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6edf31-362b-4178-920a-59c2a6a0f959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:32.685556 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6edf31-362b-4178-920a-59c2a6a0f959 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:32.700020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 830/1632] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:32.701466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6edf31-362b-4178-920a-59c2a6a0f959 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:32.765170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653644a-94fc-44e1-96f0-7d6a4a4c7352 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:32.766816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653644a-94fc-44e1-96f0-7d6a4a4c7352 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:32.789453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 803/1633] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:32.792267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653644a-94fc-44e1-96f0-7d6a4a4c7352 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:32.800063 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6edf31-362b-4178-920a-59c2a6a0f959 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:32.806430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653644a-94fc-44e1-96f0-7d6a4a4c7352 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:32.813460 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cb523-f9c3-4db9-aba1-e9b5a67475e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:32.814471 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cb523-f9c3-4db9-aba1-e9b5a67475e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:32.814898 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cb523-f9c3-4db9-aba1-e9b5a67475e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:32.815321 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cb523-f9c3-4db9-aba1-e9b5a67475e2 admin admin] PATH_INFO: `/v3/projects/ee6a734cb0c44fbbb9d32437fe567188/users/2c23e2b1f1594978aaa4bf51884d2e6a/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:32.835235 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cb523-f9c3-4db9-aba1-e9b5a67475e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6a734cb0c44fbbb9d32437fe567188, user_id=2c23e2b1f1594978aaa4bf51884d2e6a, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:32.836691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa66fdf-e952-4214-8524-1499b2bb443f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:32.839026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa66fdf-e952-4214-8524-1499b2bb443f service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:32.839433 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cb523-f9c3-4db9-aba1-e9b5a67475e2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:32.840415 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa66fdf-e952-4214-8524-1499b2bb443f service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:32.842102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa66fdf-e952-4214-8524-1499b2bb443f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:32.865317 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa66fdf-e952-4214-8524-1499b2bb443f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:32.867316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa66fdf-e952-4214-8524-1499b2bb443f service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:32.874795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 804/1634] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:32 2022] PUT /identity/v3/projects/ee6a734cb0c44fbbb9d32437fe567188/users/2c23e2b1f1594978aaa4bf51884d2e6a/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:32.876033 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cb523-f9c3-4db9-aba1-e9b5a67475e2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:32.878854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 831/1635] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:32.880097 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa66fdf-e952-4214-8524-1499b2bb443f service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:32.893517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa66fdf-e952-4214-8524-1499b2bb443f service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:33.009733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d2a0b-983f-49df-8f3b-917bebae4df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:33.010773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2a0b-983f-49df-8f3b-917bebae4df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:33.011060 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2a0b-983f-49df-8f3b-917bebae4df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:33.011338 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2a0b-983f-49df-8f3b-917bebae4df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:33.012175 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d2a0b-983f-49df-8f3b-917bebae4df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:33.013834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d2a0b-983f-49df-8f3b-917bebae4df6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:33.033860 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 832/1636] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:33.037573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d2a0b-983f-49df-8f3b-917bebae4df6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:33.056942 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cb523-f9c3-4db9-aba1-e9b5a67475e2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:33.067403 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f32b6-bdbf-400d-b0f0-73dfe3824ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:33.068275 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f32b6-bdbf-400d-b0f0-73dfe3824ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:33.068649 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f32b6-bdbf-400d-b0f0-73dfe3824ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:33.068770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d2a0b-983f-49df-8f3b-917bebae4df6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:33.069208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f32b6-bdbf-400d-b0f0-73dfe3824ca2 admin admin] PATH_INFO: `/v3/projects/fb6cdf17123343759ceb4e689d3c5e1d/users/378febc80d2546f6bf2ecba0c2e33a58/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:33.073666 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f32b6-bdbf-400d-b0f0-73dfe3824ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6cdf17123343759ceb4e689d3c5e1d, user_id=378febc80d2546f6bf2ecba0c2e33a58, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:33.076106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37fbb9-1ddd-485d-8042-ccebee36a753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:33.077759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37fbb9-1ddd-485d-8042-ccebee36a753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:33.078100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37fbb9-1ddd-485d-8042-ccebee36a753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:33.078515 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37fbb9-1ddd-485d-8042-ccebee36a753 admin admin] PATH_INFO: `/v3/projects/ee6a734cb0c44fbbb9d32437fe567188/users/2c23e2b1f1594978aaa4bf51884d2e6a/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:33.078646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f32b6-bdbf-400d-b0f0-73dfe3824ca2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:33.083012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37fbb9-1ddd-485d-8042-ccebee36a753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6a734cb0c44fbbb9d32437fe567188, user_id=2c23e2b1f1594978aaa4bf51884d2e6a, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:33.088806 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37fbb9-1ddd-485d-8042-ccebee36a753 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:33.106498 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 805/1637] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:32 2022] PUT /identity/v3/projects/fb6cdf17123343759ceb4e689d3c5e1d/users/378febc80d2546f6bf2ecba0c2e33a58/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:33.108097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f32b6-bdbf-400d-b0f0-73dfe3824ca2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:33.113286 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 833/1638] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:33 2022] PUT /identity/v3/projects/ee6a734cb0c44fbbb9d32437fe567188/users/2c23e2b1f1594978aaa4bf51884d2e6a/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:33.123670 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084b0d-1452-497c-84a4-e8d4433bf555 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:33.128528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084b0d-1452-497c-84a4-e8d4433bf555 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:33.130202 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084b0d-1452-497c-84a4-e8d4433bf555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:33.216086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b3084b0d-1452-497c-84a4-e8d4433bf555 None None] MFA Rules not processed for user `2c23e2b1f1594978aaa4bf51884d2e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:33.217539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b3084b0d-1452-497c-84a4-e8d4433bf555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:33.229484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:33.258762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f32b6-bdbf-400d-b0f0-73dfe3824ca2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:33.305764 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:33.380243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16a7b8-6ad0-4c49-bbe9-ec8b8423c1a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:33.380884 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16a7b8-6ad0-4c49-bbe9-ec8b8423c1a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:33.381409 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16a7b8-6ad0-4c49-bbe9-ec8b8423c1a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:33.381689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16a7b8-6ad0-4c49-bbe9-ec8b8423c1a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:33.400355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 834/1639] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:33.400355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a9ec8-6d99-4df4-bdae-982d8c922eb4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:33.400355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a9ec8-6d99-4df4-bdae-982d8c922eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:33.400355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a9ec8-6d99-4df4-bdae-982d8c922eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:33.473302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0e8a9ec8-6d99-4df4-bdae-982d8c922eb4 None None] MFA Rules not processed for user `378febc80d2546f6bf2ecba0c2e33a58`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:33.474766 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0e8a9ec8-6d99-4df4-bdae-982d8c922eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:33.492383 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16a7b8-6ad0-4c49-bbe9-ec8b8423c1a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:33.494297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16a7b8-6ad0-4c49-bbe9-ec8b8423c1a3 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:33.535868 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 806/1640] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:33.539576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16a7b8-6ad0-4c49-bbe9-ec8b8423c1a3 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:33.577021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16a7b8-6ad0-4c49-bbe9-ec8b8423c1a3 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:33.589974 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49402c4f-4a97-4e4a-94ca-986e235589c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:33.592760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49402c4f-4a97-4e4a-94ca-986e235589c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:33.593401 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49402c4f-4a97-4e4a-94ca-986e235589c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:33.593685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49402c4f-4a97-4e4a-94ca-986e235589c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:33.618570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49402c4f-4a97-4e4a-94ca-986e235589c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:33.619530 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49402c4f-4a97-4e4a-94ca-986e235589c5 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:33.647636 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 807/1641] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:33.649497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797be7f3-e0bd-4b77-808e-40e0f27be85d None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:33.649788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797be7f3-e0bd-4b77-808e-40e0f27be85d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:33.650063 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797be7f3-e0bd-4b77-808e-40e0f27be85d None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:33.655772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 808/1642] 10.222.0.48 () {54 vars in 912 bytes} [Tue Aug 30 05:09:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:09:33.657146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632314b-0ca6-4733-b97c-527136972d51 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:33.657517 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632314b-0ca6-4733-b97c-527136972d51 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:33.660064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632314b-0ca6-4733-b97c-527136972d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:33.661951 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 835/1643] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:33.730252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9632314b-0ca6-4733-b97c-527136972d51 None None] MFA Rules not processed for user `1aa002909502426b80c97dbf05dca008`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:33.733579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9632314b-0ca6-4733-b97c-527136972d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:33.749622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a9ec8-6d99-4df4-bdae-982d8c922eb4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:33.763775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a9ec8-6d99-4df4-bdae-982d8c922eb4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:33.774335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d06a9-2eb8-42a6-b42b-155f5b3f803b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:33.774886 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d06a9-2eb8-42a6-b42b-155f5b3f803b service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:33.775269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d06a9-2eb8-42a6-b42b-155f5b3f803b service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:33.775676 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d06a9-2eb8-42a6-b42b-155f5b3f803b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:33.792628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d06a9-2eb8-42a6-b42b-155f5b3f803b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:33.795753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d06a9-2eb8-42a6-b42b-155f5b3f803b service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:33.825919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 836/1644] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:33.873320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 809/1645] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Aug 30 05:09:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:33.966092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d06a9-2eb8-42a6-b42b-155f5b3f803b service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:33.984181 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d06a9-2eb8-42a6-b42b-155f5b3f803b service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:33.999222 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1971b-6aa7-4b25-b1c7-fbd46364378d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:34.003058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1971b-6aa7-4b25-b1c7-fbd46364378d service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:34.003413 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1971b-6aa7-4b25-b1c7-fbd46364378d service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:34.005308 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1971b-6aa7-4b25-b1c7-fbd46364378d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:34.039038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632314b-0ca6-4733-b97c-527136972d51 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:34.046843 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1971b-6aa7-4b25-b1c7-fbd46364378d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:34.053268 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1971b-6aa7-4b25-b1c7-fbd46364378d service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:34.055521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632314b-0ca6-4733-b97c-527136972d51 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:34.060000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf68670-0aad-4fb7-b918-ce268629db6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:34.061381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf68670-0aad-4fb7-b918-ce268629db6a service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:34.061876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf68670-0aad-4fb7-b918-ce268629db6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:34.062326 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf68670-0aad-4fb7-b918-ce268629db6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:34.076618 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 837/1646] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:34.109976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:34.211743 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf68670-0aad-4fb7-b918-ce268629db6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:34.213577 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf68670-0aad-4fb7-b918-ce268629db6a service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:34.226271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 810/1647] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:34.675979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1971b-6aa7-4b25-b1c7-fbd46364378d service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:34.693882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1971b-6aa7-4b25-b1c7-fbd46364378d service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:34.701663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacf603-3865-455c-a42a-3f97097deeb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:34.703182 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacf603-3865-455c-a42a-3f97097deeb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:34.703961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacf603-3865-455c-a42a-3f97097deeb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:34.706123 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacf603-3865-455c-a42a-3f97097deeb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:35.005273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacf603-3865-455c-a42a-3f97097deeb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:35.011287 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacf603-3865-455c-a42a-3f97097deeb4 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:35.055915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 838/1648] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:09:36.063081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d14ad-b074-471c-a3b9-d27d3e323e57 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:36.063081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d14ad-b074-471c-a3b9-d27d3e323e57 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:36.063081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d14ad-b074-471c-a3b9-d27d3e323e57 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:36.063081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 811/1649] 10.222.0.48 () {54 vars in 962 bytes} [Tue Aug 30 05:09:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:09:36.083057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ee200-2586-4ac4-ae2e-53452c694bac None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:36.083991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ee200-2586-4ac4-ae2e-53452c694bac None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:36.084431 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ee200-2586-4ac4-ae2e-53452c694bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:36.139774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5a1ee200-2586-4ac4-ae2e-53452c694bac None None] MFA Rules not processed for user `1aa002909502426b80c97dbf05dca008`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:36.141712 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5a1ee200-2586-4ac4-ae2e-53452c694bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:36.155927 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 839/1650] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Aug 30 05:09:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:36.162659 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d62d23-93c3-4c67-ab4b-8fdd63a1743b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:36.162957 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d62d23-93c3-4c67-ab4b-8fdd63a1743b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:36.163356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d62d23-93c3-4c67-ab4b-8fdd63a1743b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:36.165627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 812/1651] 10.222.0.48 () {54 vars in 912 bytes} [Tue Aug 30 05:09:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:09:36.175194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaecc4e-b3be-4f46-8cbb-7f4fbf1f23dd None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:36.175910 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaecc4e-b3be-4f46-8cbb-7f4fbf1f23dd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:36.176492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaecc4e-b3be-4f46-8cbb-7f4fbf1f23dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:36.224365 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-acaecc4e-b3be-4f46-8cbb-7f4fbf1f23dd None None] MFA Rules not processed for user `1aa002909502426b80c97dbf05dca008`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:36.225927 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-acaecc4e-b3be-4f46-8cbb-7f4fbf1f23dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:36.240151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 840/1652] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Aug 30 05:09:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:36.270624 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d62d23-93c3-4c67-ab4b-8fdd63a1743b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:36.301863 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d62d23-93c3-4c67-ab4b-8fdd63a1743b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:36.311319 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d42f36-ea39-446b-b315-a0d6365e4f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:36.311815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d42f36-ea39-446b-b315-a0d6365e4f3c service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:36.312125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d42f36-ea39-446b-b315-a0d6365e4f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:36.312394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d42f36-ea39-446b-b315-a0d6365e4f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:36.325872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d42f36-ea39-446b-b315-a0d6365e4f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:36.328092 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d42f36-ea39-446b-b315-a0d6365e4f3c service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:36.342761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 813/1653] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:38.458534 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaecc4e-b3be-4f46-8cbb-7f4fbf1f23dd None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:38.483453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:38.613608 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaecc4e-b3be-4f46-8cbb-7f4fbf1f23dd None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:38.639635 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d3edb-7767-47a4-8014-13a47319d919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:38.640966 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d3edb-7767-47a4-8014-13a47319d919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:38.641481 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d3edb-7767-47a4-8014-13a47319d919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:38.641735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d3edb-7767-47a4-8014-13a47319d919 admin admin] PATH_INFO: `/v3/users/af2f7b33cdb84406b1c20eaeb8de286d` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:38.643389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d3edb-7767-47a4-8014-13a47319d919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2f7b33cdb84406b1c20eaeb8de286d)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:38.652263 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d3edb-7767-47a4-8014-13a47319d919 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:38.736580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-111d3edb-7767-47a4-8014-13a47319d919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2f7b33cdb84406b1c20eaeb8de286d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:38.757165 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-111d3edb-7767-47a4-8014-13a47319d919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2f7b33cdb84406b1c20eaeb8de286d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:38.769129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-111d3edb-7767-47a4-8014-13a47319d919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2f7b33cdb84406b1c20eaeb8de286d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:38.769755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-111d3edb-7767-47a4-8014-13a47319d919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2f7b33cdb84406b1c20eaeb8de286d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:38.806866 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-111d3edb-7767-47a4-8014-13a47319d919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2f7b33cdb84406b1c20eaeb8de286d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:38.821607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 841/1654] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:09:38 2022] DELETE /identity/v3/users/af2f7b33cdb84406b1c20eaeb8de286d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:38.825441 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e95612-8175-4169-9099-15a62d975758 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:38.826434 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e95612-8175-4169-9099-15a62d975758 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:38.826847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e95612-8175-4169-9099-15a62d975758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:38.910793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-99e95612-8175-4169-9099-15a62d975758 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:38.912524 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-99e95612-8175-4169-9099-15a62d975758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:39.124711 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 814/1655] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:09:39.557088 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d3edb-7767-47a4-8014-13a47319d919 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:39.559420 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-111d3edb-7767-47a4-8014-13a47319d919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:39.742264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d3edb-7767-47a4-8014-13a47319d919 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:39.756584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32065cef-d6d6-44d4-a346-87144794f5f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:39.757224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32065cef-d6d6-44d4-a346-87144794f5f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:39.757502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32065cef-d6d6-44d4-a346-87144794f5f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:39.757776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32065cef-d6d6-44d4-a346-87144794f5f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:39.801189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32065cef-d6d6-44d4-a346-87144794f5f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:39.802694 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32065cef-d6d6-44d4-a346-87144794f5f2 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:39.830721 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 842/1656] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:40.185656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e95612-8175-4169-9099-15a62d975758 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:40.188167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-99e95612-8175-4169-9099-15a62d975758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:40.210201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e95612-8175-4169-9099-15a62d975758 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:40.235150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d56b2-dd50-450f-9b56-0c37c26bd7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:40.239882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d56b2-dd50-450f-9b56-0c37c26bd7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:40.240422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d56b2-dd50-450f-9b56-0c37c26bd7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:40.240835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d56b2-dd50-450f-9b56-0c37c26bd7da admin admin] PATH_INFO: `/v3/users/2acc523ae31d45178ad24310030ba0e5` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:40.247841 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d56b2-dd50-450f-9b56-0c37c26bd7da admin admin] RBAC: Authorizing `identity:delete_user(user_id=2acc523ae31d45178ad24310030ba0e5)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:40.249356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-e65d56b2-dd50-450f-9b56-0c37c26bd7da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 05:09:40.249356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 30 05:09:40.249356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: Aug 30 05:09:40.257197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d56b2-dd50-450f-9b56-0c37c26bd7da admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:40.495645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e65d56b2-dd50-450f-9b56-0c37c26bd7da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2acc523ae31d45178ad24310030ba0e5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:40.525909 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e65d56b2-dd50-450f-9b56-0c37c26bd7da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2acc523ae31d45178ad24310030ba0e5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:40.537822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e65d56b2-dd50-450f-9b56-0c37c26bd7da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2acc523ae31d45178ad24310030ba0e5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:40.540461 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e65d56b2-dd50-450f-9b56-0c37c26bd7da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2acc523ae31d45178ad24310030ba0e5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:40.541148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e65d56b2-dd50-450f-9b56-0c37c26bd7da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2acc523ae31d45178ad24310030ba0e5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:40.570229 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 815/1657] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:09:40 2022] DELETE /identity/v3/users/2acc523ae31d45178ad24310030ba0e5 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:40.575058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee96f8-3497-4013-88b1-7622cc1ccc6a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:40.575534 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee96f8-3497-4013-88b1-7622cc1ccc6a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:40.575609 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee96f8-3497-4013-88b1-7622cc1ccc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:40.642850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-48ee96f8-3497-4013-88b1-7622cc1ccc6a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:40.645953 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-48ee96f8-3497-4013-88b1-7622cc1ccc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:40.737644 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:40.830691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 843/1658] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:40.901690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d56b2-dd50-450f-9b56-0c37c26bd7da admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:40.903549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e65d56b2-dd50-450f-9b56-0c37c26bd7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:41.043142 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:41.140199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d56b2-dd50-450f-9b56-0c37c26bd7da admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:41.145622 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b414cc0-e786-4d41-a92a-b4a3fdf46741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:41.147281 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b414cc0-e786-4d41-a92a-b4a3fdf46741 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:41.147769 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b414cc0-e786-4d41-a92a-b4a3fdf46741 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:41.148289 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b414cc0-e786-4d41-a92a-b4a3fdf46741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:41.190661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b414cc0-e786-4d41-a92a-b4a3fdf46741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:41.192196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b414cc0-e786-4d41-a92a-b4a3fdf46741 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:41.218658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 816/1659] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:42.794763 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee96f8-3497-4013-88b1-7622cc1ccc6a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:42.796964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-48ee96f8-3497-4013-88b1-7622cc1ccc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:42.818194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b414cc0-e786-4d41-a92a-b4a3fdf46741 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:42.820202 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7b414cc0-e786-4d41-a92a-b4a3fdf46741 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:42.845443 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee96f8-3497-4013-88b1-7622cc1ccc6a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:42.872134 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b414cc0-e786-4d41-a92a-b4a3fdf46741 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:42.884809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c3c87-73d5-407b-b728-efe206d187ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:42.885677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c3c87-73d5-407b-b728-efe206d187ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:42.885991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01d509-aa02-4c9f-b006-4ef986e1d581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:42.886231 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c3c87-73d5-407b-b728-efe206d187ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:42.887179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c3c87-73d5-407b-b728-efe206d187ea admin admin] PATH_INFO: `/v3/projects/1c5d8915a91e46a884db1384d958dc3b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:42.887498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01d509-aa02-4c9f-b006-4ef986e1d581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:42.887771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01d509-aa02-4c9f-b006-4ef986e1d581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:42.888090 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01d509-aa02-4c9f-b006-4ef986e1d581 admin admin] PATH_INFO: `/v3/projects/43768b6cd0c640eea5c48c1e56335dd9` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:42.889070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c3c87-73d5-407b-b728-efe206d187ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5d8915a91e46a884db1384d958dc3b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:42.891244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01d509-aa02-4c9f-b006-4ef986e1d581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43768b6cd0c640eea5c48c1e56335dd9)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:42.892040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c3c87-73d5-407b-b728-efe206d187ea admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:42.892897 dv-cinder-853910-4-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-ec01d509-aa02-4c9f-b006-4ef986e1d581 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 05:09:42.892897 dv-cinder-853910-4-smb devstack@keystone.service[81676]: warnings.warn(msg) Aug 30 05:09:42.892897 dv-cinder-853910-4-smb devstack@keystone.service[81676]: Aug 30 05:09:42.896736 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01d509-aa02-4c9f-b006-4ef986e1d581 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:43.028266 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ec01d509-aa02-4c9f-b006-4ef986e1d581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43768b6cd0c640eea5c48c1e56335dd9', 'request_id': 'req-ec01d509-aa02-4c9f-b006-4ef986e1d581'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:43.042001 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ec01d509-aa02-4c9f-b006-4ef986e1d581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43768b6cd0c640eea5c48c1e56335dd9', 'request_id': 'req-ec01d509-aa02-4c9f-b006-4ef986e1d581'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:43.061118 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ec01d509-aa02-4c9f-b006-4ef986e1d581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43768b6cd0c640eea5c48c1e56335dd9', 'request_id': 'req-ec01d509-aa02-4c9f-b006-4ef986e1d581'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:43.090402 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ec01d509-aa02-4c9f-b006-4ef986e1d581 admin admin] The token cache is being invalidate because project 43768b6cd0c640eea5c48c1e56335dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:09:43.090825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ec01d509-aa02-4c9f-b006-4ef986e1d581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:43.091894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ec01d509-aa02-4c9f-b006-4ef986e1d581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:43.095780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-606c3c87-73d5-407b-b728-efe206d187ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5d8915a91e46a884db1384d958dc3b', 'request_id': 'req-606c3c87-73d5-407b-b728-efe206d187ea'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:43.107388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-606c3c87-73d5-407b-b728-efe206d187ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5d8915a91e46a884db1384d958dc3b', 'request_id': 'req-606c3c87-73d5-407b-b728-efe206d187ea'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:43.107564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 844/1660] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:09:42 2022] DELETE /identity/v3/projects/43768b6cd0c640eea5c48c1e56335dd9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:43.109894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079ada-0a54-4db9-b6ce-ec687664f8b1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:43.118193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079ada-0a54-4db9-b6ce-ec687664f8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:43.118985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079ada-0a54-4db9-b6ce-ec687664f8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:43.126396 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-606c3c87-73d5-407b-b728-efe206d187ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5d8915a91e46a884db1384d958dc3b', 'request_id': 'req-606c3c87-73d5-407b-b728-efe206d187ea'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:43.153160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-606c3c87-73d5-407b-b728-efe206d187ea admin admin] The token cache is being invalidate because project 1c5d8915a91e46a884db1384d958dc3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:09:43.153873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-606c3c87-73d5-407b-b728-efe206d187ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:43.154988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-606c3c87-73d5-407b-b728-efe206d187ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:43.157577 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 817/1661] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:09:42 2022] DELETE /identity/v3/projects/1c5d8915a91e46a884db1384d958dc3b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:43.163868 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e34c3-a99a-43a5-ab5b-7e7679226bd1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:43.164416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e34c3-a99a-43a5-ab5b-7e7679226bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:43.164831 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e34c3-a99a-43a5-ab5b-7e7679226bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:43.187567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-32079ada-0a54-4db9-b6ce-ec687664f8b1 None None] MFA Rules not processed for user `8c48a0f56a484813af66d8b691c79113`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:43.190187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-32079ada-0a54-4db9-b6ce-ec687664f8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:43.225029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0f7e34c3-a99a-43a5-ab5b-7e7679226bd1 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:43.229785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0f7e34c3-a99a-43a5-ab5b-7e7679226bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:43.359348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 818/1662] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:43.359348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e34c3-a99a-43a5-ab5b-7e7679226bd1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:43.359348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0f7e34c3-a99a-43a5-ab5b-7e7679226bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:43.371294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 845/1663] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:43.371294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8ba84-b9b3-442a-a891-ac4c5bed5870 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:43.371294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8ba84-b9b3-442a-a891-ac4c5bed5870 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:43.371294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8ba84-b9b3-442a-a891-ac4c5bed5870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:43.383649 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e34c3-a99a-43a5-ab5b-7e7679226bd1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:43.391874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccba548-fa6f-4227-b590-42ef4ab9ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:43.393251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccba548-fa6f-4227-b590-42ef4ab9ff90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:43.393600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccba548-fa6f-4227-b590-42ef4ab9ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:43.394757 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccba548-fa6f-4227-b590-42ef4ab9ff90 admin admin] PATH_INFO: `/v3/users/2c23e2b1f1594978aaa4bf51884d2e6a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:43.397056 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccba548-fa6f-4227-b590-42ef4ab9ff90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c23e2b1f1594978aaa4bf51884d2e6a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:43.401163 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccba548-fa6f-4227-b590-42ef4ab9ff90 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:43.417482 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-edb8ba84-b9b3-442a-a891-ac4c5bed5870 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:43.420735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-edb8ba84-b9b3-442a-a891-ac4c5bed5870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:43.433973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 846/1664] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:43.435225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8ba84-b9b3-442a-a891-ac4c5bed5870 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:43.437024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-edb8ba84-b9b3-442a-a891-ac4c5bed5870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:43.509965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:43.519762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cccba548-fa6f-4227-b590-42ef4ab9ff90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c23e2b1f1594978aaa4bf51884d2e6a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:43.546403 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:43.552114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cccba548-fa6f-4227-b590-42ef4ab9ff90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c23e2b1f1594978aaa4bf51884d2e6a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:43.574216 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cccba548-fa6f-4227-b590-42ef4ab9ff90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c23e2b1f1594978aaa4bf51884d2e6a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:43.575862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cccba548-fa6f-4227-b590-42ef4ab9ff90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c23e2b1f1594978aaa4bf51884d2e6a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:43.578735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cccba548-fa6f-4227-b590-42ef4ab9ff90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c23e2b1f1594978aaa4bf51884d2e6a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:43.607132 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 819/1665] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:09:43 2022] DELETE /identity/v3/users/2c23e2b1f1594978aaa4bf51884d2e6a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:43.629241 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccba548-fa6f-4227-b590-42ef4ab9ff90 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:43.632611 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cccba548-fa6f-4227-b590-42ef4ab9ff90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:43.638561 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8ba84-b9b3-442a-a891-ac4c5bed5870 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:43.806293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f9139-490f-488f-aedc-817f4ee9ca10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:43.810951 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f9139-490f-488f-aedc-817f4ee9ca10 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:43.811429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f9139-490f-488f-aedc-817f4ee9ca10 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:43.811867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccba548-fa6f-4227-b590-42ef4ab9ff90 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:43.812019 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f9139-490f-488f-aedc-817f4ee9ca10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:43.817541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c43f9139-490f-488f-aedc-817f4ee9ca10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:43.819826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875d5a6-4c21-42bc-99f8-966a10272fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:43.821410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875d5a6-4c21-42bc-99f8-966a10272fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:43.821870 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875d5a6-4c21-42bc-99f8-966a10272fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:43.822345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875d5a6-4c21-42bc-99f8-966a10272fd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:43.823442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875d5a6-4c21-42bc-99f8-966a10272fd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:09:43.823922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875d5a6-4c21-42bc-99f8-966a10272fd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:43.826117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875d5a6-4c21-42bc-99f8-966a10272fd8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:43.868704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 820/1666] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:09:43.877789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875d5a6-4c21-42bc-99f8-966a10272fd8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:43.910443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875d5a6-4c21-42bc-99f8-966a10272fd8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:43.924832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca9cc4-eb55-4d93-8b13-3b3af651bf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:43.925765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca9cc4-eb55-4d93-8b13-3b3af651bf12 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:43.926117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca9cc4-eb55-4d93-8b13-3b3af651bf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:43.926392 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca9cc4-eb55-4d93-8b13-3b3af651bf12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:43.927047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca9cc4-eb55-4d93-8b13-3b3af651bf12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:43.932060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca9cc4-eb55-4d93-8b13-3b3af651bf12 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:44.003257 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f9139-490f-488f-aedc-817f4ee9ca10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:44.005753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f9139-490f-488f-aedc-817f4ee9ca10 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:44.025763 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 821/1667] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:43 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:44.032807 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca9cc4-eb55-4d93-8b13-3b3af651bf12 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:44.048842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 847/1668] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:44.243134 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca9cc4-eb55-4d93-8b13-3b3af651bf12 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:44.256010 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606090c4-7cf4-4273-8628-fb6a7dd1c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:44.258485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606090c4-7cf4-4273-8628-fb6a7dd1c2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:44.263688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606090c4-7cf4-4273-8628-fb6a7dd1c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:44.265204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606090c4-7cf4-4273-8628-fb6a7dd1c2b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:44.266494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606090c4-7cf4-4273-8628-fb6a7dd1c2b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:44.271663 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606090c4-7cf4-4273-8628-fb6a7dd1c2b4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:44.326546 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 822/1669] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:44 2022] POST /identity/v3/users => generated 284 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:44.332056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f9139-490f-488f-aedc-817f4ee9ca10 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:44.370516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f9139-490f-488f-aedc-817f4ee9ca10 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:44.398816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96272f-caf4-48c0-9745-d77cd3045d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:44.400590 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96272f-caf4-48c0-9745-d77cd3045d17 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:44.400876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96272f-caf4-48c0-9745-d77cd3045d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:44.403282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96272f-caf4-48c0-9745-d77cd3045d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:44.404032 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96272f-caf4-48c0-9745-d77cd3045d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:44.409722 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96272f-caf4-48c0-9745-d77cd3045d17 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:44.473123 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 848/1670] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:44.477161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606090c4-7cf4-4273-8628-fb6a7dd1c2b4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:44.493173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606090c4-7cf4-4273-8628-fb6a7dd1c2b4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:44.517295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e07c1-2a37-4e03-a5c1-39c3de0d5d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:44.517918 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e07c1-2a37-4e03-a5c1-39c3de0d5d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:44.519902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e07c1-2a37-4e03-a5c1-39c3de0d5d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:44.520222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e07c1-2a37-4e03-a5c1-39c3de0d5d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:44.521437 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e07c1-2a37-4e03-a5c1-39c3de0d5d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:44.527491 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e07c1-2a37-4e03-a5c1-39c3de0d5d5e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:44.547378 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 823/1671] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:44.552128 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96272f-caf4-48c0-9745-d77cd3045d17 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:44.563923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96272f-caf4-48c0-9745-d77cd3045d17 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:44.569694 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefa4ee-3b25-4999-8ece-52ef23eb4b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:44.570372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefa4ee-3b25-4999-8ece-52ef23eb4b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:44.570650 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefa4ee-3b25-4999-8ece-52ef23eb4b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:44.570925 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefa4ee-3b25-4999-8ece-52ef23eb4b26 admin admin] PATH_INFO: `/v3/projects/d7982474d3164f1ca130e6d4053cad30/users/20c6734138ca4e44b663c60a98235d3a/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:44.593634 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefa4ee-3b25-4999-8ece-52ef23eb4b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7982474d3164f1ca130e6d4053cad30, user_id=20c6734138ca4e44b663c60a98235d3a, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:44.598791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefa4ee-3b25-4999-8ece-52ef23eb4b26 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:44.633408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79323e9-c29e-4ae6-95a9-fa6d42d31662 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:44.633584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 849/1672] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:44 2022] PUT /identity/v3/projects/d7982474d3164f1ca130e6d4053cad30/users/20c6734138ca4e44b663c60a98235d3a/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:44.633872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79323e9-c29e-4ae6-95a9-fa6d42d31662 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:44.634408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79323e9-c29e-4ae6-95a9-fa6d42d31662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:44.678278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:44.701002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c79323e9-c29e-4ae6-95a9-fa6d42d31662 None None] MFA Rules not processed for user `20c6734138ca4e44b663c60a98235d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:44.702859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c79323e9-c29e-4ae6-95a9-fa6d42d31662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:44.839108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 824/1673] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:44.845054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefa4ee-3b25-4999-8ece-52ef23eb4b26 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:44.945940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:44.992171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefa4ee-3b25-4999-8ece-52ef23eb4b26 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:45.006932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751692e4-7c15-465e-8906-8d5e4a2cfadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:45.007698 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751692e4-7c15-465e-8906-8d5e4a2cfadf admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:45.008306 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751692e4-7c15-465e-8906-8d5e4a2cfadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:45.008429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751692e4-7c15-465e-8906-8d5e4a2cfadf admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:45.009088 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751692e4-7c15-465e-8906-8d5e4a2cfadf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:45.011034 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751692e4-7c15-465e-8906-8d5e4a2cfadf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:45.071421 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 850/1674] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:44 2022] POST /identity/v3/projects => generated 367 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:45.075486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79323e9-c29e-4ae6-95a9-fa6d42d31662 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:45.090965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79323e9-c29e-4ae6-95a9-fa6d42d31662 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:45.328638 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de9b15-e912-4dc6-958a-fbf745356285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:45.330761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de9b15-e912-4dc6-958a-fbf745356285 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:45.332964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de9b15-e912-4dc6-958a-fbf745356285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:45.333262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de9b15-e912-4dc6-958a-fbf745356285 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:45.334011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de9b15-e912-4dc6-958a-fbf745356285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:45.356623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de9b15-e912-4dc6-958a-fbf745356285 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:45.448498 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 825/1675] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:45 2022] POST /identity/v3/users => generated 290 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:09:45.452235 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751692e4-7c15-465e-8906-8d5e4a2cfadf admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:45.473915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751692e4-7c15-465e-8906-8d5e4a2cfadf admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:45.484354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1b3ae-5a80-4d48-bc56-84e978a9bd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:45.484994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1b3ae-5a80-4d48-bc56-84e978a9bd46 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:45.486724 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1b3ae-5a80-4d48-bc56-84e978a9bd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:45.487901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1b3ae-5a80-4d48-bc56-84e978a9bd46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:45.489914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1b3ae-5a80-4d48-bc56-84e978a9bd46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:45.496981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1b3ae-5a80-4d48-bc56-84e978a9bd46 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:45.536676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de9b15-e912-4dc6-958a-fbf745356285 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:45.538347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 851/1676] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:45.552308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de9b15-e912-4dc6-958a-fbf745356285 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:45.582709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb32c23-f5b8-40b8-be1e-7c84fb4182a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:45.584612 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb32c23-f5b8-40b8-be1e-7c84fb4182a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:45.586098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb32c23-f5b8-40b8-be1e-7c84fb4182a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:45.587278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb32c23-f5b8-40b8-be1e-7c84fb4182a4 admin admin] PATH_INFO: `/v3/projects/f07f0a4236e144bd9230fc760568d252/users/b73cd53360bd421bb402d67ad3f11ed7/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:45.662730 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb32c23-f5b8-40b8-be1e-7c84fb4182a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07f0a4236e144bd9230fc760568d252, user_id=b73cd53360bd421bb402d67ad3f11ed7, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:45.680290 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb32c23-f5b8-40b8-be1e-7c84fb4182a4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:45.713480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 826/1677] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:45 2022] PUT /identity/v3/projects/f07f0a4236e144bd9230fc760568d252/users/b73cd53360bd421bb402d67ad3f11ed7/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:09:45.718149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1b3ae-5a80-4d48-bc56-84e978a9bd46 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:45.734833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1b3ae-5a80-4d48-bc56-84e978a9bd46 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:45.924408 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1372a7a-101b-48e8-ba3f-d8a3fb5cbd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:45.925080 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1372a7a-101b-48e8-ba3f-d8a3fb5cbd0a admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:45.925207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1372a7a-101b-48e8-ba3f-d8a3fb5cbd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:45.926808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1372a7a-101b-48e8-ba3f-d8a3fb5cbd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:45.931203 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1372a7a-101b-48e8-ba3f-d8a3fb5cbd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:45.933149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1372a7a-101b-48e8-ba3f-d8a3fb5cbd0a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:45.980227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 852/1678] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:09:45.984103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb32c23-f5b8-40b8-be1e-7c84fb4182a4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:46.009419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb32c23-f5b8-40b8-be1e-7c84fb4182a4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:46.021920 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1126aeb-29ab-4168-863f-7269b04ded25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:46.023224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1126aeb-29ab-4168-863f-7269b04ded25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:46.023713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1126aeb-29ab-4168-863f-7269b04ded25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:46.024524 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1126aeb-29ab-4168-863f-7269b04ded25 admin admin] PATH_INFO: `/v3/projects/f07f0a4236e144bd9230fc760568d252/users/b73cd53360bd421bb402d67ad3f11ed7/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:46.028713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1126aeb-29ab-4168-863f-7269b04ded25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07f0a4236e144bd9230fc760568d252, user_id=b73cd53360bd421bb402d67ad3f11ed7, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:46.033101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1126aeb-29ab-4168-863f-7269b04ded25 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:46.055722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 827/1679] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:45 2022] PUT /identity/v3/projects/f07f0a4236e144bd9230fc760568d252/users/b73cd53360bd421bb402d67ad3f11ed7/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:46.065942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5358f1-717b-4e67-979d-aff6d472bb2e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:46.066230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5358f1-717b-4e67-979d-aff6d472bb2e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:46.066505 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5358f1-717b-4e67-979d-aff6d472bb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:46.148398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2e5358f1-717b-4e67-979d-aff6d472bb2e None None] MFA Rules not processed for user `b73cd53360bd421bb402d67ad3f11ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:46.148681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2e5358f1-717b-4e67-979d-aff6d472bb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:46.314635 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 853/1680] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:46.326061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1126aeb-29ab-4168-863f-7269b04ded25 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:46.328652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b1126aeb-29ab-4168-863f-7269b04ded25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:46.496734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1126aeb-29ab-4168-863f-7269b04ded25 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:46.509962 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b01f1-f49f-4d7e-bd27-5e68fee1a0aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:46.513488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b01f1-f49f-4d7e-bd27-5e68fee1a0aa service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:46.516094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b01f1-f49f-4d7e-bd27-5e68fee1a0aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:46.519152 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b01f1-f49f-4d7e-bd27-5e68fee1a0aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:46.540663 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:46.547096 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b01f1-f49f-4d7e-bd27-5e68fee1a0aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:46.550497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b01f1-f49f-4d7e-bd27-5e68fee1a0aa service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:46.590380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 828/1681] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:46.613405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5358f1-717b-4e67-979d-aff6d472bb2e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:46.615125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2e5358f1-717b-4e67-979d-aff6d472bb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:46.810807 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:46.881605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5358f1-717b-4e67-979d-aff6d472bb2e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:46.900333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac156343-d7a9-4bbc-9971-fb159515f761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:46.901270 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac156343-d7a9-4bbc-9971-fb159515f761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:46.901757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac156343-d7a9-4bbc-9971-fb159515f761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:46.903680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac156343-d7a9-4bbc-9971-fb159515f761 admin admin] PATH_INFO: `/v3/projects/ee6a734cb0c44fbbb9d32437fe567188` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:46.911788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac156343-d7a9-4bbc-9971-fb159515f761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6a734cb0c44fbbb9d32437fe567188)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:46.913843 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac156343-d7a9-4bbc-9971-fb159515f761 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:47.085716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ac156343-d7a9-4bbc-9971-fb159515f761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6a734cb0c44fbbb9d32437fe567188', 'request_id': 'req-ac156343-d7a9-4bbc-9971-fb159515f761'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:47.109980 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ac156343-d7a9-4bbc-9971-fb159515f761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6a734cb0c44fbbb9d32437fe567188', 'request_id': 'req-ac156343-d7a9-4bbc-9971-fb159515f761'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:47.123868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ac156343-d7a9-4bbc-9971-fb159515f761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6a734cb0c44fbbb9d32437fe567188', 'request_id': 'req-ac156343-d7a9-4bbc-9971-fb159515f761'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:47.164641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ac156343-d7a9-4bbc-9971-fb159515f761 admin admin] The token cache is being invalidate because project ee6a734cb0c44fbbb9d32437fe567188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:09:47.166693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ac156343-d7a9-4bbc-9971-fb159515f761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:47.167845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ac156343-d7a9-4bbc-9971-fb159515f761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:47.178510 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 854/1682] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:09:46 2022] DELETE /identity/v3/projects/ee6a734cb0c44fbbb9d32437fe567188 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:47.183777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b7ab0-bc1e-4c21-9267-a9980cc4cca1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:47.184931 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b7ab0-bc1e-4c21-9267-a9980cc4cca1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:47.185457 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b7ab0-bc1e-4c21-9267-a9980cc4cca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:47.237364 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-216b7ab0-bc1e-4c21-9267-a9980cc4cca1 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:47.242629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-216b7ab0-bc1e-4c21-9267-a9980cc4cca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:47.433872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38d88b-92d8-439f-a825-739af5471f67 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:47.434582 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38d88b-92d8-439f-a825-739af5471f67 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:47.434911 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 829/1683] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:47.435089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38d88b-92d8-439f-a825-739af5471f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:47.503462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7b38d88b-92d8-439f-a825-739af5471f67 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:47.504490 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7b38d88b-92d8-439f-a825-739af5471f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:47.550853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 855/1684] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:09:47.558818 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b7ab0-bc1e-4c21-9267-a9980cc4cca1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:47.585835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b7ab0-bc1e-4c21-9267-a9980cc4cca1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:47.616197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92433688-3834-4989-9623-69cebf393925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:47.616875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92433688-3834-4989-9623-69cebf393925 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:47.620234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92433688-3834-4989-9623-69cebf393925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:47.629602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92433688-3834-4989-9623-69cebf393925 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:47.634028 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92433688-3834-4989-9623-69cebf393925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:09:47.634445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92433688-3834-4989-9623-69cebf393925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:47.641442 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5866-4cf3-49b8-bc80-c18bd6b205b4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:47.641734 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5866-4cf3-49b8-bc80-c18bd6b205b4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:47.642566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5866-4cf3-49b8-bc80-c18bd6b205b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:47.645889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92433688-3834-4989-9623-69cebf393925 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:47.700072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 830/1685] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:09:47.701159 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92433688-3834-4989-9623-69cebf393925 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:47.717321 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92433688-3834-4989-9623-69cebf393925 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:47.724309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3779e18-b7a3-4df2-bddf-1ecfbbb7e0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:47.724953 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3779e18-b7a3-4df2-bddf-1ecfbbb7e0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:47.725237 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3779e18-b7a3-4df2-bddf-1ecfbbb7e0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:47.725517 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3779e18-b7a3-4df2-bddf-1ecfbbb7e0b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:47.726321 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3779e18-b7a3-4df2-bddf-1ecfbbb7e0b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:47.729259 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3779e18-b7a3-4df2-bddf-1ecfbbb7e0b1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:47.756494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8b7d5866-4cf3-49b8-bc80-c18bd6b205b4 None None] MFA Rules not processed for user `30a180efbf754d458ed13e4401296bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:47.757757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8b7d5866-4cf3-49b8-bc80-c18bd6b205b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:47.799617 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 831/1686] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:47 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:47.802244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3779e18-b7a3-4df2-bddf-1ecfbbb7e0b1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:48.005688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 856/1687] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:48.017513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8801a9c-f2e8-4e44-832e-f4c10b8339f1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:48.018031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8801a9c-f2e8-4e44-832e-f4c10b8339f1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:48.019376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8801a9c-f2e8-4e44-832e-f4c10b8339f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:48.053504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3779e18-b7a3-4df2-bddf-1ecfbbb7e0b1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:48.071971 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db217c7-38cd-454d-8057-71d866d9f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:48.079733 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db217c7-38cd-454d-8057-71d866d9f831 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:48.080209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db217c7-38cd-454d-8057-71d866d9f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:48.080711 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db217c7-38cd-454d-8057-71d866d9f831 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:48.081493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db217c7-38cd-454d-8057-71d866d9f831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:48.084720 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a8801a9c-f2e8-4e44-832e-f4c10b8339f1 None None] MFA Rules not processed for user `30a180efbf754d458ed13e4401296bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:48.087829 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db217c7-38cd-454d-8057-71d866d9f831 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:48.089340 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a8801a9c-f2e8-4e44-832e-f4c10b8339f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:48.148695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 832/1688] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:47 2022] POST /identity/v3/users => generated 294 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:48.151390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db217c7-38cd-454d-8057-71d866d9f831 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:48.176484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db217c7-38cd-454d-8057-71d866d9f831 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:48.200576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223707b-db5f-4343-ad11-ef85c130997c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:48.202864 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223707b-db5f-4343-ad11-ef85c130997c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:48.203738 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223707b-db5f-4343-ad11-ef85c130997c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:48.204576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223707b-db5f-4343-ad11-ef85c130997c admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:48.206807 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223707b-db5f-4343-ad11-ef85c130997c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:48.209843 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223707b-db5f-4343-ad11-ef85c130997c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:48.217534 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:48.252549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 833/1689] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:48.258274 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223707b-db5f-4343-ad11-ef85c130997c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:48.263092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 857/1690] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:48.282206 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8801a9c-f2e8-4e44-832e-f4c10b8339f1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:48.284466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a8801a9c-f2e8-4e44-832e-f4c10b8339f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:48.304747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223707b-db5f-4343-ad11-ef85c130997c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:48.315264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39036737-f8fe-4a73-b9d4-8d3cb3b1e0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:48.315901 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39036737-f8fe-4a73-b9d4-8d3cb3b1e0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:48.318448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39036737-f8fe-4a73-b9d4-8d3cb3b1e0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:48.318811 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39036737-f8fe-4a73-b9d4-8d3cb3b1e0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:48.320773 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39036737-f8fe-4a73-b9d4-8d3cb3b1e0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:48.336730 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39036737-f8fe-4a73-b9d4-8d3cb3b1e0c8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:48.382108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 834/1691] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:09:48.387731 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39036737-f8fe-4a73-b9d4-8d3cb3b1e0c8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:48.399629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39036737-f8fe-4a73-b9d4-8d3cb3b1e0c8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:48.421242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2737e5a-21e3-4c20-9764-832db143867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:48.429297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2737e5a-21e3-4c20-9764-832db143867d admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:48.429630 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2737e5a-21e3-4c20-9764-832db143867d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:48.429839 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2737e5a-21e3-4c20-9764-832db143867d admin admin] PATH_INFO: `/v3/projects/cfb33ebaf59d4fe2bd0613c9518bea2a/users/972477d19ae64c54b7f086d1b2a47585/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:48.463476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2737e5a-21e3-4c20-9764-832db143867d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb33ebaf59d4fe2bd0613c9518bea2a, user_id=972477d19ae64c54b7f086d1b2a47585, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:48.469776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2737e5a-21e3-4c20-9764-832db143867d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:48.476669 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8801a9c-f2e8-4e44-832e-f4c10b8339f1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:48.486835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bed28-aa18-4d25-a6ba-4601d3b1edf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:48.488116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bed28-aa18-4d25-a6ba-4601d3b1edf8 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:48.488614 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bed28-aa18-4d25-a6ba-4601d3b1edf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:48.489507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bed28-aa18-4d25-a6ba-4601d3b1edf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:48.507383 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 835/1692] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:48 2022] PUT /identity/v3/projects/cfb33ebaf59d4fe2bd0613c9518bea2a/users/972477d19ae64c54b7f086d1b2a47585/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:09:48.511070 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bed28-aa18-4d25-a6ba-4601d3b1edf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:48.511639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be6c5-08f7-4db3-bd87-ecdbc804de78 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:48.511933 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be6c5-08f7-4db3-bd87-ecdbc804de78 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:48.512282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be6c5-08f7-4db3-bd87-ecdbc804de78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:48.514329 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bed28-aa18-4d25-a6ba-4601d3b1edf8 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:48.527744 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:48.535460 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 858/1693] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:09:48.631964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4d9be6c5-08f7-4db3-bd87-ecdbc804de78 None None] MFA Rules not processed for user `972477d19ae64c54b7f086d1b2a47585`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:48.637077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4d9be6c5-08f7-4db3-bd87-ecdbc804de78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:48.938589 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 836/1694] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:09:48.942990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bed28-aa18-4d25-a6ba-4601d3b1edf8 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:48.957759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bed28-aa18-4d25-a6ba-4601d3b1edf8 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:49.239106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6cfcc-e308-4eba-a16a-03f334a97682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:49.239857 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6cfcc-e308-4eba-a16a-03f334a97682 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:49.240236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6cfcc-e308-4eba-a16a-03f334a97682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:49.240362 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6cfcc-e308-4eba-a16a-03f334a97682 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:49.240945 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6cfcc-e308-4eba-a16a-03f334a97682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:49.255689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6cfcc-e308-4eba-a16a-03f334a97682 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:49.363647 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 859/1695] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:48 2022] POST /identity/v3/projects => generated 385 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:49.369459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9be6c5-08f7-4db3-bd87-ecdbc804de78 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:49.398841 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9be6c5-08f7-4db3-bd87-ecdbc804de78 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:49.620323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581573c1-49b7-4ab9-b3be-742b9011fe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:49.627408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581573c1-49b7-4ab9-b3be-742b9011fe0a admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:49.627408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581573c1-49b7-4ab9-b3be-742b9011fe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:49.627408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581573c1-49b7-4ab9-b3be-742b9011fe0a admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:49.627778 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581573c1-49b7-4ab9-b3be-742b9011fe0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:49.640613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581573c1-49b7-4ab9-b3be-742b9011fe0a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:49.704017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 837/1696] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:49 2022] POST /identity/v3/users => generated 299 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:49.707236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6cfcc-e308-4eba-a16a-03f334a97682 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:49.725766 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6cfcc-e308-4eba-a16a-03f334a97682 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:49.741448 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc8972-012b-44b5-9e4d-f36520f74a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:49.741870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc8972-012b-44b5-9e4d-f36520f74a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:49.742146 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc8972-012b-44b5-9e4d-f36520f74a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:49.742415 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc8972-012b-44b5-9e4d-f36520f74a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:49.743266 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc8972-012b-44b5-9e4d-f36520f74a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:49.747339 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc8972-012b-44b5-9e4d-f36520f74a6a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:49.787215 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581573c1-49b7-4ab9-b3be-742b9011fe0a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:49.790603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 860/1697] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:49.810111 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581573c1-49b7-4ab9-b3be-742b9011fe0a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:49.824474 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12938829-2403-4ea4-aecc-6cacccf90bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:49.827352 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12938829-2403-4ea4-aecc-6cacccf90bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:49.827638 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12938829-2403-4ea4-aecc-6cacccf90bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:49.827924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12938829-2403-4ea4-aecc-6cacccf90bf8 admin admin] PATH_INFO: `/v3/projects/4e57b33d290949e6be82626dd517f669/users/a10482ad316f463d89e24186ea353368/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:49.887122 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12938829-2403-4ea4-aecc-6cacccf90bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e57b33d290949e6be82626dd517f669, user_id=a10482ad316f463d89e24186ea353368, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:49.894840 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12938829-2403-4ea4-aecc-6cacccf90bf8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:49.928070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 838/1698] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:49 2022] PUT /identity/v3/projects/4e57b33d290949e6be82626dd517f669/users/a10482ad316f463d89e24186ea353368/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:49.931839 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc8972-012b-44b5-9e4d-f36520f74a6a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:49.955718 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc8972-012b-44b5-9e4d-f36520f74a6a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:50.178070 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:50.202296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5539b6-42e2-4406-a82e-7d2518af85b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:50.202931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5539b6-42e2-4406-a82e-7d2518af85b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:50.203370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5539b6-42e2-4406-a82e-7d2518af85b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:50.203805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5539b6-42e2-4406-a82e-7d2518af85b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:50.205190 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5539b6-42e2-4406-a82e-7d2518af85b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:50.206972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5539b6-42e2-4406-a82e-7d2518af85b4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:50.249634 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 861/1699] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:50.253781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12938829-2403-4ea4-aecc-6cacccf90bf8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:50.275537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12938829-2403-4ea4-aecc-6cacccf90bf8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:50.302191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba62b-56e9-455a-8310-8c026f6a7312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:50.306471 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba62b-56e9-455a-8310-8c026f6a7312 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:50.308060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba62b-56e9-455a-8310-8c026f6a7312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:50.308437 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba62b-56e9-455a-8310-8c026f6a7312 admin admin] PATH_INFO: `/v3/projects/4e57b33d290949e6be82626dd517f669/users/a10482ad316f463d89e24186ea353368/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:50.313674 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ba62b-56e9-455a-8310-8c026f6a7312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e57b33d290949e6be82626dd517f669, user_id=a10482ad316f463d89e24186ea353368, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:50.331143 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ba62b-56e9-455a-8310-8c026f6a7312 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:50.350576 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05dff8-4f05-4492-98b3-e3da40d92930 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:50.351088 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05dff8-4f05-4492-98b3-e3da40d92930 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:50.351462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05dff8-4f05-4492-98b3-e3da40d92930 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:50.353110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 862/1700] 10.222.0.48 () {54 vars in 912 bytes} [Tue Aug 30 05:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:09:50.368711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27328409-3cb5-42c0-bc7a-6b5d29e732c6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:50.369277 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27328409-3cb5-42c0-bc7a-6b5d29e732c6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:50.369752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27328409-3cb5-42c0-bc7a-6b5d29e732c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:50.397962 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 839/1701] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:50 2022] PUT /identity/v3/projects/4e57b33d290949e6be82626dd517f669/users/a10482ad316f463d89e24186ea353368/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:50.410983 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37df486-860d-4dbe-959d-5cab5e5696ea None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:50.411815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37df486-860d-4dbe-959d-5cab5e5696ea None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:50.412656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37df486-860d-4dbe-959d-5cab5e5696ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:50.510667 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e37df486-860d-4dbe-959d-5cab5e5696ea None None] MFA Rules not processed for user `a10482ad316f463d89e24186ea353368`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:50.512854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e37df486-860d-4dbe-959d-5cab5e5696ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:50.523291 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-27328409-3cb5-42c0-bc7a-6b5d29e732c6 None None] MFA Rules not processed for user `4398d5175c8c409789d62c277da35ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:50.524782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-27328409-3cb5-42c0-bc7a-6b5d29e732c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:50.610842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:50.648790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 863/1702] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Aug 30 05:09:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:50.702041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27328409-3cb5-42c0-bc7a-6b5d29e732c6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:50.703562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-27328409-3cb5-42c0-bc7a-6b5d29e732c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:50.718289 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 840/1703] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:50.726758 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37df486-860d-4dbe-959d-5cab5e5696ea None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:50.728861 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e37df486-860d-4dbe-959d-5cab5e5696ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:50.737749 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27328409-3cb5-42c0-bc7a-6b5d29e732c6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:50.748730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893fc0f-cab6-422a-8180-00e188a7fe1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:50.749369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893fc0f-cab6-422a-8180-00e188a7fe1f service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:50.749759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893fc0f-cab6-422a-8180-00e188a7fe1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:50.750062 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893fc0f-cab6-422a-8180-00e188a7fe1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:50.763752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893fc0f-cab6-422a-8180-00e188a7fe1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:50.764608 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893fc0f-cab6-422a-8180-00e188a7fe1f service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:50.786079 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 864/1704] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:50.855496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37df486-860d-4dbe-959d-5cab5e5696ea None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:50.857485 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893fc0f-cab6-422a-8180-00e188a7fe1f service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:50.862529 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe7e27-8e6d-4f62-b2c6-4cb0f706b745 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:50.863160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe7e27-8e6d-4f62-b2c6-4cb0f706b745 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:50.863395 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1893fc0f-cab6-422a-8180-00e188a7fe1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:50.863516 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe7e27-8e6d-4f62-b2c6-4cb0f706b745 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:50.863688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe7e27-8e6d-4f62-b2c6-4cb0f706b745 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:50.878728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe7e27-8e6d-4f62-b2c6-4cb0f706b745 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:50.880594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe7e27-8e6d-4f62-b2c6-4cb0f706b745 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:50.913010 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 841/1705] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:51.002156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893fc0f-cab6-422a-8180-00e188a7fe1f service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:51.012301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b3464-9759-4010-9631-20ac3cd680bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:51.015333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b3464-9759-4010-9631-20ac3cd680bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:51.016636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b3464-9759-4010-9631-20ac3cd680bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:51.018944 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b3464-9759-4010-9631-20ac3cd680bd admin admin] PATH_INFO: `/v3/users/20c6734138ca4e44b663c60a98235d3a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:51.022789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b3464-9759-4010-9631-20ac3cd680bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c6734138ca4e44b663c60a98235d3a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:51.026936 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b3464-9759-4010-9631-20ac3cd680bd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:51.132362 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-233b3464-9759-4010-9631-20ac3cd680bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c6734138ca4e44b663c60a98235d3a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:51.156347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-233b3464-9759-4010-9631-20ac3cd680bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c6734138ca4e44b663c60a98235d3a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:51.178170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-233b3464-9759-4010-9631-20ac3cd680bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c6734138ca4e44b663c60a98235d3a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:51.178886 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-233b3464-9759-4010-9631-20ac3cd680bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c6734138ca4e44b663c60a98235d3a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:51.207264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:51.216206 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-233b3464-9759-4010-9631-20ac3cd680bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c6734138ca4e44b663c60a98235d3a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:51.227460 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 865/1706] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:09:50 2022] DELETE /identity/v3/users/20c6734138ca4e44b663c60a98235d3a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:09:51.231771 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c7f74-79a2-4256-8c50-b0d52f6e14a7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:51.232467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c7f74-79a2-4256-8c50-b0d52f6e14a7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:51.233007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c7f74-79a2-4256-8c50-b0d52f6e14a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:51.297225 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7b1c7f74-79a2-4256-8c50-b0d52f6e14a7 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:51.300130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7b1c7f74-79a2-4256-8c50-b0d52f6e14a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:51.466336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 842/1707] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:51.503199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b3464-9759-4010-9631-20ac3cd680bd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:51.507200 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-233b3464-9759-4010-9631-20ac3cd680bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:51.748615 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef126a-640c-41cd-a2db-79a90cf76d50 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:51.748902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef126a-640c-41cd-a2db-79a90cf76d50 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:51.749177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef126a-640c-41cd-a2db-79a90cf76d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:51.749883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b3464-9759-4010-9631-20ac3cd680bd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:51.760719 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b26692-60d8-4c8c-a692-205def1b83ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:51.761424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b26692-60d8-4c8c-a692-205def1b83ba service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:51.761704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b26692-60d8-4c8c-a692-205def1b83ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:51.764439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b26692-60d8-4c8c-a692-205def1b83ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:51.787963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b26692-60d8-4c8c-a692-205def1b83ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:51.792283 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b26692-60d8-4c8c-a692-205def1b83ba service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:51.824634 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 866/1708] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:51.849379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-82ef126a-640c-41cd-a2db-79a90cf76d50 None None] MFA Rules not processed for user `8c48a0f56a484813af66d8b691c79113`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:51.868717 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-82ef126a-640c-41cd-a2db-79a90cf76d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:52.026190 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b26692-60d8-4c8c-a692-205def1b83ba service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:52.028003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-84b26692-60d8-4c8c-a692-205def1b83ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:52.153152 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 843/1709] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:09:52.446766 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b26692-60d8-4c8c-a692-205def1b83ba service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:52.470822 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9887f-4843-4b29-801a-eb26444d6160 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed835047051142d2bc98bb1564e3a98f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:52.471475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9887f-4843-4b29-801a-eb26444d6160 service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:52.471742 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9887f-4843-4b29-801a-eb26444d6160 service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:52.474239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9887f-4843-4b29-801a-eb26444d6160 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:52.478662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e7d9887f-4843-4b29-801a-eb26444d6160 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:52.512038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9887f-4843-4b29-801a-eb26444d6160 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:52.516194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9887f-4843-4b29-801a-eb26444d6160 service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:52.546614 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 867/1710] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:09:52.660872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ff585-3cd7-4fb1-8718-c8e03cc69799 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:52.661763 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ff585-3cd7-4fb1-8718-c8e03cc69799 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:52.662177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ff585-3cd7-4fb1-8718-c8e03cc69799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:52.767972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-587ff585-3cd7-4fb1-8718-c8e03cc69799 None None] MFA Rules not processed for user `b0e4c582fefb4b92b0a2e10652de62f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:52.772175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-587ff585-3cd7-4fb1-8718-c8e03cc69799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:52.841462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:52.959202 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944450f5-ee86-4d6f-815e-8bb6d790373d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:52.959601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944450f5-ee86-4d6f-815e-8bb6d790373d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:52.959886 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944450f5-ee86-4d6f-815e-8bb6d790373d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:53.012799 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 844/1711] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:53.027261 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed214ccd-ab9a-4d69-9b12-ae9ea4808c42 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:53.027548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed214ccd-ab9a-4d69-9b12-ae9ea4808c42 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:53.028119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed214ccd-ab9a-4d69-9b12-ae9ea4808c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:53.067930 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-944450f5-ee86-4d6f-815e-8bb6d790373d None None] MFA Rules not processed for user `dd803cc555584e95baf795337a36ad6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:53.069221 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-944450f5-ee86-4d6f-815e-8bb6d790373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:53.084011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ed214ccd-ab9a-4d69-9b12-ae9ea4808c42 None None] MFA Rules not processed for user `b0e4c582fefb4b92b0a2e10652de62f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:53.085356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ed214ccd-ab9a-4d69-9b12-ae9ea4808c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:53.124532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 845/1712] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:09:53.127602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed214ccd-ab9a-4d69-9b12-ae9ea4808c42 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:53.129221 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ed214ccd-ab9a-4d69-9b12-ae9ea4808c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:53.282439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 868/1713] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:53.283705 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944450f5-ee86-4d6f-815e-8bb6d790373d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:53.285730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-944450f5-ee86-4d6f-815e-8bb6d790373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:53.331060 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944450f5-ee86-4d6f-815e-8bb6d790373d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:53.347483 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf07e05-c9a7-4082-bad2-67355e73a9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:53.348211 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf07e05-c9a7-4082-bad2-67355e73a9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:53.348492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf07e05-c9a7-4082-bad2-67355e73a9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:53.348767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf07e05-c9a7-4082-bad2-67355e73a9ac admin admin] PATH_INFO: `/v3/users/972477d19ae64c54b7f086d1b2a47585` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:53.350791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf07e05-c9a7-4082-bad2-67355e73a9ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=972477d19ae64c54b7f086d1b2a47585)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:53.354717 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf07e05-c9a7-4082-bad2-67355e73a9ac admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:53.388187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:53.429854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed214ccd-ab9a-4d69-9b12-ae9ea4808c42 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:53.448288 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4f70c-ab29-4738-a3eb-0f7ce6f532f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:53.449389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4f70c-ab29-4738-a3eb-0f7ce6f532f6 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:53.449795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4f70c-ab29-4738-a3eb-0f7ce6f532f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:53.450204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4f70c-ab29-4738-a3eb-0f7ce6f532f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:53.463295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4f70c-ab29-4738-a3eb-0f7ce6f532f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:53.468896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4f70c-ab29-4738-a3eb-0f7ce6f532f6 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:53.483741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edf07e05-c9a7-4082-bad2-67355e73a9ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '972477d19ae64c54b7f086d1b2a47585'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:53.509844 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edf07e05-c9a7-4082-bad2-67355e73a9ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '972477d19ae64c54b7f086d1b2a47585'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:53.517577 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 846/1714] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:53 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:53.521327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edf07e05-c9a7-4082-bad2-67355e73a9ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '972477d19ae64c54b7f086d1b2a47585'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:53.522770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edf07e05-c9a7-4082-bad2-67355e73a9ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '972477d19ae64c54b7f086d1b2a47585'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:53.550825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edf07e05-c9a7-4082-bad2-67355e73a9ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '972477d19ae64c54b7f086d1b2a47585'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:53.560940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 869/1715] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:09:53 2022] DELETE /identity/v3/users/972477d19ae64c54b7f086d1b2a47585 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:53.565761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb178bd-d74e-457d-a169-e7ec2dd96b18 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:53.566047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb178bd-d74e-457d-a169-e7ec2dd96b18 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:53.566318 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb178bd-d74e-457d-a169-e7ec2dd96b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:53.602954 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2eb178bd-d74e-457d-a169-e7ec2dd96b18 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:53.604651 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2eb178bd-d74e-457d-a169-e7ec2dd96b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:53.719998 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 847/1716] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:53.735039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf07e05-c9a7-4082-bad2-67355e73a9ac admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:53.737661 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-edf07e05-c9a7-4082-bad2-67355e73a9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:53.887528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf07e05-c9a7-4082-bad2-67355e73a9ac admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:53.893539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c7a0e-d091-44ac-b4d1-4833e0044742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:53.894569 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7a0e-d091-44ac-b4d1-4833e0044742 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:53.894847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7a0e-d091-44ac-b4d1-4833e0044742 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:53.895118 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7a0e-d091-44ac-b4d1-4833e0044742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:53.925044 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c7a0e-d091-44ac-b4d1-4833e0044742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:53.928497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb178bd-d74e-457d-a169-e7ec2dd96b18 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:53.929056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c7a0e-d091-44ac-b4d1-4833e0044742 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:53.930483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2eb178bd-d74e-457d-a169-e7ec2dd96b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:53.952703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb178bd-d74e-457d-a169-e7ec2dd96b18 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:53.961651 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f11b02-db2b-4317-9d43-32b37b7c607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:53.962629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f11b02-db2b-4317-9d43-32b37b7c607b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:53.963111 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f11b02-db2b-4317-9d43-32b37b7c607b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:53.963735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f11b02-db2b-4317-9d43-32b37b7c607b admin admin] PATH_INFO: `/v3/projects/d7982474d3164f1ca130e6d4053cad30` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:53.965350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f11b02-db2b-4317-9d43-32b37b7c607b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7982474d3164f1ca130e6d4053cad30)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:53.967198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 870/1717] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:53.976092 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f11b02-db2b-4317-9d43-32b37b7c607b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:54.047336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:54.092826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-82f11b02-db2b-4317-9d43-32b37b7c607b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7982474d3164f1ca130e6d4053cad30', 'request_id': 'req-82f11b02-db2b-4317-9d43-32b37b7c607b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:54.107471 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-82f11b02-db2b-4317-9d43-32b37b7c607b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7982474d3164f1ca130e6d4053cad30', 'request_id': 'req-82f11b02-db2b-4317-9d43-32b37b7c607b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:54.122988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-82f11b02-db2b-4317-9d43-32b37b7c607b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7982474d3164f1ca130e6d4053cad30', 'request_id': 'req-82f11b02-db2b-4317-9d43-32b37b7c607b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:54.148422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-82f11b02-db2b-4317-9d43-32b37b7c607b admin admin] The token cache is being invalidate because project d7982474d3164f1ca130e6d4053cad30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:09:54.148743 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-82f11b02-db2b-4317-9d43-32b37b7c607b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:54.150376 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-82f11b02-db2b-4317-9d43-32b37b7c607b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:54.158674 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 848/1718] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:09:53 2022] DELETE /identity/v3/projects/d7982474d3164f1ca130e6d4053cad30 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:54.159924 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c7a0e-d091-44ac-b4d1-4833e0044742 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:54.174565 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c7a0e-d091-44ac-b4d1-4833e0044742 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:54.227274 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72319366-b644-43ea-946b-c4c8916c7916 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:54.227800 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72319366-b644-43ea-946b-c4c8916c7916 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:54.228237 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72319366-b644-43ea-946b-c4c8916c7916 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:54.230783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 849/1719] 10.222.0.48 () {54 vars in 912 bytes} [Tue Aug 30 05:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:09:54.255104 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e10f3-045a-444d-898e-a598d5c74e85 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:54.255690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e10f3-045a-444d-898e-a598d5c74e85 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:54.256147 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e10f3-045a-444d-898e-a598d5c74e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:54.302580 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0e6e10f3-045a-444d-898e-a598d5c74e85 None None] MFA Rules not processed for user `4398d5175c8c409789d62c277da35ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:54.304408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0e6e10f3-045a-444d-898e-a598d5c74e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:54.371167 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6db4c-7882-4823-b73f-8dcbe85978a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:54.372120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6db4c-7882-4823-b73f-8dcbe85978a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:54.372629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6db4c-7882-4823-b73f-8dcbe85978a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:54.373174 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6db4c-7882-4823-b73f-8dcbe85978a9 admin admin] PATH_INFO: `/v3/users/b73cd53360bd421bb402d67ad3f11ed7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:54.404283 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6db4c-7882-4823-b73f-8dcbe85978a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b73cd53360bd421bb402d67ad3f11ed7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:54.418638 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6db4c-7882-4823-b73f-8dcbe85978a9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:54.473352 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 850/1720] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Aug 30 05:09:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:54.489483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e10f3-045a-444d-898e-a598d5c74e85 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:54.491241 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0e6e10f3-045a-444d-898e-a598d5c74e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:54.500766 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:54.515063 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e10f3-045a-444d-898e-a598d5c74e85 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:54.529402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff03b8c-4b67-4585-8bc7-6282411487f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:54.530359 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff03b8c-4b67-4585-8bc7-6282411487f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:54.530788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff03b8c-4b67-4585-8bc7-6282411487f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:54.531397 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff03b8c-4b67-4585-8bc7-6282411487f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:54.552956 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff03b8c-4b67-4585-8bc7-6282411487f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:54.554877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff03b8c-4b67-4585-8bc7-6282411487f0 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:54.562840 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-27a6db4c-7882-4823-b73f-8dcbe85978a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b73cd53360bd421bb402d67ad3f11ed7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:54.588257 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 851/1721] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:54.589784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-27a6db4c-7882-4823-b73f-8dcbe85978a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b73cd53360bd421bb402d67ad3f11ed7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:54.592953 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff03b8c-4b67-4585-8bc7-6282411487f0 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:54.596311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-eff03b8c-4b67-4585-8bc7-6282411487f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:54.608299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-27a6db4c-7882-4823-b73f-8dcbe85978a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b73cd53360bd421bb402d67ad3f11ed7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:54.609207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-27a6db4c-7882-4823-b73f-8dcbe85978a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b73cd53360bd421bb402d67ad3f11ed7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:54.659013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-27a6db4c-7882-4823-b73f-8dcbe85978a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b73cd53360bd421bb402d67ad3f11ed7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:54.660562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff03b8c-4b67-4585-8bc7-6282411487f0 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:54.690424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 871/1722] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:09:54 2022] DELETE /identity/v3/users/b73cd53360bd421bb402d67ad3f11ed7 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:54.691451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d45f2-7ac1-408e-ae6f-8c0742139583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:54.693973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d45f2-7ac1-408e-ae6f-8c0742139583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:54.701184 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d45f2-7ac1-408e-ae6f-8c0742139583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:54.701560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d45f2-7ac1-408e-ae6f-8c0742139583 admin admin] PATH_INFO: `/v3/projects/cfb33ebaf59d4fe2bd0613c9518bea2a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:54.706620 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d45f2-7ac1-408e-ae6f-8c0742139583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfb33ebaf59d4fe2bd0613c9518bea2a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:54.708730 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d45f2-7ac1-408e-ae6f-8c0742139583 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:54.902153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6c9d45f2-7ac1-408e-ae6f-8c0742139583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfb33ebaf59d4fe2bd0613c9518bea2a', 'request_id': 'req-6c9d45f2-7ac1-408e-ae6f-8c0742139583'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:54.917079 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6c9d45f2-7ac1-408e-ae6f-8c0742139583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfb33ebaf59d4fe2bd0613c9518bea2a', 'request_id': 'req-6c9d45f2-7ac1-408e-ae6f-8c0742139583'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:54.932028 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6c9d45f2-7ac1-408e-ae6f-8c0742139583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfb33ebaf59d4fe2bd0613c9518bea2a', 'request_id': 'req-6c9d45f2-7ac1-408e-ae6f-8c0742139583'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:54.976713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6c9d45f2-7ac1-408e-ae6f-8c0742139583 admin admin] The token cache is being invalidate because project cfb33ebaf59d4fe2bd0613c9518bea2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:09:54.977823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6c9d45f2-7ac1-408e-ae6f-8c0742139583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:54.986045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6c9d45f2-7ac1-408e-ae6f-8c0742139583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:54.990966 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 852/1723] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:09:54 2022] DELETE /identity/v3/projects/cfb33ebaf59d4fe2bd0613c9518bea2a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:54.991923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6db4c-7882-4823-b73f-8dcbe85978a9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:54.993664 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-27a6db4c-7882-4823-b73f-8dcbe85978a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:55.155139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6db4c-7882-4823-b73f-8dcbe85978a9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:55.279169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd25dc-dfd1-4673-a6d3-3923bee385a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:55.280297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd25dc-dfd1-4673-a6d3-3923bee385a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:55.280802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd25dc-dfd1-4673-a6d3-3923bee385a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:55.281440 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd25dc-dfd1-4673-a6d3-3923bee385a3 admin admin] PATH_INFO: `/v3/users/a10482ad316f463d89e24186ea353368` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:55.283186 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd25dc-dfd1-4673-a6d3-3923bee385a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10482ad316f463d89e24186ea353368)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:55.286303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd25dc-dfd1-4673-a6d3-3923bee385a3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:55.431255 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-52dd25dc-dfd1-4673-a6d3-3923bee385a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10482ad316f463d89e24186ea353368'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:55.476622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-52dd25dc-dfd1-4673-a6d3-3923bee385a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10482ad316f463d89e24186ea353368'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:55.483978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:55.506628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-52dd25dc-dfd1-4673-a6d3-3923bee385a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10482ad316f463d89e24186ea353368'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:55.508454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-52dd25dc-dfd1-4673-a6d3-3923bee385a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10482ad316f463d89e24186ea353368'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:55.575099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-52dd25dc-dfd1-4673-a6d3-3923bee385a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10482ad316f463d89e24186ea353368'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:55.598279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 872/1724] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:09:54 2022] DELETE /identity/v3/users/a10482ad316f463d89e24186ea353368 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:09:55.652628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d45f2-7ac1-408e-ae6f-8c0742139583 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:55.657487 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6c9d45f2-7ac1-408e-ae6f-8c0742139583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:55.740414 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:55.866443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d45f2-7ac1-408e-ae6f-8c0742139583 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:56.130213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866148e-4d63-471c-9180-c251ca39bb8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:56.133275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd25dc-dfd1-4673-a6d3-3923bee385a3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:56.135557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-52dd25dc-dfd1-4673-a6d3-3923bee385a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:56.137214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866148e-4d63-471c-9180-c251ca39bb8a service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:56.140964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866148e-4d63-471c-9180-c251ca39bb8a service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:56.142746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866148e-4d63-471c-9180-c251ca39bb8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:56.153166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0866148e-4d63-471c-9180-c251ca39bb8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:56.358770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd25dc-dfd1-4673-a6d3-3923bee385a3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:56.371133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c1ef9-b35f-475f-a476-6c50facb59e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:56.373175 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c1ef9-b35f-475f-a476-6c50facb59e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:56.374144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c1ef9-b35f-475f-a476-6c50facb59e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:56.374346 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c1ef9-b35f-475f-a476-6c50facb59e5 admin admin] PATH_INFO: `/v3/users/5aecba0b55a841659b054c9e4fa84089` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:56.381150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c1ef9-b35f-475f-a476-6c50facb59e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aecba0b55a841659b054c9e4fa84089)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:56.389710 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c1ef9-b35f-475f-a476-6c50facb59e5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:56.427349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866148e-4d63-471c-9180-c251ca39bb8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:56.428920 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866148e-4d63-471c-9180-c251ca39bb8a service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:56.458774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 853/1725] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 808 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:56.535520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-790c1ef9-b35f-475f-a476-6c50facb59e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aecba0b55a841659b054c9e4fa84089'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:56.558913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-790c1ef9-b35f-475f-a476-6c50facb59e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aecba0b55a841659b054c9e4fa84089'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:56.581275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-790c1ef9-b35f-475f-a476-6c50facb59e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aecba0b55a841659b054c9e4fa84089'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:56.583598 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-790c1ef9-b35f-475f-a476-6c50facb59e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aecba0b55a841659b054c9e4fa84089'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:56.618615 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-790c1ef9-b35f-475f-a476-6c50facb59e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aecba0b55a841659b054c9e4fa84089'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:56.635455 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 873/1726] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:09:56 2022] DELETE /identity/v3/users/5aecba0b55a841659b054c9e4fa84089 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:56.640294 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85fbae-7a7f-46c2-b0d2-46a972b3cbbd None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:56.640572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85fbae-7a7f-46c2-b0d2-46a972b3cbbd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:56.640901 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85fbae-7a7f-46c2-b0d2-46a972b3cbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:56.673532 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c1ef9-b35f-475f-a476-6c50facb59e5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:56.675168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-790c1ef9-b35f-475f-a476-6c50facb59e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:56.706789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-fd85fbae-7a7f-46c2-b0d2-46a972b3cbbd None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:56.709932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fd85fbae-7a7f-46c2-b0d2-46a972b3cbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:56.885241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:56.900577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c1ef9-b35f-475f-a476-6c50facb59e5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:56.921199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6445d-b070-4f38-b866-a5047791144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:56.921864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6445d-b070-4f38-b866-a5047791144e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:56.922213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6445d-b070-4f38-b866-a5047791144e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:56.922488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6445d-b070-4f38-b866-a5047791144e admin admin] PATH_INFO: `/v3/projects/f07f0a4236e144bd9230fc760568d252` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:56.929800 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 854/1727] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:56.932016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6445d-b070-4f38-b866-a5047791144e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07f0a4236e144bd9230fc760568d252)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:56.936860 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6445d-b070-4f38-b866-a5047791144e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:57.001909 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67ab45-9111-47bd-932a-5d8c1c6e116c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:57.002509 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67ab45-9111-47bd-932a-5d8c1c6e116c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:57.003101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67ab45-9111-47bd-932a-5d8c1c6e116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:57.029166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:57.043605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ad6445d-b070-4f38-b866-a5047791144e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07f0a4236e144bd9230fc760568d252', 'request_id': 'req-7ad6445d-b070-4f38-b866-a5047791144e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:57.078784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ad6445d-b070-4f38-b866-a5047791144e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07f0a4236e144bd9230fc760568d252', 'request_id': 'req-7ad6445d-b070-4f38-b866-a5047791144e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:57.095094 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ad6445d-b070-4f38-b866-a5047791144e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07f0a4236e144bd9230fc760568d252', 'request_id': 'req-7ad6445d-b070-4f38-b866-a5047791144e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:57.123416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ad6445d-b070-4f38-b866-a5047791144e admin admin] The token cache is being invalidate because project f07f0a4236e144bd9230fc760568d252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:09:57.123416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ad6445d-b070-4f38-b866-a5047791144e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:57.123416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ad6445d-b070-4f38-b866-a5047791144e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:57.129958 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 874/1728] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:09:56 2022] DELETE /identity/v3/projects/f07f0a4236e144bd9230fc760568d252 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:09:57.134760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b3400-c16d-45d0-ae15-8a8d97215482 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:57.135114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b3400-c16d-45d0-ae15-8a8d97215482 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:57.135677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b3400-c16d-45d0-ae15-8a8d97215482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:57.155156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9e67ab45-9111-47bd-932a-5d8c1c6e116c None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:57.157279 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9e67ab45-9111-47bd-932a-5d8c1c6e116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:57.171021 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f10b3400-c16d-45d0-ae15-8a8d97215482 None None] MFA Rules not processed for user `b0e4c582fefb4b92b0a2e10652de62f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:57.172833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f10b3400-c16d-45d0-ae15-8a8d97215482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:57.291099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 855/1729] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Aug 30 05:09:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:57.296248 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a43e5-4570-4564-907e-b3ce17863111 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:57.296605 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a43e5-4570-4564-907e-b3ce17863111 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:57.296805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a43e5-4570-4564-907e-b3ce17863111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:57.349101 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 875/1730] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:57.349101 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b3400-c16d-45d0-ae15-8a8d97215482 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:57.349101 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f10b3400-c16d-45d0-ae15-8a8d97215482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:57.364238 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-351a43e5-4570-4564-907e-b3ce17863111 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:57.365860 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-351a43e5-4570-4564-907e-b3ce17863111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:57.554348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 856/1731] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:57.555558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9021d-555e-45d7-91c5-4079d8c408ce None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:57.555852 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9021d-555e-45d7-91c5-4079d8c408ce None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:57.556218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9021d-555e-45d7-91c5-4079d8c408ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:57.594398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4fa9021d-555e-45d7-91c5-4079d8c408ce None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:57.597328 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4fa9021d-555e-45d7-91c5-4079d8c408ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:57.644210 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 857/1732] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:09:57.648026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9021d-555e-45d7-91c5-4079d8c408ce None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:57.667455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9021d-555e-45d7-91c5-4079d8c408ce None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:57.682646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04215db0-6d5c-45cb-858e-2b865f17a134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:57.683556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04215db0-6d5c-45cb-858e-2b865f17a134 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:57.684528 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04215db0-6d5c-45cb-858e-2b865f17a134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:57.685089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04215db0-6d5c-45cb-858e-2b865f17a134 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:57.692000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b3400-c16d-45d0-ae15-8a8d97215482 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:57.698131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04215db0-6d5c-45cb-858e-2b865f17a134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:09:57.700504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04215db0-6d5c-45cb-858e-2b865f17a134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:57.702455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04215db0-6d5c-45cb-858e-2b865f17a134 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:57.709000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a94572-1fb6-4b3a-8056-46490db4813f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:57.710017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a94572-1fb6-4b3a-8056-46490db4813f service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:57.710310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a94572-1fb6-4b3a-8056-46490db4813f service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:57.714380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a94572-1fb6-4b3a-8056-46490db4813f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:57.721088 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d4a94572-1fb6-4b3a-8056-46490db4813f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:57.746226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 858/1733] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:09:57.747423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04215db0-6d5c-45cb-858e-2b865f17a134 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:57.762493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a94572-1fb6-4b3a-8056-46490db4813f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:57.768114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a94572-1fb6-4b3a-8056-46490db4813f service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:57.791858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04215db0-6d5c-45cb-858e-2b865f17a134 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:57.807601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 876/1734] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:57.808699 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a94572-1fb6-4b3a-8056-46490db4813f service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:57.815490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a24e8-71af-48d3-ac01-d80f5994b0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:57.816987 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d4a94572-1fb6-4b3a-8056-46490db4813f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:57.821396 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a24e8-71af-48d3-ac01-d80f5994b0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:57.821983 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a24e8-71af-48d3-ac01-d80f5994b0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:57.822896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a24e8-71af-48d3-ac01-d80f5994b0b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:57.824916 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a24e8-71af-48d3-ac01-d80f5994b0b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:57.827071 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a24e8-71af-48d3-ac01-d80f5994b0b5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:57.926704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 859/1735] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:57 2022] POST /identity/v3/projects => generated 389 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:57.930527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a24e8-71af-48d3-ac01-d80f5994b0b5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:57.947377 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:58.062460 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:58.091626 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a94572-1fb6-4b3a-8056-46490db4813f service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:58.110459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a24e8-71af-48d3-ac01-d80f5994b0b5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:58.124576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c32b7-367c-406e-8541-6fe1887ee45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:58.125664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c32b7-367c-406e-8541-6fe1887ee45e admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:58.130351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c32b7-367c-406e-8541-6fe1887ee45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:58.130843 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c32b7-367c-406e-8541-6fe1887ee45e admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:58.132201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c32b7-367c-406e-8541-6fe1887ee45e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:58.134665 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c32b7-367c-406e-8541-6fe1887ee45e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:58.181230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 860/1736] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:57 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:09:58.187990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c32b7-367c-406e-8541-6fe1887ee45e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:58.199872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6fe5a-2e51-40f4-8bb9-11a9348c6ac7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:58.202087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6fe5a-2e51-40f4-8bb9-11a9348c6ac7 service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:58.202731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6fe5a-2e51-40f4-8bb9-11a9348c6ac7 service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:58.203254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6fe5a-2e51-40f4-8bb9-11a9348c6ac7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:58.205931 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c32b7-367c-406e-8541-6fe1887ee45e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:58.220776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eb0f5-ee66-4bde-9b82-3e86abddc75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:58.221972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb0f5-ee66-4bde-9b82-3e86abddc75c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:58.230605 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb0f5-ee66-4bde-9b82-3e86abddc75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:58.235558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb0f5-ee66-4bde-9b82-3e86abddc75c admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:58.236819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42eb0f5-ee66-4bde-9b82-3e86abddc75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:58.241980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42eb0f5-ee66-4bde-9b82-3e86abddc75c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:58.282815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 861/1737] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:58.285444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eb0f5-ee66-4bde-9b82-3e86abddc75c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:58.318948 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6fe5a-2e51-40f4-8bb9-11a9348c6ac7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:58.319558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eb0f5-ee66-4bde-9b82-3e86abddc75c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:58.321478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6fe5a-2e51-40f4-8bb9-11a9348c6ac7 service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:58.325265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb3a74-e8b7-4583-ac2d-1789c822614c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:58.326000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb3a74-e8b7-4583-ac2d-1789c822614c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:58.326377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb3a74-e8b7-4583-ac2d-1789c822614c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:58.326750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb3a74-e8b7-4583-ac2d-1789c822614c admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:58.327505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb3a74-e8b7-4583-ac2d-1789c822614c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:58.331298 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb3a74-e8b7-4583-ac2d-1789c822614c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:58.334707 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 877/1738] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:09:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:09:58.359512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 862/1739] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:09:58.364370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6fe5a-2e51-40f4-8bb9-11a9348c6ac7 service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:58.384166 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6fe5a-2e51-40f4-8bb9-11a9348c6ac7 service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:58.399800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467132d6-36f1-4efc-9cfb-659389461394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:58.400671 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467132d6-36f1-4efc-9cfb-659389461394 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:58.401260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467132d6-36f1-4efc-9cfb-659389461394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:58.401544 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467132d6-36f1-4efc-9cfb-659389461394 admin admin] PATH_INFO: `/v3/projects/ef23328e1afe45b69f6112a6068ae2f7/users/f34903b28b3c44b4bf6fbc38a8880ff1/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:58.446768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467132d6-36f1-4efc-9cfb-659389461394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef23328e1afe45b69f6112a6068ae2f7, user_id=f34903b28b3c44b4bf6fbc38a8880ff1, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:58.451817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467132d6-36f1-4efc-9cfb-659389461394 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:58.497617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 878/1740] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:09:58 2022] PUT /identity/v3/projects/ef23328e1afe45b69f6112a6068ae2f7/users/f34903b28b3c44b4bf6fbc38a8880ff1/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:09:58.511804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790edd67-8ca6-4beb-bd71-2bd3a3a21aa7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:58.512486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790edd67-8ca6-4beb-bd71-2bd3a3a21aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:58.513095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790edd67-8ca6-4beb-bd71-2bd3a3a21aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:58.622217 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-790edd67-8ca6-4beb-bd71-2bd3a3a21aa7 None None] MFA Rules not processed for user `f34903b28b3c44b4bf6fbc38a8880ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:58.625428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-790edd67-8ca6-4beb-bd71-2bd3a3a21aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:58.653803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467132d6-36f1-4efc-9cfb-659389461394 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:58.657527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-467132d6-36f1-4efc-9cfb-659389461394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:58.876672 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:59.043458 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467132d6-36f1-4efc-9cfb-659389461394 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:59.065797 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874d37c-0ad7-46b3-85d0-435780dc2913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:59.066251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874d37c-0ad7-46b3-85d0-435780dc2913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:59.066251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874d37c-0ad7-46b3-85d0-435780dc2913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:59.071479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874d37c-0ad7-46b3-85d0-435780dc2913 admin admin] PATH_INFO: `/v3/projects/4e57b33d290949e6be82626dd517f669` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:59.071656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 863/1741] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 560 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:59.076344 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874d37c-0ad7-46b3-85d0-435780dc2913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e57b33d290949e6be82626dd517f669)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:59.078326 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874d37c-0ad7-46b3-85d0-435780dc2913 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:59.082890 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790edd67-8ca6-4beb-bd71-2bd3a3a21aa7 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:59.137734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790edd67-8ca6-4beb-bd71-2bd3a3a21aa7 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:59.156871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965dda6-5af4-45dd-8ac5-5f2167033dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:59.160619 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965dda6-5af4-45dd-8ac5-5f2167033dcd admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:59.160936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965dda6-5af4-45dd-8ac5-5f2167033dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:59.163829 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965dda6-5af4-45dd-8ac5-5f2167033dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:59.166062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965dda6-5af4-45dd-8ac5-5f2167033dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:59.180633 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965dda6-5af4-45dd-8ac5-5f2167033dcd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:59.319121 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f874d37c-0ad7-46b3-85d0-435780dc2913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e57b33d290949e6be82626dd517f669', 'request_id': 'req-f874d37c-0ad7-46b3-85d0-435780dc2913'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:59.338619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f874d37c-0ad7-46b3-85d0-435780dc2913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e57b33d290949e6be82626dd517f669', 'request_id': 'req-f874d37c-0ad7-46b3-85d0-435780dc2913'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:59.354010 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 864/1742] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:09:59 2022] POST /identity/v3/projects => generated 389 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:59.356775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f874d37c-0ad7-46b3-85d0-435780dc2913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e57b33d290949e6be82626dd517f669', 'request_id': 'req-f874d37c-0ad7-46b3-85d0-435780dc2913'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:59.357811 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965dda6-5af4-45dd-8ac5-5f2167033dcd admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:59.399691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f874d37c-0ad7-46b3-85d0-435780dc2913 admin admin] The token cache is being invalidate because project 4e57b33d290949e6be82626dd517f669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:09:59.400408 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f874d37c-0ad7-46b3-85d0-435780dc2913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:59.403672 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f874d37c-0ad7-46b3-85d0-435780dc2913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:09:59.411040 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 879/1743] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:09:58 2022] DELETE /identity/v3/projects/4e57b33d290949e6be82626dd517f669 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:09:59.420806 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d2757-3353-48b4-b9e4-a4593ac678eb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:59.421447 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d2757-3353-48b4-b9e4-a4593ac678eb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:59.422115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d2757-3353-48b4-b9e4-a4593ac678eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:59.489357 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-906d2757-3353-48b4-b9e4-a4593ac678eb None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:59.498032 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-906d2757-3353-48b4-b9e4-a4593ac678eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:59.669588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965dda6-5af4-45dd-8ac5-5f2167033dcd admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:59.692135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4501aa1-8204-47c2-912d-935b912853ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:59.693534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4501aa1-8204-47c2-912d-935b912853ea admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:59.693818 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4501aa1-8204-47c2-912d-935b912853ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:59.694846 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4501aa1-8204-47c2-912d-935b912853ea admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:59.702236 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4501aa1-8204-47c2-912d-935b912853ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:59.716037 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4501aa1-8204-47c2-912d-935b912853ea admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:59.723870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 880/1744] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:09:59.748897 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39b138-496b-4993-a9fb-f7b5632a746b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:59.751932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39b138-496b-4993-a9fb-f7b5632a746b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:59.752376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39b138-496b-4993-a9fb-f7b5632a746b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:59.821067 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 865/1745] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:09:59 2022] POST /identity/v3/users => generated 301 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:09:59.830619 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4501aa1-8204-47c2-912d-935b912853ea admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:59.834185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2b39b138-496b-4993-a9fb-f7b5632a746b None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:59.836193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2b39b138-496b-4993-a9fb-f7b5632a746b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:59.843114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e4501aa1-8204-47c2-912d-935b912853ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:59.900545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 881/1746] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:59.901981 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:59.909307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39b138-496b-4993-a9fb-f7b5632a746b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:59.935981 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4501aa1-8204-47c2-912d-935b912853ea admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:59.955141 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59fe4e-6ba5-4ee5-a70c-12579e5755a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:59.957952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39b138-496b-4993-a9fb-f7b5632a746b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:59.958889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59fe4e-6ba5-4ee5-a70c-12579e5755a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:59.959671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59fe4e-6ba5-4ee5-a70c-12579e5755a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:59.960191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59fe4e-6ba5-4ee5-a70c-12579e5755a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:59.961013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59fe4e-6ba5-4ee5-a70c-12579e5755a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:59.966733 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59fe4e-6ba5-4ee5-a70c-12579e5755a6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:59.993837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b58bd-5520-4f97-b8e5-fe4f19c40681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:59.996304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b58bd-5520-4f97-b8e5-fe4f19c40681 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:59.996867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b58bd-5520-4f97-b8e5-fe4f19c40681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:59.997354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b58bd-5520-4f97-b8e5-fe4f19c40681 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:00.002580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b58bd-5520-4f97-b8e5-fe4f19c40681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:00.002580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b58bd-5520-4f97-b8e5-fe4f19c40681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:00.010184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b58bd-5520-4f97-b8e5-fe4f19c40681 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:00.030701 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 866/1747] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:00.033789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59fe4e-6ba5-4ee5-a70c-12579e5755a6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:00.062141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 882/1748] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:00.069207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b58bd-5520-4f97-b8e5-fe4f19c40681 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:00.075070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59fe4e-6ba5-4ee5-a70c-12579e5755a6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:00.089622 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a479c96-8945-4608-8e0b-3297b61b7d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:00.090757 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a479c96-8945-4608-8e0b-3297b61b7d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:00.090757 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a479c96-8945-4608-8e0b-3297b61b7d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:00.090978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a479c96-8945-4608-8e0b-3297b61b7d95 admin admin] PATH_INFO: `/v3/projects/e0bd019c4c7640d18e4e22ad9992134b/users/d38fe76de8f142eaa40fb888b24aabdf/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:00.103682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b58bd-5520-4f97-b8e5-fe4f19c40681 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:00.123930 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75678e0-f17b-4b21-9cc8-a6b43a1cb02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:00.124652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75678e0-f17b-4b21-9cc8-a6b43a1cb02d admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:00.125116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75678e0-f17b-4b21-9cc8-a6b43a1cb02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:00.125809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75678e0-f17b-4b21-9cc8-a6b43a1cb02d admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:00.128539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75678e0-f17b-4b21-9cc8-a6b43a1cb02d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:00.132431 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75678e0-f17b-4b21-9cc8-a6b43a1cb02d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:00.177763 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a479c96-8945-4608-8e0b-3297b61b7d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bd019c4c7640d18e4e22ad9992134b, user_id=d38fe76de8f142eaa40fb888b24aabdf, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:00.182465 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a479c96-8945-4608-8e0b-3297b61b7d95 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:00.220912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 867/1749] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:00 2022] PUT /identity/v3/projects/e0bd019c4c7640d18e4e22ad9992134b/users/d38fe76de8f142eaa40fb888b24aabdf/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:00.226137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a479c96-8945-4608-8e0b-3297b61b7d95 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:00.303269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 883/1750] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:00 2022] POST /identity/v3/projects => generated 373 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:00.307378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75678e0-f17b-4b21-9cc8-a6b43a1cb02d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:00.363982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:00.475508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75678e0-f17b-4b21-9cc8-a6b43a1cb02d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:00.516025 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcf657-a526-4078-9985-e8ea04dc298a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:00.518076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcf657-a526-4078-9985-e8ea04dc298a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:00.520284 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcf657-a526-4078-9985-e8ea04dc298a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:00.520771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcf657-a526-4078-9985-e8ea04dc298a admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:00.521525 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcf657-a526-4078-9985-e8ea04dc298a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:00.529772 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcf657-a526-4078-9985-e8ea04dc298a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:00.539673 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a479c96-8945-4608-8e0b-3297b61b7d95 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:00.556736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdee04c-89be-49b1-a956-401fcfcc19b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:00.557394 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee04c-89be-49b1-a956-401fcfcc19b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:00.557808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee04c-89be-49b1-a956-401fcfcc19b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:00.557991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee04c-89be-49b1-a956-401fcfcc19b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:00.558689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdee04c-89be-49b1-a956-401fcfcc19b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:00.584799 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdee04c-89be-49b1-a956-401fcfcc19b1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:00.619333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 884/1751] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:00 2022] POST /identity/v3/users => generated 287 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:00.620761 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcf657-a526-4078-9985-e8ea04dc298a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:00.621415 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 868/1752] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:00.629081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdee04c-89be-49b1-a956-401fcfcc19b1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:00.674036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcf657-a526-4078-9985-e8ea04dc298a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:00.674417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdee04c-89be-49b1-a956-401fcfcc19b1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:00.700743 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cfef6-d518-4eea-b381-02dd94a6bd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:00.701431 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cfef6-d518-4eea-b381-02dd94a6bd5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:00.702225 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cfef6-d518-4eea-b381-02dd94a6bd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:00.702225 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cfef6-d518-4eea-b381-02dd94a6bd5d admin admin] PATH_INFO: `/v3/projects/e0bd019c4c7640d18e4e22ad9992134b/users/d38fe76de8f142eaa40fb888b24aabdf/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:00.702520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3cad6-858c-432a-ab0b-0fc26a4eea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:00.705236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3cad6-858c-432a-ab0b-0fc26a4eea4b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:00.705530 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3cad6-858c-432a-ab0b-0fc26a4eea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:00.706259 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cfef6-d518-4eea-b381-02dd94a6bd5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bd019c4c7640d18e4e22ad9992134b, user_id=d38fe76de8f142eaa40fb888b24aabdf, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:00.707629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3cad6-858c-432a-ab0b-0fc26a4eea4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:00.708858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3cad6-858c-432a-ab0b-0fc26a4eea4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:00.716845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3cad6-858c-432a-ab0b-0fc26a4eea4b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:00.721626 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cfef6-d518-4eea-b381-02dd94a6bd5d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:00.749953 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 885/1753] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:00.755333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3cad6-858c-432a-ab0b-0fc26a4eea4b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:00.772392 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 869/1754] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:00 2022] PUT /identity/v3/projects/e0bd019c4c7640d18e4e22ad9992134b/users/d38fe76de8f142eaa40fb888b24aabdf/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:00.785092 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b319ef-2ec8-46f4-b32a-d2b717b4cd8d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:00.785482 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b319ef-2ec8-46f4-b32a-d2b717b4cd8d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:00.785636 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b319ef-2ec8-46f4-b32a-d2b717b4cd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:00.793808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3cad6-858c-432a-ab0b-0fc26a4eea4b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:00.873003 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-03b319ef-2ec8-46f4-b32a-d2b717b4cd8d None None] MFA Rules not processed for user `d38fe76de8f142eaa40fb888b24aabdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:00.875468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-03b319ef-2ec8-46f4-b32a-d2b717b4cd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:00.975693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d6479-cbc9-4517-9c68-d64a817c65fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:00.977484 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d6479-cbc9-4517-9c68-d64a817c65fa admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:00.977808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d6479-cbc9-4517-9c68-d64a817c65fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:00.979494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d6479-cbc9-4517-9c68-d64a817c65fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:00.980255 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d6479-cbc9-4517-9c68-d64a817c65fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:00.981937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d6479-cbc9-4517-9c68-d64a817c65fa admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:01.027803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 886/1755] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:01.035564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d6479-cbc9-4517-9c68-d64a817c65fa admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:01.065355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d6479-cbc9-4517-9c68-d64a817c65fa admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:01.089737 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb1f6a-4fdf-407e-ae2d-c7616aaa297a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:01.090056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb1f6a-4fdf-407e-ae2d-c7616aaa297a admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:01.092853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb1f6a-4fdf-407e-ae2d-c7616aaa297a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:01.093151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb1f6a-4fdf-407e-ae2d-c7616aaa297a admin admin] PATH_INFO: `/v3/projects/20e43ada78fe4513ae2a475965967b34/users/9a3a24fd0b274525841057fde1d8df4a/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:01.138137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 870/1756] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:00 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:01.148000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b319ef-2ec8-46f4-b32a-d2b717b4cd8d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:01.149858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-03b319ef-2ec8-46f4-b32a-d2b717b4cd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:01.175180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb1f6a-4fdf-407e-ae2d-c7616aaa297a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e43ada78fe4513ae2a475965967b34, user_id=9a3a24fd0b274525841057fde1d8df4a, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:01.178509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb1f6a-4fdf-407e-ae2d-c7616aaa297a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:01.226778 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 887/1757] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:01 2022] PUT /identity/v3/projects/20e43ada78fe4513ae2a475965967b34/users/9a3a24fd0b274525841057fde1d8df4a/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:01.229027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0b2fc-2b13-48a2-b74b-ea06e5848c42 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:01.229500 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0b2fc-2b13-48a2-b74b-ea06e5848c42 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:01.229924 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0b2fc-2b13-48a2-b74b-ea06e5848c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:01.301866 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-31a0b2fc-2b13-48a2-b74b-ea06e5848c42 None None] MFA Rules not processed for user `9a3a24fd0b274525841057fde1d8df4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:01.303287 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-31a0b2fc-2b13-48a2-b74b-ea06e5848c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:01.368034 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:01.499093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b319ef-2ec8-46f4-b32a-d2b717b4cd8d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:01.535144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 888/1758] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:01.536273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0b2fc-2b13-48a2-b74b-ea06e5848c42 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:01.541035 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-31a0b2fc-2b13-48a2-b74b-ea06e5848c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:01.567228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:01.731352 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acd7b5-634c-4cd8-baa5-55ab91b5f2be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:01.733554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acd7b5-634c-4cd8-baa5-55ab91b5f2be service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:01.734357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acd7b5-634c-4cd8-baa5-55ab91b5f2be service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:01.735835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acd7b5-634c-4cd8-baa5-55ab91b5f2be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:01.778569 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0b2fc-2b13-48a2-b74b-ea06e5848c42 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:01.789365 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa8ea7-2c47-4282-ace6-9e79b5d6e2bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:01.790693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa8ea7-2c47-4282-ace6-9e79b5d6e2bb service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:01.791110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa8ea7-2c47-4282-ace6-9e79b5d6e2bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:01.791505 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa8ea7-2c47-4282-ace6-9e79b5d6e2bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:01.815933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa8ea7-2c47-4282-ace6-9e79b5d6e2bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:01.818222 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa8ea7-2c47-4282-ace6-9e79b5d6e2bb service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:01.844495 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 889/1759] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:01.879702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa8ea7-2c47-4282-ace6-9e79b5d6e2bb service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:02.029496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acd7b5-634c-4cd8-baa5-55ab91b5f2be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:02.040371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acd7b5-634c-4cd8-baa5-55ab91b5f2be service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:02.085468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 871/1760] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:01 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 937 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:02.148614 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa8ea7-2c47-4282-ace6-9e79b5d6e2bb service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:02.169870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1c935-5e2c-4274-ba6c-be146e530828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:02.170740 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1c935-5e2c-4274-ba6c-be146e530828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:02.171166 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1c935-5e2c-4274-ba6c-be146e530828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:02.171592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1c935-5e2c-4274-ba6c-be146e530828 admin admin] PATH_INFO: `/v3/users/9a3a24fd0b274525841057fde1d8df4a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:02.182155 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1c935-5e2c-4274-ba6c-be146e530828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3a24fd0b274525841057fde1d8df4a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:02.182155 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1c935-5e2c-4274-ba6c-be146e530828 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:02.260175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acd7b5-634c-4cd8-baa5-55ab91b5f2be service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:02.262244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-80acd7b5-634c-4cd8-baa5-55ab91b5f2be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:02.301852 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acd7b5-634c-4cd8-baa5-55ab91b5f2be service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:02.331805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07559b2b-13b4-4263-8946-fe5e3d84ff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:02.333141 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07559b2b-13b4-4263-8946-fe5e3d84ff04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:02.337270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07559b2b-13b4-4263-8946-fe5e3d84ff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:02.338219 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07559b2b-13b4-4263-8946-fe5e3d84ff04 admin admin] PATH_INFO: `/v3/projects/71d98362fed842ae9ff1a049e4f17ef4` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:02.345080 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07559b2b-13b4-4263-8946-fe5e3d84ff04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d98362fed842ae9ff1a049e4f17ef4)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:02.366209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07559b2b-13b4-4263-8946-fe5e3d84ff04 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:02.410574 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-60d1c935-5e2c-4274-ba6c-be146e530828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3a24fd0b274525841057fde1d8df4a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:02.453234 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-60d1c935-5e2c-4274-ba6c-be146e530828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3a24fd0b274525841057fde1d8df4a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:02.498055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-60d1c935-5e2c-4274-ba6c-be146e530828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3a24fd0b274525841057fde1d8df4a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:02.499682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-60d1c935-5e2c-4274-ba6c-be146e530828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3a24fd0b274525841057fde1d8df4a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:02.574700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-60d1c935-5e2c-4274-ba6c-be146e530828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3a24fd0b274525841057fde1d8df4a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:02.607816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 890/1761] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:01 2022] DELETE /identity/v3/users/9a3a24fd0b274525841057fde1d8df4a => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:02.608844 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1c935-5e2c-4274-ba6c-be146e530828 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:02.614674 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-60d1c935-5e2c-4274-ba6c-be146e530828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:02.680265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-07559b2b-13b4-4263-8946-fe5e3d84ff04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d98362fed842ae9ff1a049e4f17ef4', 'request_id': 'req-07559b2b-13b4-4263-8946-fe5e3d84ff04'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:02.697016 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-07559b2b-13b4-4263-8946-fe5e3d84ff04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d98362fed842ae9ff1a049e4f17ef4', 'request_id': 'req-07559b2b-13b4-4263-8946-fe5e3d84ff04'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:02.719425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-07559b2b-13b4-4263-8946-fe5e3d84ff04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d98362fed842ae9ff1a049e4f17ef4', 'request_id': 'req-07559b2b-13b4-4263-8946-fe5e3d84ff04'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:02.776376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:02.797435 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-07559b2b-13b4-4263-8946-fe5e3d84ff04 admin admin] The token cache is being invalidate because project 71d98362fed842ae9ff1a049e4f17ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:02.799930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-07559b2b-13b4-4263-8946-fe5e3d84ff04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:02.805207 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-07559b2b-13b4-4263-8946-fe5e3d84ff04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:02.812931 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 872/1762] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:02 2022] DELETE /identity/v3/projects/71d98362fed842ae9ff1a049e4f17ef4 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:02.816830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eacd40-0949-4543-ac1e-145ea65ee67f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:02.818124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eacd40-0949-4543-ac1e-145ea65ee67f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:02.819262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eacd40-0949-4543-ac1e-145ea65ee67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:02.864654 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e9eacd40-0949-4543-ac1e-145ea65ee67f None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:02.868897 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e9eacd40-0949-4543-ac1e-145ea65ee67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:02.962482 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:03.048396 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1c935-5e2c-4274-ba6c-be146e530828 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:03.199315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 873/1763] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:03.200395 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eacd40-0949-4543-ac1e-145ea65ee67f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:03.210982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e9eacd40-0949-4543-ac1e-145ea65ee67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:03.252021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eacd40-0949-4543-ac1e-145ea65ee67f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:03.294245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f60a9-97aa-4093-a87a-ee1abe839b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:03.295534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f60a9-97aa-4093-a87a-ee1abe839b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:03.299583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f60a9-97aa-4093-a87a-ee1abe839b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:03.304247 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f60a9-97aa-4093-a87a-ee1abe839b3f admin admin] PATH_INFO: `/v3/users/378febc80d2546f6bf2ecba0c2e33a58` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:03.309654 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f60a9-97aa-4093-a87a-ee1abe839b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=378febc80d2546f6bf2ecba0c2e33a58)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:03.314922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f60a9-97aa-4093-a87a-ee1abe839b3f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:03.395768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39124a3-d178-43ce-b360-ad72e9f906a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:03.401624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39124a3-d178-43ce-b360-ad72e9f906a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:03.402134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39124a3-d178-43ce-b360-ad72e9f906a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:03.402587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39124a3-d178-43ce-b360-ad72e9f906a4 admin admin] PATH_INFO: `/v3/users/f34903b28b3c44b4bf6fbc38a8880ff1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:03.404049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39124a3-d178-43ce-b360-ad72e9f906a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f34903b28b3c44b4bf6fbc38a8880ff1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:03.408193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39124a3-d178-43ce-b360-ad72e9f906a4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:03.553961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e39124a3-d178-43ce-b360-ad72e9f906a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f34903b28b3c44b4bf6fbc38a8880ff1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:03.581889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-330f60a9-97aa-4093-a87a-ee1abe839b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378febc80d2546f6bf2ecba0c2e33a58'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:03.582126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e39124a3-d178-43ce-b360-ad72e9f906a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f34903b28b3c44b4bf6fbc38a8880ff1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:03.600329 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e39124a3-d178-43ce-b360-ad72e9f906a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f34903b28b3c44b4bf6fbc38a8880ff1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:03.602793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e39124a3-d178-43ce-b360-ad72e9f906a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f34903b28b3c44b4bf6fbc38a8880ff1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:03.651115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-330f60a9-97aa-4093-a87a-ee1abe839b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378febc80d2546f6bf2ecba0c2e33a58'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:03.679876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e39124a3-d178-43ce-b360-ad72e9f906a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f34903b28b3c44b4bf6fbc38a8880ff1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:03.698613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-330f60a9-97aa-4093-a87a-ee1abe839b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378febc80d2546f6bf2ecba0c2e33a58'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:03.706773 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-330f60a9-97aa-4093-a87a-ee1abe839b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378febc80d2546f6bf2ecba0c2e33a58'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:03.708261 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-330f60a9-97aa-4093-a87a-ee1abe839b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378febc80d2546f6bf2ecba0c2e33a58'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:03.724654 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 891/1764] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:02 2022] DELETE /identity/v3/users/f34903b28b3c44b4bf6fbc38a8880ff1 => generated 0 bytes in 1116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:03.726793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39124a3-d178-43ce-b360-ad72e9f906a4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:03.730559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e39124a3-d178-43ce-b360-ad72e9f906a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:03.756994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 874/1765] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:03 2022] DELETE /identity/v3/users/378febc80d2546f6bf2ecba0c2e33a58 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:03.761151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7283b7-20b3-4ee0-8823-eb7baa0902ac None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:03.763916 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7283b7-20b3-4ee0-8823-eb7baa0902ac None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:03.764568 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7283b7-20b3-4ee0-8823-eb7baa0902ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:03.856323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8c7283b7-20b3-4ee0-8823-eb7baa0902ac None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:03.859294 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8c7283b7-20b3-4ee0-8823-eb7baa0902ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:04.101589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39124a3-d178-43ce-b360-ad72e9f906a4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:04.143226 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:04.201533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 875/1766] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:04.515773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93471bf-6073-41ad-8024-25b33fbca95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:04.520548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93471bf-6073-41ad-8024-25b33fbca95d service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:04.523272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93471bf-6073-41ad-8024-25b33fbca95d service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:04.523789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93471bf-6073-41ad-8024-25b33fbca95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:04.536980 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a93471bf-6073-41ad-8024-25b33fbca95d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:04.578154 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93471bf-6073-41ad-8024-25b33fbca95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:04.581166 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93471bf-6073-41ad-8024-25b33fbca95d service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:04.616165 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 892/1767] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 891 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:04.638751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7283b7-20b3-4ee0-8823-eb7baa0902ac None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:04.640651 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8c7283b7-20b3-4ee0-8823-eb7baa0902ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:04.666486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7283b7-20b3-4ee0-8823-eb7baa0902ac None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:04.679521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bedb7-bcdf-4f25-90fb-40003e2d85d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:04.680293 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bedb7-bcdf-4f25-90fb-40003e2d85d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:04.680632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bedb7-bcdf-4f25-90fb-40003e2d85d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:04.680842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bedb7-bcdf-4f25-90fb-40003e2d85d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:04.754794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bedb7-bcdf-4f25-90fb-40003e2d85d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:04.761419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bedb7-bcdf-4f25-90fb-40003e2d85d0 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:04.831441 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 876/1768] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:05.865943 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7a888-a561-46ce-ad38-c3bc96c4c9fc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:05.866636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7a888-a561-46ce-ad38-c3bc96c4c9fc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:05.866636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7a888-a561-46ce-ad38-c3bc96c4c9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:05.960538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5cf7a888-a561-46ce-ad38-c3bc96c4c9fc None None] MFA Rules not processed for user `4398d5175c8c409789d62c277da35ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:05.961800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5cf7a888-a561-46ce-ad38-c3bc96c4c9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:06.006091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 893/1769] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Aug 30 05:10:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:06.201748 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3f9ed-bc04-4b0b-800b-bc9e6d46b679 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:06.202295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3f9ed-bc04-4b0b-800b-bc9e6d46b679 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:06.202295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3f9ed-bc04-4b0b-800b-bc9e6d46b679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:06.237185 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6fa3f9ed-bc04-4b0b-800b-bc9e6d46b679 None None] MFA Rules not processed for user `dd803cc555584e95baf795337a36ad6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:06.240427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6fa3f9ed-bc04-4b0b-800b-bc9e6d46b679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:06.308202 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:06.353692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7a888-a561-46ce-ad38-c3bc96c4c9fc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:06.355147 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5cf7a888-a561-46ce-ad38-c3bc96c4c9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:06.372387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7a888-a561-46ce-ad38-c3bc96c4c9fc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:06.401994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cd37f-430e-4cc1-8163-bf38202f7211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:06.402624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cd37f-430e-4cc1-8163-bf38202f7211 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:06.402903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cd37f-430e-4cc1-8163-bf38202f7211 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:06.403174 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cd37f-430e-4cc1-8163-bf38202f7211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:06.423903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cd37f-430e-4cc1-8163-bf38202f7211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:06.425389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cd37f-430e-4cc1-8163-bf38202f7211 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:06.459877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 877/1770] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:06.461009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3f9ed-bc04-4b0b-800b-bc9e6d46b679 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:06.466763 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 894/1771] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:06.488436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3f9ed-bc04-4b0b-800b-bc9e6d46b679 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:06.500629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cc188-af5e-4297-be7b-d588621a31a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:06.501378 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cc188-af5e-4297-be7b-d588621a31a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:06.501664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cc188-af5e-4297-be7b-d588621a31a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:06.501943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cc188-af5e-4297-be7b-d588621a31a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:06.528700 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089cc188-af5e-4297-be7b-d588621a31a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:06.531212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089cc188-af5e-4297-be7b-d588621a31a1 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:06.561968 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 878/1772] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:06.721838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cd37f-430e-4cc1-8163-bf38202f7211 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:06.730599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ac1cd37f-430e-4cc1-8163-bf38202f7211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:06.774716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cd37f-430e-4cc1-8163-bf38202f7211 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:06.821247 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9277192-6e7a-4325-9472-db7339032407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:06.824838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9277192-6e7a-4325-9472-db7339032407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:06.826910 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9277192-6e7a-4325-9472-db7339032407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:06.828094 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9277192-6e7a-4325-9472-db7339032407 admin admin] PATH_INFO: `/v3/projects/20e43ada78fe4513ae2a475965967b34` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:06.832679 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9277192-6e7a-4325-9472-db7339032407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e43ada78fe4513ae2a475965967b34)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:06.835405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9277192-6e7a-4325-9472-db7339032407 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:06.973692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d9277192-6e7a-4325-9472-db7339032407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e43ada78fe4513ae2a475965967b34', 'request_id': 'req-d9277192-6e7a-4325-9472-db7339032407'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:06.995554 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d9277192-6e7a-4325-9472-db7339032407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e43ada78fe4513ae2a475965967b34', 'request_id': 'req-d9277192-6e7a-4325-9472-db7339032407'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:07.022634 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d9277192-6e7a-4325-9472-db7339032407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e43ada78fe4513ae2a475965967b34', 'request_id': 'req-d9277192-6e7a-4325-9472-db7339032407'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:07.057674 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d9277192-6e7a-4325-9472-db7339032407 admin admin] The token cache is being invalidate because project 20e43ada78fe4513ae2a475965967b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:07.057975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d9277192-6e7a-4325-9472-db7339032407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:07.069063 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d9277192-6e7a-4325-9472-db7339032407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:07.072520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 895/1773] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:06 2022] DELETE /identity/v3/projects/20e43ada78fe4513ae2a475965967b34 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:07.077493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c571ab9-9ab9-4050-85a2-e4c6cca00229 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:07.079896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c571ab9-9ab9-4050-85a2-e4c6cca00229 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:07.093639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c571ab9-9ab9-4050-85a2-e4c6cca00229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:07.130423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6c571ab9-9ab9-4050-85a2-e4c6cca00229 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:07.137151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6c571ab9-9ab9-4050-85a2-e4c6cca00229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:07.373092 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 879/1774] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:07.390516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245a2f-6969-40f9-b7e2-765ea960b3b7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:07.390756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245a2f-6969-40f9-b7e2-765ea960b3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:07.391003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245a2f-6969-40f9-b7e2-765ea960b3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:07.446875 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d2245a2f-6969-40f9-b7e2-765ea960b3b7 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:07.448287 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d2245a2f-6969-40f9-b7e2-765ea960b3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:07.485930 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 896/1775] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:07.490692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c571ab9-9ab9-4050-85a2-e4c6cca00229 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:07.542216 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c571ab9-9ab9-4050-85a2-e4c6cca00229 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:07.602923 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309edb3b-2a36-47dd-ab48-e7382ea36e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:07.603567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309edb3b-2a36-47dd-ab48-e7382ea36e2e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:07.603848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309edb3b-2a36-47dd-ab48-e7382ea36e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:07.604197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309edb3b-2a36-47dd-ab48-e7382ea36e2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:07.604873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309edb3b-2a36-47dd-ab48-e7382ea36e2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:07.605194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309edb3b-2a36-47dd-ab48-e7382ea36e2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:07.606939 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309edb3b-2a36-47dd-ab48-e7382ea36e2e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:07.665422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 880/1776] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:07.666003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2245a2f-6969-40f9-b7e2-765ea960b3b7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:07.677009 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2245a2f-6969-40f9-b7e2-765ea960b3b7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:07.692778 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a9c8b-2218-4d67-92fd-2a0c01024919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:07.700732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a9c8b-2218-4d67-92fd-2a0c01024919 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:07.701087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a9c8b-2218-4d67-92fd-2a0c01024919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:07.701374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a9c8b-2218-4d67-92fd-2a0c01024919 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:07.702051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a9c8b-2218-4d67-92fd-2a0c01024919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:07.710352 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a9c8b-2218-4d67-92fd-2a0c01024919 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:07.804316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 897/1777] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:07 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:07.806450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309edb3b-2a36-47dd-ab48-e7382ea36e2e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:07.820000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309edb3b-2a36-47dd-ab48-e7382ea36e2e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:07.989647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56028d-9b93-4897-a5fb-c9758f837b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:07.990685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56028d-9b93-4897-a5fb-c9758f837b52 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:07.991172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56028d-9b93-4897-a5fb-c9758f837b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:07.991650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56028d-9b93-4897-a5fb-c9758f837b52 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:07.992933 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56028d-9b93-4897-a5fb-c9758f837b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:08.000408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56028d-9b93-4897-a5fb-c9758f837b52 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:08.070440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 881/1778] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:07 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:08.074539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a9c8b-2218-4d67-92fd-2a0c01024919 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:08.096616 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a9c8b-2218-4d67-92fd-2a0c01024919 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:08.104592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a4e3d-f5e7-4c69-8051-e4369ea3b44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:08.114564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a4e3d-f5e7-4c69-8051-e4369ea3b44e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:08.115152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a4e3d-f5e7-4c69-8051-e4369ea3b44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:08.115601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a4e3d-f5e7-4c69-8051-e4369ea3b44e admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:08.117091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a4e3d-f5e7-4c69-8051-e4369ea3b44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:08.122882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a4e3d-f5e7-4c69-8051-e4369ea3b44e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:08.138104 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 898/1779] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:08.142612 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56028d-9b93-4897-a5fb-c9758f837b52 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:08.161971 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56028d-9b93-4897-a5fb-c9758f837b52 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:08.167992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3c2ac-2595-4e5b-a3c2-b700687e7185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:08.168777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3c2ac-2595-4e5b-a3c2-b700687e7185 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:08.169561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3c2ac-2595-4e5b-a3c2-b700687e7185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:08.169866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3c2ac-2595-4e5b-a3c2-b700687e7185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:08.170587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3c2ac-2595-4e5b-a3c2-b700687e7185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:08.173237 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3c2ac-2595-4e5b-a3c2-b700687e7185 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:08.231179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 882/1780] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:08.236640 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a4e3d-f5e7-4c69-8051-e4369ea3b44e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:08.258728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a4e3d-f5e7-4c69-8051-e4369ea3b44e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:08.273180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221ee97-f636-41f0-957c-1b2194339c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:08.274118 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221ee97-f636-41f0-957c-1b2194339c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:08.274604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221ee97-f636-41f0-957c-1b2194339c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:08.275081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221ee97-f636-41f0-957c-1b2194339c75 admin admin] PATH_INFO: `/v3/projects/57d9dd6b84384f5c9d7c2c35db5edf0b/users/4ff03a72bb144c77bad743bbb4dfd129/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:08.309845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221ee97-f636-41f0-957c-1b2194339c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d9dd6b84384f5c9d7c2c35db5edf0b, user_id=4ff03a72bb144c77bad743bbb4dfd129, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:08.312931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221ee97-f636-41f0-957c-1b2194339c75 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:08.350416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 899/1781] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:08 2022] PUT /identity/v3/projects/57d9dd6b84384f5c9d7c2c35db5edf0b/users/4ff03a72bb144c77bad743bbb4dfd129/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:08.362961 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28366b2b-e7b3-41a6-880d-dd918bc8848e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:08.362961 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28366b2b-e7b3-41a6-880d-dd918bc8848e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:08.364524 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28366b2b-e7b3-41a6-880d-dd918bc8848e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:08.482508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-28366b2b-e7b3-41a6-880d-dd918bc8848e None None] MFA Rules not processed for user `4ff03a72bb144c77bad743bbb4dfd129`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:08.487708 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-28366b2b-e7b3-41a6-880d-dd918bc8848e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:08.526398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:08.703838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 883/1782] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:08.711578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221ee97-f636-41f0-957c-1b2194339c75 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:08.713917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2221ee97-f636-41f0-957c-1b2194339c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:08.781779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:08.980428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a251a-7d1b-4da8-9d4b-83e5fbbdf43a None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:08.981095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a251a-7d1b-4da8-9d4b-83e5fbbdf43a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:08.982175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a251a-7d1b-4da8-9d4b-83e5fbbdf43a None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:08.984618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 884/1783] 10.222.0.48 () {54 vars in 921 bytes} [Tue Aug 30 05:10:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:10:08.994313 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221ee97-f636-41f0-957c-1b2194339c75 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:09.004201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689dd97-06b6-4fd9-a92c-d05a9acc6056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:09.004962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689dd97-06b6-4fd9-a92c-d05a9acc6056 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:09.010237 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689dd97-06b6-4fd9-a92c-d05a9acc6056 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:09.010658 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689dd97-06b6-4fd9-a92c-d05a9acc6056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:09.042716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689dd97-06b6-4fd9-a92c-d05a9acc6056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:09.044548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689dd97-06b6-4fd9-a92c-d05a9acc6056 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:09.066928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0589674-b54e-4a3d-b8fd-3d8b248b88f9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:09.067879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0589674-b54e-4a3d-b8fd-3d8b248b88f9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:09.067879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0589674-b54e-4a3d-b8fd-3d8b248b88f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:09.095410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 900/1784] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:09.128912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c0589674-b54e-4a3d-b8fd-3d8b248b88f9 None None] MFA Rules not processed for user `1aa002909502426b80c97dbf05dca008`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:09.131537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c0589674-b54e-4a3d-b8fd-3d8b248b88f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:09.218177 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689dd97-06b6-4fd9-a92c-d05a9acc6056 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:09.221290 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f689dd97-06b6-4fd9-a92c-d05a9acc6056 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:09.567986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 885/1785] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Aug 30 05:10:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 504 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:09.569056 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0589674-b54e-4a3d-b8fd-3d8b248b88f9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:09.572594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c0589674-b54e-4a3d-b8fd-3d8b248b88f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:09.632124 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689dd97-06b6-4fd9-a92c-d05a9acc6056 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:09.636193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0589674-b54e-4a3d-b8fd-3d8b248b88f9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:09.644259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86c65f-2c1f-410b-9ea8-c83225625c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:09.645231 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86c65f-2c1f-410b-9ea8-c83225625c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:09.646956 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86c65f-2c1f-410b-9ea8-c83225625c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:09.647689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86c65f-2c1f-410b-9ea8-c83225625c5b admin admin] PATH_INFO: `/v3/projects/fb6cdf17123343759ceb4e689d3c5e1d` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:09.650276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc66055-32e3-4921-8911-f668de21696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:09.651222 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86c65f-2c1f-410b-9ea8-c83225625c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6cdf17123343759ceb4e689d3c5e1d)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:09.662600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86c65f-2c1f-410b-9ea8-c83225625c5b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:09.669037 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc66055-32e3-4921-8911-f668de21696d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:09.671249 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc66055-32e3-4921-8911-f668de21696d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:09.671683 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc66055-32e3-4921-8911-f668de21696d admin admin] PATH_INFO: `/v3/projects/ef23328e1afe45b69f6112a6068ae2f7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:09.674489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc66055-32e3-4921-8911-f668de21696d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef23328e1afe45b69f6112a6068ae2f7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:09.677988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc66055-32e3-4921-8911-f668de21696d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:09.783680 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3cc66055-32e3-4921-8911-f668de21696d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef23328e1afe45b69f6112a6068ae2f7', 'request_id': 'req-3cc66055-32e3-4921-8911-f668de21696d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:09.829815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3cc66055-32e3-4921-8911-f668de21696d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef23328e1afe45b69f6112a6068ae2f7', 'request_id': 'req-3cc66055-32e3-4921-8911-f668de21696d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:09.854485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3cc66055-32e3-4921-8911-f668de21696d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef23328e1afe45b69f6112a6068ae2f7', 'request_id': 'req-3cc66055-32e3-4921-8911-f668de21696d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:09.856022 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-dc86c65f-2c1f-410b-9ea8-c83225625c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6cdf17123343759ceb4e689d3c5e1d', 'request_id': 'req-dc86c65f-2c1f-410b-9ea8-c83225625c5b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:09.886857 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-dc86c65f-2c1f-410b-9ea8-c83225625c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6cdf17123343759ceb4e689d3c5e1d', 'request_id': 'req-dc86c65f-2c1f-410b-9ea8-c83225625c5b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:09.893121 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3cc66055-32e3-4921-8911-f668de21696d admin admin] The token cache is being invalidate because project ef23328e1afe45b69f6112a6068ae2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:09.894345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3cc66055-32e3-4921-8911-f668de21696d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:09.895983 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3cc66055-32e3-4921-8911-f668de21696d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:09.904670 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-dc86c65f-2c1f-410b-9ea8-c83225625c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6cdf17123343759ceb4e689d3c5e1d', 'request_id': 'req-dc86c65f-2c1f-410b-9ea8-c83225625c5b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:09.905970 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 886/1786] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:09 2022] DELETE /identity/v3/projects/ef23328e1afe45b69f6112a6068ae2f7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:09.908785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc66055-32e3-4921-8911-f668de21696d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:09.913169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3cc66055-32e3-4921-8911-f668de21696d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:09.945024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-dc86c65f-2c1f-410b-9ea8-c83225625c5b admin admin] The token cache is being invalidate because project fb6cdf17123343759ceb4e689d3c5e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:09.946116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-dc86c65f-2c1f-410b-9ea8-c83225625c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:09.949731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-dc86c65f-2c1f-410b-9ea8-c83225625c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:09.953640 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 901/1787] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:09 2022] DELETE /identity/v3/projects/fb6cdf17123343759ceb4e689d3c5e1d => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:09.960023 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc62f5a-d5f5-4e4e-9a2b-f306342f610d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:09.960471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc62f5a-d5f5-4e4e-9a2b-f306342f610d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:09.960835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc62f5a-d5f5-4e4e-9a2b-f306342f610d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:10.018451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:10.030743 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1bc62f5a-d5f5-4e4e-9a2b-f306342f610d None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:10.039293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1bc62f5a-d5f5-4e4e-9a2b-f306342f610d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:10.174085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc66055-32e3-4921-8911-f668de21696d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:10.245772 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:10.343599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 902/1788] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:10.358142 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc62f5a-d5f5-4e4e-9a2b-f306342f610d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:10.364311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1bc62f5a-d5f5-4e4e-9a2b-f306342f610d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:10.399265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc62f5a-d5f5-4e4e-9a2b-f306342f610d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:10.412883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de35692-5527-4925-b942-1e59e933672e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:10.414044 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de35692-5527-4925-b942-1e59e933672e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:10.414920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de35692-5527-4925-b942-1e59e933672e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:10.417220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de35692-5527-4925-b942-1e59e933672e admin admin] PATH_INFO: `/v3/users/cb24f570361347a4b8fb78d6c4623172` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:10.420316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de35692-5527-4925-b942-1e59e933672e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb24f570361347a4b8fb78d6c4623172)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:10.428434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de35692-5527-4925-b942-1e59e933672e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:10.459570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b759b9-99bd-4705-a9d7-995f83def6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:10.460645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b759b9-99bd-4705-a9d7-995f83def6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:10.463930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b759b9-99bd-4705-a9d7-995f83def6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:10.464711 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b759b9-99bd-4705-a9d7-995f83def6c2 admin admin] PATH_INFO: `/v3/users/d38fe76de8f142eaa40fb888b24aabdf` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:10.467721 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b759b9-99bd-4705-a9d7-995f83def6c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d38fe76de8f142eaa40fb888b24aabdf)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:10.470840 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b759b9-99bd-4705-a9d7-995f83def6c2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:10.563574 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7de35692-5527-4925-b942-1e59e933672e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb24f570361347a4b8fb78d6c4623172'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:10.587112 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7de35692-5527-4925-b942-1e59e933672e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb24f570361347a4b8fb78d6c4623172'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:10.610651 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7de35692-5527-4925-b942-1e59e933672e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb24f570361347a4b8fb78d6c4623172'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:10.611427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7de35692-5527-4925-b942-1e59e933672e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb24f570361347a4b8fb78d6c4623172'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:10.636859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74b759b9-99bd-4705-a9d7-995f83def6c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd38fe76de8f142eaa40fb888b24aabdf'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:10.658563 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7de35692-5527-4925-b942-1e59e933672e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb24f570361347a4b8fb78d6c4623172'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:10.676436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74b759b9-99bd-4705-a9d7-995f83def6c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd38fe76de8f142eaa40fb888b24aabdf'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:10.684347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 903/1789] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:10 2022] DELETE /identity/v3/users/cb24f570361347a4b8fb78d6c4623172 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:10.684347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736813ab-df90-44bd-8fdf-0161fc4a9803 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:10.684347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736813ab-df90-44bd-8fdf-0161fc4a9803 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:10.687169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736813ab-df90-44bd-8fdf-0161fc4a9803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:10.696429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74b759b9-99bd-4705-a9d7-995f83def6c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd38fe76de8f142eaa40fb888b24aabdf'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:10.697323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74b759b9-99bd-4705-a9d7-995f83def6c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd38fe76de8f142eaa40fb888b24aabdf'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:10.698354 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74b759b9-99bd-4705-a9d7-995f83def6c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd38fe76de8f142eaa40fb888b24aabdf'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:10.723781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 887/1790] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:09 2022] DELETE /identity/v3/users/d38fe76de8f142eaa40fb888b24aabdf => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:10.725602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0c0d9-74fe-456d-91fc-7bd2abac2051 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:10.726068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0c0d9-74fe-456d-91fc-7bd2abac2051 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:10.726472 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0c0d9-74fe-456d-91fc-7bd2abac2051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:10.759294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-736813ab-df90-44bd-8fdf-0161fc4a9803 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:10.763113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-736813ab-df90-44bd-8fdf-0161fc4a9803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:10.771054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bad0c0d9-74fe-456d-91fc-7bd2abac2051 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:10.772840 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bad0c0d9-74fe-456d-91fc-7bd2abac2051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:10.965446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:10.989193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 904/1791] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:11.003031 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 888/1792] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:11.003851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736813ab-df90-44bd-8fdf-0161fc4a9803 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:11.024633 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0c0d9-74fe-456d-91fc-7bd2abac2051 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:11.027091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bad0c0d9-74fe-456d-91fc-7bd2abac2051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:11.081970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736813ab-df90-44bd-8fdf-0161fc4a9803 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:11.106010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fbe0d-8336-4fea-a91d-d2cbbb976ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:11.114378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fbe0d-8336-4fea-a91d-d2cbbb976ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:11.114378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fbe0d-8336-4fea-a91d-d2cbbb976ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:11.117606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fbe0d-8336-4fea-a91d-d2cbbb976ad7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:11.126026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fbe0d-8336-4fea-a91d-d2cbbb976ad7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:11.126783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fbe0d-8336-4fea-a91d-d2cbbb976ad7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:11.138897 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fbe0d-8336-4fea-a91d-d2cbbb976ad7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:11.181548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 905/1793] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:11.182346 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fbe0d-8336-4fea-a91d-d2cbbb976ad7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:11.193399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0c0d9-74fe-456d-91fc-7bd2abac2051 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:11.205095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa8e63-8c7e-4d4a-a457-b0578bf5dc9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:11.205799 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa8e63-8c7e-4d4a-a457-b0578bf5dc9a service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:11.206271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa8e63-8c7e-4d4a-a457-b0578bf5dc9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:11.210487 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fbe0d-8336-4fea-a91d-d2cbbb976ad7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:11.214692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa8e63-8c7e-4d4a-a457-b0578bf5dc9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:11.223759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a059b-0bf1-45fa-9a64-4079ad0a5650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:11.224421 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a059b-0bf1-45fa-9a64-4079ad0a5650 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:11.224702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a059b-0bf1-45fa-9a64-4079ad0a5650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:11.224958 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a059b-0bf1-45fa-9a64-4079ad0a5650 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:11.225599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a059b-0bf1-45fa-9a64-4079ad0a5650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:11.227526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a059b-0bf1-45fa-9a64-4079ad0a5650 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:11.240912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa8e63-8c7e-4d4a-a457-b0578bf5dc9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:11.242433 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa8e63-8c7e-4d4a-a457-b0578bf5dc9a service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:11.262549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 889/1794] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:11.311080 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa8e63-8c7e-4d4a-a457-b0578bf5dc9a service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:11.313784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 906/1795] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:11 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:11.327161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa8e63-8c7e-4d4a-a457-b0578bf5dc9a service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:11.529685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ad717-02ae-4f98-99eb-e6283d9960ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:11.530336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ad717-02ae-4f98-99eb-e6283d9960ad admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:11.535122 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ad717-02ae-4f98-99eb-e6283d9960ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:11.536405 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ad717-02ae-4f98-99eb-e6283d9960ad admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:11.538810 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ad717-02ae-4f98-99eb-e6283d9960ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:11.552703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ad717-02ae-4f98-99eb-e6283d9960ad admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:11.646577 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 890/1796] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:11 2022] POST /identity/v3/users => generated 285 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:11.648632 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a059b-0bf1-45fa-9a64-4079ad0a5650 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:11.668542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a059b-0bf1-45fa-9a64-4079ad0a5650 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:11.675343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1cd9d-1347-42e2-bbad-3346f24d7a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:11.676316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1cd9d-1347-42e2-bbad-3346f24d7a0c admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:11.679430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e04696-2d30-4943-a2f0-6e4400f14d3b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:11.680074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e04696-2d30-4943-a2f0-6e4400f14d3b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:11.680548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e04696-2d30-4943-a2f0-6e4400f14d3b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:11.682688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 891/1797] 10.222.0.48 () {54 vars in 921 bytes} [Tue Aug 30 05:10:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:10:11.683081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1cd9d-1347-42e2-bbad-3346f24d7a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:11.683718 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1cd9d-1347-42e2-bbad-3346f24d7a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:11.685477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1cd9d-1347-42e2-bbad-3346f24d7a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:11.687541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1cd9d-1347-42e2-bbad-3346f24d7a0c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:11.703257 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 907/1798] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:11.708471 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e04696-2d30-4943-a2f0-6e4400f14d3b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:11.724218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e04696-2d30-4943-a2f0-6e4400f14d3b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:11.729510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad0fc8-91a0-4ba4-a5aa-156b210bf6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:11.730357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad0fc8-91a0-4ba4-a5aa-156b210bf6af admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:11.730814 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad0fc8-91a0-4ba4-a5aa-156b210bf6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:11.731438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad0fc8-91a0-4ba4-a5aa-156b210bf6af admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:11.732323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad0fc8-91a0-4ba4-a5aa-156b210bf6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:11.734368 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad0fc8-91a0-4ba4-a5aa-156b210bf6af admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:11.747856 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 892/1799] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:11.753015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1cd9d-1347-42e2-bbad-3346f24d7a0c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:11.767282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1cd9d-1347-42e2-bbad-3346f24d7a0c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:11.774551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a7df0-8a6e-4ee1-848b-f3112f01dcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:11.775893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a7df0-8a6e-4ee1-848b-f3112f01dcbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:11.776679 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a7df0-8a6e-4ee1-848b-f3112f01dcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:11.777202 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a7df0-8a6e-4ee1-848b-f3112f01dcbe admin admin] PATH_INFO: `/v3/projects/a741d407c2a54e059f5cf8072f65d1ec/users/d4390ef194d74242b90f4584be7df637/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:11.781694 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:11.805210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a7df0-8a6e-4ee1-848b-f3112f01dcbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a741d407c2a54e059f5cf8072f65d1ec, user_id=d4390ef194d74242b90f4584be7df637, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:11.808328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a7df0-8a6e-4ee1-848b-f3112f01dcbe admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:11.834006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 908/1800] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:11 2022] PUT /identity/v3/projects/a741d407c2a54e059f5cf8072f65d1ec/users/d4390ef194d74242b90f4584be7df637/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:11.844884 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a5f43-b0c2-4df2-8cc4-7add69edda80 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:11.845165 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a5f43-b0c2-4df2-8cc4-7add69edda80 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:11.845521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a5f43-b0c2-4df2-8cc4-7add69edda80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:11.893981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2d19-0b09-47ba-bb3e-da284e2c63b6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:11.894279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2d19-0b09-47ba-bb3e-da284e2c63b6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:11.894601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2d19-0b09-47ba-bb3e-da284e2c63b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:11.901947 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-da9a5f43-b0c2-4df2-8cc4-7add69edda80 None None] MFA Rules not processed for user `d4390ef194d74242b90f4584be7df637`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:11.903139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-da9a5f43-b0c2-4df2-8cc4-7add69edda80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:11.993223 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-485a2d19-0b09-47ba-bb3e-da284e2c63b6 None None] MFA Rules not processed for user `1aa002909502426b80c97dbf05dca008`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:12.011539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-485a2d19-0b09-47ba-bb3e-da284e2c63b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:12.060243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 893/1801] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:12.065125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a5f43-b0c2-4df2-8cc4-7add69edda80 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:12.071422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:12.196080 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a5f43-b0c2-4df2-8cc4-7add69edda80 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:12.209125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b16dea-6829-4d0a-9b52-b7e0e1c36560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:12.209860 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b16dea-6829-4d0a-9b52-b7e0e1c36560 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:12.210063 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b16dea-6829-4d0a-9b52-b7e0e1c36560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:12.210295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b16dea-6829-4d0a-9b52-b7e0e1c36560 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:12.211045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b16dea-6829-4d0a-9b52-b7e0e1c36560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:12.212893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b16dea-6829-4d0a-9b52-b7e0e1c36560 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:12.269256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 894/1802] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:12 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:10:12.273448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b16dea-6829-4d0a-9b52-b7e0e1c36560 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:12.355284 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 909/1803] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Aug 30 05:10:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:12.356808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2d19-0b09-47ba-bb3e-da284e2c63b6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:12.360066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-485a2d19-0b09-47ba-bb3e-da284e2c63b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:12.412430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2d19-0b09-47ba-bb3e-da284e2c63b6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:12.479577 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b16dea-6829-4d0a-9b52-b7e0e1c36560 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:12.489679 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48416c0e-692e-400c-a176-b72cf20c19c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:12.490438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48416c0e-692e-400c-a176-b72cf20c19c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:12.490696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48416c0e-692e-400c-a176-b72cf20c19c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:12.491069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48416c0e-692e-400c-a176-b72cf20c19c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:12.491847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48416c0e-692e-400c-a176-b72cf20c19c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:12.494262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48416c0e-692e-400c-a176-b72cf20c19c2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:12.551926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 895/1804] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:12 2022] POST /identity/v3/users => generated 291 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:10:12.552817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48416c0e-692e-400c-a176-b72cf20c19c2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:12.556477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-48416c0e-692e-400c-a176-b72cf20c19c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:12.586582 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48416c0e-692e-400c-a176-b72cf20c19c2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:12.597646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:12.598384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:12.598695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:12.598971 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac admin admin] PATH_INFO: `/v3/projects/ca8431144ea04bb78f1d28a4747ecc55` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:12.603242 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756fa64-12ff-4f01-aafc-7691828b82b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:12.603986 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756fa64-12ff-4f01-aafc-7691828b82b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:12.604273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756fa64-12ff-4f01-aafc-7691828b82b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:12.604546 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756fa64-12ff-4f01-aafc-7691828b82b3 admin admin] PATH_INFO: `/v3/projects/e0bd019c4c7640d18e4e22ad9992134b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:12.606426 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756fa64-12ff-4f01-aafc-7691828b82b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0bd019c4c7640d18e4e22ad9992134b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:12.609545 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8431144ea04bb78f1d28a4747ecc55)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:12.612160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:12.616835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756fa64-12ff-4f01-aafc-7691828b82b3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:12.744892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0756fa64-12ff-4f01-aafc-7691828b82b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0bd019c4c7640d18e4e22ad9992134b', 'request_id': 'req-0756fa64-12ff-4f01-aafc-7691828b82b3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:12.758871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0756fa64-12ff-4f01-aafc-7691828b82b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0bd019c4c7640d18e4e22ad9992134b', 'request_id': 'req-0756fa64-12ff-4f01-aafc-7691828b82b3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:12.781614 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8431144ea04bb78f1d28a4747ecc55', 'request_id': 'req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:12.783056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0756fa64-12ff-4f01-aafc-7691828b82b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0bd019c4c7640d18e4e22ad9992134b', 'request_id': 'req-0756fa64-12ff-4f01-aafc-7691828b82b3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:12.800767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8431144ea04bb78f1d28a4747ecc55', 'request_id': 'req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:12.814671 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0756fa64-12ff-4f01-aafc-7691828b82b3 admin admin] The token cache is being invalidate because project e0bd019c4c7640d18e4e22ad9992134b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:12.814961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0756fa64-12ff-4f01-aafc-7691828b82b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:12.815995 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0756fa64-12ff-4f01-aafc-7691828b82b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:12.818293 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8431144ea04bb78f1d28a4747ecc55', 'request_id': 'req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:12.824163 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 910/1805] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:12 2022] DELETE /identity/v3/projects/e0bd019c4c7640d18e4e22ad9992134b => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:12.825169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756fa64-12ff-4f01-aafc-7691828b82b3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:12.830422 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0756fa64-12ff-4f01-aafc-7691828b82b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:12.846471 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac admin admin] The token cache is being invalidate because project ca8431144ea04bb78f1d28a4747ecc55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:12.850367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:12.866277 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:12.877415 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:12.881737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 896/1806] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:12 2022] DELETE /identity/v3/projects/ca8431144ea04bb78f1d28a4747ecc55 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:12.882286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:12.884653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:12.894071 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:13.018688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df9d6c-60ca-466d-ac9d-057fc53a69ac admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:13.035105 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaf99f-6896-456b-80cd-ecaed5fab3b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:13.036815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaf99f-6896-456b-80cd-ecaed5fab3b8 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:13.037098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaf99f-6896-456b-80cd-ecaed5fab3b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:13.037377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaf99f-6896-456b-80cd-ecaed5fab3b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:13.040173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-88aaf99f-6896-456b-80cd-ecaed5fab3b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:13.061490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaf99f-6896-456b-80cd-ecaed5fab3b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:13.063439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaf99f-6896-456b-80cd-ecaed5fab3b8 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:13.092102 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 897/1807] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:13.095418 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ed4b7-42f7-4db1-bd64-911a60593d25 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:13.099786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ed4b7-42f7-4db1-bd64-911a60593d25 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:13.100201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ed4b7-42f7-4db1-bd64-911a60593d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:13.122001 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756fa64-12ff-4f01-aafc-7691828b82b3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:13.144211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7e6ed4b7-42f7-4db1-bd64-911a60593d25 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:13.148822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7e6ed4b7-42f7-4db1-bd64-911a60593d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:13.282731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567094c3-a257-4328-ba9e-a1b438b8857f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:13.282731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567094c3-a257-4328-ba9e-a1b438b8857f admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:13.282731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567094c3-a257-4328-ba9e-a1b438b8857f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:13.282731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567094c3-a257-4328-ba9e-a1b438b8857f admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:13.283211 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567094c3-a257-4328-ba9e-a1b438b8857f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:13.283715 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567094c3-a257-4328-ba9e-a1b438b8857f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:13.297188 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 898/1808] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:13.298986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ed4b7-42f7-4db1-bd64-911a60593d25 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:13.303674 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 911/1809] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:13.308274 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc2cec-e0f7-45ec-9939-ca2a19d43a24 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:13.308557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc2cec-e0f7-45ec-9939-ca2a19d43a24 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:13.308827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc2cec-e0f7-45ec-9939-ca2a19d43a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:13.319583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7e6ed4b7-42f7-4db1-bd64-911a60593d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:13.338114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2ccc2cec-e0f7-45ec-9939-ca2a19d43a24 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:13.339544 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2ccc2cec-e0f7-45ec-9939-ca2a19d43a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:13.341731 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ed4b7-42f7-4db1-bd64-911a60593d25 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:13.352132 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4676d9-244a-409f-9f91-c3cd99878f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:13.352913 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4676d9-244a-409f-9f91-c3cd99878f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:13.353370 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4676d9-244a-409f-9f91-c3cd99878f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:13.354339 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4676d9-244a-409f-9f91-c3cd99878f9b admin admin] PATH_INFO: `/v3/users/6b739831eb5c43f4ade05972ada8a8e3` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:13.355138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 912/1810] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:13.356006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc2cec-e0f7-45ec-9939-ca2a19d43a24 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:13.357360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2ccc2cec-e0f7-45ec-9939-ca2a19d43a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:13.359048 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4676d9-244a-409f-9f91-c3cd99878f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b739831eb5c43f4ade05972ada8a8e3)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:13.363295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4676d9-244a-409f-9f91-c3cd99878f9b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:13.401179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc2cec-e0f7-45ec-9939-ca2a19d43a24 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:13.411828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce44c2-bbfc-4697-9336-08c6106efee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:13.417142 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce44c2-bbfc-4697-9336-08c6106efee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:13.417429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce44c2-bbfc-4697-9336-08c6106efee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:13.417708 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce44c2-bbfc-4697-9336-08c6106efee5 admin admin] PATH_INFO: `/v3/projects/559ef12736d040c7ad221b3ecc1da735/users/fbb545e6abdc40b89016b192170bce81/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:13.452081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce44c2-bbfc-4697-9336-08c6106efee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559ef12736d040c7ad221b3ecc1da735, user_id=fbb545e6abdc40b89016b192170bce81, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:13.455302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce44c2-bbfc-4697-9336-08c6106efee5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:13.488172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ed4676d9-244a-409f-9f91-c3cd99878f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b739831eb5c43f4ade05972ada8a8e3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:13.493825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 913/1811] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:13 2022] PUT /identity/v3/projects/559ef12736d040c7ad221b3ecc1da735/users/fbb545e6abdc40b89016b192170bce81/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:13.498110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce44c2-bbfc-4697-9336-08c6106efee5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:13.511177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ed4676d9-244a-409f-9f91-c3cd99878f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b739831eb5c43f4ade05972ada8a8e3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:13.522908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ed4676d9-244a-409f-9f91-c3cd99878f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b739831eb5c43f4ade05972ada8a8e3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:13.523825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ed4676d9-244a-409f-9f91-c3cd99878f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b739831eb5c43f4ade05972ada8a8e3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:13.524558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ed4676d9-244a-409f-9f91-c3cd99878f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b739831eb5c43f4ade05972ada8a8e3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:13.538589 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:13.545874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 899/1812] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:13 2022] DELETE /identity/v3/users/6b739831eb5c43f4ade05972ada8a8e3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:13.546934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4676d9-244a-409f-9f91-c3cd99878f9b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:13.549732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ed4676d9-244a-409f-9f91-c3cd99878f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:13.591930 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce44c2-bbfc-4697-9336-08c6106efee5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:13.642668 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:13.679326 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4676d9-244a-409f-9f91-c3cd99878f9b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:13.686052 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9485a5-08e9-4803-a02f-7fe9c83addc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:13.686848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9485a5-08e9-4803-a02f-7fe9c83addc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:13.687457 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9485a5-08e9-4803-a02f-7fe9c83addc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:13.688020 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9485a5-08e9-4803-a02f-7fe9c83addc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:13.688824 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9485a5-08e9-4803-a02f-7fe9c83addc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:13.690891 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9485a5-08e9-4803-a02f-7fe9c83addc5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:13.704825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 900/1813] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:13.709391 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9485a5-08e9-4803-a02f-7fe9c83addc5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:13.723025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9485a5-08e9-4803-a02f-7fe9c83addc5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:13.729103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1230467-7195-4f43-9cc5-e9282c6779b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:13.729946 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1230467-7195-4f43-9cc5-e9282c6779b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:13.730374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1230467-7195-4f43-9cc5-e9282c6779b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:13.730793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1230467-7195-4f43-9cc5-e9282c6779b1 admin admin] PATH_INFO: `/v3/projects/559ef12736d040c7ad221b3ecc1da735/users/fbb545e6abdc40b89016b192170bce81/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:13.733108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1230467-7195-4f43-9cc5-e9282c6779b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559ef12736d040c7ad221b3ecc1da735, user_id=fbb545e6abdc40b89016b192170bce81, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:13.736022 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1230467-7195-4f43-9cc5-e9282c6779b1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:13.737048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8d76f-a391-4df5-b069-dee9a7b28bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:13.737841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8d76f-a391-4df5-b069-dee9a7b28bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:13.738124 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8d76f-a391-4df5-b069-dee9a7b28bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:13.738397 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8d76f-a391-4df5-b069-dee9a7b28bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:13.739058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8d76f-a391-4df5-b069-dee9a7b28bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:13.742346 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8d76f-a391-4df5-b069-dee9a7b28bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:13.744063 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8d76f-a391-4df5-b069-dee9a7b28bf2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:13.766796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 901/1814] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:13 2022] PUT /identity/v3/projects/559ef12736d040c7ad221b3ecc1da735/users/fbb545e6abdc40b89016b192170bce81/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:13.805246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a144e-1545-473b-a954-575bb495643c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:13.805246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a144e-1545-473b-a954-575bb495643c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:13.805246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a144e-1545-473b-a954-575bb495643c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:13.811621 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 914/1815] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:13.831333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8d76f-a391-4df5-b069-dee9a7b28bf2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:13.835148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-37c8d76f-a391-4df5-b069-dee9a7b28bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:13.870653 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8d76f-a391-4df5-b069-dee9a7b28bf2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:13.904907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3e8a144e-1545-473b-a954-575bb495643c None None] MFA Rules not processed for user `fbb545e6abdc40b89016b192170bce81`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:13.906140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3e8a144e-1545-473b-a954-575bb495643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:14.034038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6af9cc-5926-48f6-ab23-a2b50eec2f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:14.034618 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6af9cc-5926-48f6-ab23-a2b50eec2f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:14.034891 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6af9cc-5926-48f6-ab23-a2b50eec2f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:14.035221 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6af9cc-5926-48f6-ab23-a2b50eec2f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:14.035781 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6af9cc-5926-48f6-ab23-a2b50eec2f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:14.037713 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6af9cc-5926-48f6-ab23-a2b50eec2f85 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:14.063803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 902/1816] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:14.063803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a144e-1545-473b-a954-575bb495643c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:14.063803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3e8a144e-1545-473b-a954-575bb495643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:14.099278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 915/1817] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:13 2022] POST /identity/v3/projects => generated 371 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:10:14.103708 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6af9cc-5926-48f6-ab23-a2b50eec2f85 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:14.110923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8c6af9cc-5926-48f6-ab23-a2b50eec2f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:14.212671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a144e-1545-473b-a954-575bb495643c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:14.222609 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:14.234552 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6af9cc-5926-48f6-ab23-a2b50eec2f85 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:14.245169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e8111-6ed3-4b5c-8594-ca41b9374550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:14.245927 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e8111-6ed3-4b5c-8594-ca41b9374550 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:14.246329 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e8111-6ed3-4b5c-8594-ca41b9374550 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:14.246620 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e8111-6ed3-4b5c-8594-ca41b9374550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:14.312537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5125cb-7d44-42b2-a81d-239f052661a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:14.313982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5125cb-7d44-42b2-a81d-239f052661a6 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:14.313982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5125cb-7d44-42b2-a81d-239f052661a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:14.314292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5125cb-7d44-42b2-a81d-239f052661a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:14.319696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6c5125cb-7d44-42b2-a81d-239f052661a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:14.333313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5125cb-7d44-42b2-a81d-239f052661a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:14.335502 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5125cb-7d44-42b2-a81d-239f052661a6 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:14.350671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 903/1818] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:14.351856 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5125cb-7d44-42b2-a81d-239f052661a6 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:14.396436 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:14.412730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e8111-6ed3-4b5c-8594-ca41b9374550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:14.417677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e8111-6ed3-4b5c-8594-ca41b9374550 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:14.436130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 916/1819] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:14.436988 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e8111-6ed3-4b5c-8594-ca41b9374550 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:14.439142 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-883e8111-6ed3-4b5c-8594-ca41b9374550 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:14.506707 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5125cb-7d44-42b2-a81d-239f052661a6 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:14.525617 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7079cb-87cb-4d4a-b053-e4b51113dee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:14.526338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7079cb-87cb-4d4a-b053-e4b51113dee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:14.526617 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7079cb-87cb-4d4a-b053-e4b51113dee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:14.526889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7079cb-87cb-4d4a-b053-e4b51113dee2 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:14.527536 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7079cb-87cb-4d4a-b053-e4b51113dee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:14.529564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7079cb-87cb-4d4a-b053-e4b51113dee2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:14.572505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 904/1820] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:14 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:14.573540 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7079cb-87cb-4d4a-b053-e4b51113dee2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:14.577643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5e7079cb-87cb-4d4a-b053-e4b51113dee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:14.592502 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7079cb-87cb-4d4a-b053-e4b51113dee2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:14.598025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef372255-59ad-4f67-8cd3-5e1c19ff8a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:14.598830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef372255-59ad-4f67-8cd3-5e1c19ff8a8c service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:14.599373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef372255-59ad-4f67-8cd3-5e1c19ff8a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:14.599719 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef372255-59ad-4f67-8cd3-5e1c19ff8a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:14.601822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ef372255-59ad-4f67-8cd3-5e1c19ff8a8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:14.611522 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e8111-6ed3-4b5c-8594-ca41b9374550 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:14.629287 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49f4d0-4a46-4b8e-893a-4ca88458fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:14.630110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49f4d0-4a46-4b8e-893a-4ca88458fe83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:14.630790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49f4d0-4a46-4b8e-893a-4ca88458fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:14.630790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49f4d0-4a46-4b8e-893a-4ca88458fe83 admin admin] PATH_INFO: `/v3/projects/b854c8cb9dc5493e97e3d34bec1d2db9` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:14.636888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49f4d0-4a46-4b8e-893a-4ca88458fe83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b854c8cb9dc5493e97e3d34bec1d2db9)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:14.641855 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49f4d0-4a46-4b8e-893a-4ca88458fe83 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:14.713524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0b49f4d0-4a46-4b8e-893a-4ca88458fe83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b854c8cb9dc5493e97e3d34bec1d2db9', 'request_id': 'req-0b49f4d0-4a46-4b8e-893a-4ca88458fe83'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:14.715442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef372255-59ad-4f67-8cd3-5e1c19ff8a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:14.717604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef372255-59ad-4f67-8cd3-5e1c19ff8a8c service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:14.721218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0b49f4d0-4a46-4b8e-893a-4ca88458fe83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b854c8cb9dc5493e97e3d34bec1d2db9', 'request_id': 'req-0b49f4d0-4a46-4b8e-893a-4ca88458fe83'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:14.731273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0b49f4d0-4a46-4b8e-893a-4ca88458fe83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b854c8cb9dc5493e97e3d34bec1d2db9', 'request_id': 'req-0b49f4d0-4a46-4b8e-893a-4ca88458fe83'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:14.732908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 905/1821] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:14.733950 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef372255-59ad-4f67-8cd3-5e1c19ff8a8c service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:14.759876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef372255-59ad-4f67-8cd3-5e1c19ff8a8c service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:14.781139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:14.784355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0b49f4d0-4a46-4b8e-893a-4ca88458fe83 admin admin] The token cache is being invalidate because project b854c8cb9dc5493e97e3d34bec1d2db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:14.784651 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0b49f4d0-4a46-4b8e-893a-4ca88458fe83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:14.785747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0b49f4d0-4a46-4b8e-893a-4ca88458fe83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:14.788242 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 917/1822] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:14 2022] DELETE /identity/v3/projects/b854c8cb9dc5493e97e3d34bec1d2db9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:14.793165 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310abb32-028e-44a7-be00-676949a872d3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:14.793497 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310abb32-028e-44a7-be00-676949a872d3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:14.793727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310abb32-028e-44a7-be00-676949a872d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:14.817485 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-310abb32-028e-44a7-be00-676949a872d3 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:14.819882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-310abb32-028e-44a7-be00-676949a872d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:14.854142 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f93b89-51b5-43b3-889d-a29fcbf5969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:14.855212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f93b89-51b5-43b3-889d-a29fcbf5969d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:14.855555 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f93b89-51b5-43b3-889d-a29fcbf5969d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:14.855901 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f93b89-51b5-43b3-889d-a29fcbf5969d admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:14.857016 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f93b89-51b5-43b3-889d-a29fcbf5969d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:14.858809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f93b89-51b5-43b3-889d-a29fcbf5969d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:14.878652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 906/1823] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:14.879711 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f93b89-51b5-43b3-889d-a29fcbf5969d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:14.882416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f5f93b89-51b5-43b3-889d-a29fcbf5969d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:14.906581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f93b89-51b5-43b3-889d-a29fcbf5969d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:14.915706 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ef6f2-29eb-4475-800d-b94f74c3c97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:14.916404 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ef6f2-29eb-4475-800d-b94f74c3c97f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:14.916686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ef6f2-29eb-4475-800d-b94f74c3c97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:14.917022 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ef6f2-29eb-4475-800d-b94f74c3c97f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:14.918714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ef6f2-29eb-4475-800d-b94f74c3c97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:14.920803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ef6f2-29eb-4475-800d-b94f74c3c97f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:14.937831 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 907/1824] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:14.938050 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 918/1825] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:14.939304 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ef6f2-29eb-4475-800d-b94f74c3c97f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:14.946152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7db89a-d4e4-4ab5-8471-487d3ecd6ca6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:14.946826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7db89a-d4e4-4ab5-8471-487d3ecd6ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:14.946826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7db89a-d4e4-4ab5-8471-487d3ecd6ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:14.960661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ef6f2-29eb-4475-800d-b94f74c3c97f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:14.966551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b350c-52ad-4fb9-9724-21d5dea68dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:14.967321 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b350c-52ad-4fb9-9724-21d5dea68dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:14.967736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b350c-52ad-4fb9-9724-21d5dea68dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:14.968112 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b350c-52ad-4fb9-9724-21d5dea68dbd admin admin] PATH_INFO: `/v3/projects/0cdf6e8adc1a42a99d30243dbd6d3762/users/49b8dde87752484e8a5dacfb3a816adf/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:14.977995 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fe7db89a-d4e4-4ab5-8471-487d3ecd6ca6 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:14.980034 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fe7db89a-d4e4-4ab5-8471-487d3ecd6ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:14.991622 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b350c-52ad-4fb9-9724-21d5dea68dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdf6e8adc1a42a99d30243dbd6d3762, user_id=49b8dde87752484e8a5dacfb3a816adf, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:14.993169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 919/1826] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:14.997085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b350c-52ad-4fb9-9724-21d5dea68dbd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:14.998549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7db89a-d4e4-4ab5-8471-487d3ecd6ca6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:15.018878 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7db89a-d4e4-4ab5-8471-487d3ecd6ca6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:15.031001 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 908/1827] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:14 2022] PUT /identity/v3/projects/0cdf6e8adc1a42a99d30243dbd6d3762/users/49b8dde87752484e8a5dacfb3a816adf/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:15.038460 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ddd40-17ce-4e3d-9c47-a50f503fd957 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:15.038794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ddd40-17ce-4e3d-9c47-a50f503fd957 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:15.039026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ddd40-17ce-4e3d-9c47-a50f503fd957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:15.056601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:15.085571 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-655ddd40-17ce-4e3d-9c47-a50f503fd957 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:15.087084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-655ddd40-17ce-4e3d-9c47-a50f503fd957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:15.155598 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84486ce9-9aab-4771-b068-9515f488aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:15.156269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84486ce9-9aab-4771-b068-9515f488aac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:15.156560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84486ce9-9aab-4771-b068-9515f488aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:15.156850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84486ce9-9aab-4771-b068-9515f488aac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:15.157504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84486ce9-9aab-4771-b068-9515f488aac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:15.157807 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84486ce9-9aab-4771-b068-9515f488aac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:15.159422 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84486ce9-9aab-4771-b068-9515f488aac2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:15.191791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 920/1828] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:15.196328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84486ce9-9aab-4771-b068-9515f488aac2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:15.218600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84486ce9-9aab-4771-b068-9515f488aac2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:15.238228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc4f4e-bb5c-42ed-841a-079303514561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:15.239535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc4f4e-bb5c-42ed-841a-079303514561 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:15.240134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc4f4e-bb5c-42ed-841a-079303514561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:15.241083 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc4f4e-bb5c-42ed-841a-079303514561 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:15.242508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc4f4e-bb5c-42ed-841a-079303514561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:15.252596 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc4f4e-bb5c-42ed-841a-079303514561 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:15.302768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 909/1829] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:15.349581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ddd40-17ce-4e3d-9c47-a50f503fd957 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:15.351363 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-655ddd40-17ce-4e3d-9c47-a50f503fd957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:15.374367 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 921/1830] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:15 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:15.380460 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc4f4e-bb5c-42ed-841a-079303514561 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:15.453347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ddd40-17ce-4e3d-9c47-a50f503fd957 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:15.486640 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc4f4e-bb5c-42ed-841a-079303514561 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:15.496670 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd528b4-1ddc-499d-9957-dbcbcae30696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:15.497609 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd528b4-1ddc-499d-9957-dbcbcae30696 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:15.497909 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd528b4-1ddc-499d-9957-dbcbcae30696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:15.500316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd528b4-1ddc-499d-9957-dbcbcae30696 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:15.501026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd528b4-1ddc-499d-9957-dbcbcae30696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:15.503376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd528b4-1ddc-499d-9957-dbcbcae30696 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:15.508071 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:15.549551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd91559-08b9-4894-ae42-22bed6afd059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:15.550275 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd91559-08b9-4894-ae42-22bed6afd059 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:15.550624 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd91559-08b9-4894-ae42-22bed6afd059 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:15.550964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd91559-08b9-4894-ae42-22bed6afd059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:15.559369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 922/1831] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:15 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:15.560678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd528b4-1ddc-499d-9957-dbcbcae30696 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:15.569948 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd91559-08b9-4894-ae42-22bed6afd059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:15.573359 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd528b4-1ddc-499d-9957-dbcbcae30696 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:15.575469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd91559-08b9-4894-ae42-22bed6afd059 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:15.578968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8c939-75a1-43a0-aac1-1f14ddf153f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:15.579684 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8c939-75a1-43a0-aac1-1f14ddf153f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:15.579989 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8c939-75a1-43a0-aac1-1f14ddf153f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:15.580269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8c939-75a1-43a0-aac1-1f14ddf153f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:15.580929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8c939-75a1-43a0-aac1-1f14ddf153f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:15.583631 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8c939-75a1-43a0-aac1-1f14ddf153f0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:15.601397 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 923/1832] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:15.602684 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8c939-75a1-43a0-aac1-1f14ddf153f0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:15.606055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 910/1833] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:15.619226 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8c939-75a1-43a0-aac1-1f14ddf153f0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:15.625053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a2df7-48d5-4230-9484-fa37038be221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:15.625711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a2df7-48d5-4230-9484-fa37038be221 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:15.626144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a2df7-48d5-4230-9484-fa37038be221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:15.626424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a2df7-48d5-4230-9484-fa37038be221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:15.627069 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a2df7-48d5-4230-9484-fa37038be221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:15.628783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a2df7-48d5-4230-9484-fa37038be221 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:15.641635 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 924/1834] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:15.645993 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd91559-08b9-4894-ae42-22bed6afd059 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:15.660257 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd91559-08b9-4894-ae42-22bed6afd059 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:15.665932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609aeedf-14b5-465e-930a-2abca24a1a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:15.666889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609aeedf-14b5-465e-930a-2abca24a1a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:15.667776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609aeedf-14b5-465e-930a-2abca24a1a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:15.668098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609aeedf-14b5-465e-930a-2abca24a1a99 admin admin] PATH_INFO: `/v3/projects/0bad44aa6c7a4289ab734c0383d26943/users/83600379407342fd9cff78b353e2a369/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:15.690855 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609aeedf-14b5-465e-930a-2abca24a1a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bad44aa6c7a4289ab734c0383d26943, user_id=83600379407342fd9cff78b353e2a369, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:15.694491 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609aeedf-14b5-465e-930a-2abca24a1a99 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:15.714816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 911/1835] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:15 2022] PUT /identity/v3/projects/0bad44aa6c7a4289ab734c0383d26943/users/83600379407342fd9cff78b353e2a369/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:15.726514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0055f4-80a6-467a-910f-93131af9f257 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:15.726891 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0055f4-80a6-467a-910f-93131af9f257 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:15.727121 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0055f4-80a6-467a-910f-93131af9f257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:15.759367 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9c0055f4-80a6-467a-910f-93131af9f257 None None] MFA Rules not processed for user `83600379407342fd9cff78b353e2a369`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:15.761108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9c0055f4-80a6-467a-910f-93131af9f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:15.850324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:15.879976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 925/1836] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:15.883355 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609aeedf-14b5-465e-930a-2abca24a1a99 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:15.948628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609aeedf-14b5-465e-930a-2abca24a1a99 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:15.954882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf179cb-4332-42d7-89f8-cbd0fd2d1575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:15.955413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf179cb-4332-42d7-89f8-cbd0fd2d1575 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:15.955753 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf179cb-4332-42d7-89f8-cbd0fd2d1575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:15.956042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf179cb-4332-42d7-89f8-cbd0fd2d1575 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:15.956734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf179cb-4332-42d7-89f8-cbd0fd2d1575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:15.958716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf179cb-4332-42d7-89f8-cbd0fd2d1575 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:15.997683 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 912/1837] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:15 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:10:16.000100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0055f4-80a6-467a-910f-93131af9f257 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:16.013924 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0055f4-80a6-467a-910f-93131af9f257 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:16.090471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae5d96-bd59-4089-a81b-fdf959a99970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:16.091090 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae5d96-bd59-4089-a81b-fdf959a99970 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:16.091367 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae5d96-bd59-4089-a81b-fdf959a99970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:16.091641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae5d96-bd59-4089-a81b-fdf959a99970 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:16.092311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae5d96-bd59-4089-a81b-fdf959a99970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:16.094352 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae5d96-bd59-4089-a81b-fdf959a99970 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:16.120862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 926/1838] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:15 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:16.124706 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf179cb-4332-42d7-89f8-cbd0fd2d1575 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:16.151728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf179cb-4332-42d7-89f8-cbd0fd2d1575 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:16.158417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9725f-f150-493d-9a27-850dfd54fc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:16.159157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9725f-f150-493d-9a27-850dfd54fc8c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:16.159532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9725f-f150-493d-9a27-850dfd54fc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:16.159924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9725f-f150-493d-9a27-850dfd54fc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:16.160707 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9725f-f150-493d-9a27-850dfd54fc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:16.162559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9725f-f150-493d-9a27-850dfd54fc8c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:16.176070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 913/1839] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:16.183462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae5d96-bd59-4089-a81b-fdf959a99970 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:16.195370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae5d96-bd59-4089-a81b-fdf959a99970 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:16.202235 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2e904-a05c-4d80-9c40-e33b2eac0588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:16.202921 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2e904-a05c-4d80-9c40-e33b2eac0588 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:16.203205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2e904-a05c-4d80-9c40-e33b2eac0588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:16.203508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2e904-a05c-4d80-9c40-e33b2eac0588 admin admin] PATH_INFO: `/v3/projects/7341e4c7236a45a7bcfe211287f09941/users/7f888bd2c6094979b873bba4216f7006/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:16.223536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2e904-a05c-4d80-9c40-e33b2eac0588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7341e4c7236a45a7bcfe211287f09941, user_id=7f888bd2c6094979b873bba4216f7006, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:16.226608 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2e904-a05c-4d80-9c40-e33b2eac0588 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:16.244684 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 927/1840] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:16 2022] PUT /identity/v3/projects/7341e4c7236a45a7bcfe211287f09941/users/7f888bd2c6094979b873bba4216f7006/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:16.249209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9725f-f150-493d-9a27-850dfd54fc8c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:16.263250 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9725f-f150-493d-9a27-850dfd54fc8c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:16.370328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2e904-a05c-4d80-9c40-e33b2eac0588 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:16.372624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2cd2e904-a05c-4d80-9c40-e33b2eac0588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:16.466121 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c0b42-31e5-48cd-b49d-495f6619f6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:16.466736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c0b42-31e5-48cd-b49d-495f6619f6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:16.467011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c0b42-31e5-48cd-b49d-495f6619f6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:16.467278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c0b42-31e5-48cd-b49d-495f6619f6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:16.467924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c0b42-31e5-48cd-b49d-495f6619f6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:16.469581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c0b42-31e5-48cd-b49d-495f6619f6e5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:16.504537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 914/1841] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:16.510747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c0b42-31e5-48cd-b49d-495f6619f6e5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:16.525857 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2e904-a05c-4d80-9c40-e33b2eac0588 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:16.533431 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561b3f6-6b49-4fdf-844c-585e509100c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:16.534092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561b3f6-6b49-4fdf-844c-585e509100c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:16.534389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561b3f6-6b49-4fdf-844c-585e509100c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:16.534710 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561b3f6-6b49-4fdf-844c-585e509100c9 admin admin] PATH_INFO: `/v3/users/4ff03a72bb144c77bad743bbb4dfd129` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:16.536027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561b3f6-6b49-4fdf-844c-585e509100c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff03a72bb144c77bad743bbb4dfd129)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:16.537921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c0b42-31e5-48cd-b49d-495f6619f6e5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:16.538054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561b3f6-6b49-4fdf-844c-585e509100c9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:16.544329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584237ea-2a1f-41bb-ab28-8a4199281193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:16.545947 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584237ea-2a1f-41bb-ab28-8a4199281193 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:16.546432 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584237ea-2a1f-41bb-ab28-8a4199281193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:16.546910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584237ea-2a1f-41bb-ab28-8a4199281193 admin admin] PATH_INFO: `/v3/projects/7341e4c7236a45a7bcfe211287f09941/users/7f888bd2c6094979b873bba4216f7006/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:16.550230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584237ea-2a1f-41bb-ab28-8a4199281193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7341e4c7236a45a7bcfe211287f09941, user_id=7f888bd2c6094979b873bba4216f7006, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:16.553665 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584237ea-2a1f-41bb-ab28-8a4199281193 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:16.587750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 915/1842] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:16 2022] PUT /identity/v3/projects/7341e4c7236a45a7bcfe211287f09941/users/7f888bd2c6094979b873bba4216f7006/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:16.599479 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2cc55-d8f7-438c-aea4-f150f7019516 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:16.599805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2cc55-d8f7-438c-aea4-f150f7019516 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:16.600117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2cc55-d8f7-438c-aea4-f150f7019516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:16.626473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6561b3f6-6b49-4fdf-844c-585e509100c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff03a72bb144c77bad743bbb4dfd129'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:16.642554 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6561b3f6-6b49-4fdf-844c-585e509100c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff03a72bb144c77bad743bbb4dfd129'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:16.644557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:16.655626 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6561b3f6-6b49-4fdf-844c-585e509100c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff03a72bb144c77bad743bbb4dfd129'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:16.656503 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6561b3f6-6b49-4fdf-844c-585e509100c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff03a72bb144c77bad743bbb4dfd129'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:16.659822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:16.667773 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-29d2cc55-d8f7-438c-aea4-f150f7019516 None None] MFA Rules not processed for user `7f888bd2c6094979b873bba4216f7006`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:16.669879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-29d2cc55-d8f7-438c-aea4-f150f7019516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:16.678322 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6561b3f6-6b49-4fdf-844c-585e509100c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff03a72bb144c77bad743bbb4dfd129'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:16.687187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 928/1843] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:16 2022] DELETE /identity/v3/users/4ff03a72bb144c77bad743bbb4dfd129 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:10:16.692502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb24aab-4add-401c-a0de-053874d6ef6a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:16.692912 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb24aab-4add-401c-a0de-053874d6ef6a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:16.693613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb24aab-4add-401c-a0de-053874d6ef6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:16.736812 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-cfb24aab-4add-401c-a0de-053874d6ef6a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:16.738204 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cfb24aab-4add-401c-a0de-053874d6ef6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:16.822725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 916/1844] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:16.836494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2cc55-d8f7-438c-aea4-f150f7019516 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:16.838188 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-29d2cc55-d8f7-438c-aea4-f150f7019516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:16.870549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 929/1845] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:16.885584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb24aab-4add-401c-a0de-053874d6ef6a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:16.887828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cfb24aab-4add-401c-a0de-053874d6ef6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:16.979898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb24aab-4add-401c-a0de-053874d6ef6a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:16.986998 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2cc55-d8f7-438c-aea4-f150f7019516 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:16.988837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22185bb0-2ce4-40c0-b2f8-de707faf18f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:16.990803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22185bb0-2ce4-40c0-b2f8-de707faf18f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:16.991519 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22185bb0-2ce4-40c0-b2f8-de707faf18f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:16.992007 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22185bb0-2ce4-40c0-b2f8-de707faf18f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:17.008176 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22185bb0-2ce4-40c0-b2f8-de707faf18f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:17.010039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22185bb0-2ce4-40c0-b2f8-de707faf18f1 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:17.025630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 930/1846] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:17.097615 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10213eb8-e7b7-485b-a75b-6346cec47403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:17.098356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10213eb8-e7b7-485b-a75b-6346cec47403 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:17.105906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10213eb8-e7b7-485b-a75b-6346cec47403 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:17.106263 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10213eb8-e7b7-485b-a75b-6346cec47403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:17.230655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10213eb8-e7b7-485b-a75b-6346cec47403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:17.232372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10213eb8-e7b7-485b-a75b-6346cec47403 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:17.250836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 917/1847] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:17.365847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22185bb0-2ce4-40c0-b2f8-de707faf18f1 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:17.382189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22185bb0-2ce4-40c0-b2f8-de707faf18f1 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:17.388691 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe990bd-02c7-4e93-86ad-d1b7ff5d8f23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:17.390266 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe990bd-02c7-4e93-86ad-d1b7ff5d8f23 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:17.390716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe990bd-02c7-4e93-86ad-d1b7ff5d8f23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:17.391728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe990bd-02c7-4e93-86ad-d1b7ff5d8f23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:17.394988 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3fe990bd-02c7-4e93-86ad-d1b7ff5d8f23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:17.480942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe990bd-02c7-4e93-86ad-d1b7ff5d8f23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:17.482374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe990bd-02c7-4e93-86ad-d1b7ff5d8f23 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:17.491905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 931/1848] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:17.801585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10213eb8-e7b7-485b-a75b-6346cec47403 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:17.803233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-10213eb8-e7b7-485b-a75b-6346cec47403 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:17.820816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:17.829885 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10213eb8-e7b7-485b-a75b-6346cec47403 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:17.841630 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbf50c-c325-4dcd-98a7-8f16f8b2c5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:17.842676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf50c-c325-4dcd-98a7-8f16f8b2c5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:17.842994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf50c-c325-4dcd-98a7-8f16f8b2c5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:17.843382 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf50c-c325-4dcd-98a7-8f16f8b2c5bc admin admin] PATH_INFO: `/v3/projects/57d9dd6b84384f5c9d7c2c35db5edf0b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:17.847846 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbf50c-c325-4dcd-98a7-8f16f8b2c5bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d9dd6b84384f5c9d7c2c35db5edf0b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:17.855444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbf50c-c325-4dcd-98a7-8f16f8b2c5bc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:17.930570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ecfbf50c-c325-4dcd-98a7-8f16f8b2c5bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d9dd6b84384f5c9d7c2c35db5edf0b', 'request_id': 'req-ecfbf50c-c325-4dcd-98a7-8f16f8b2c5bc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:17.940928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ecfbf50c-c325-4dcd-98a7-8f16f8b2c5bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d9dd6b84384f5c9d7c2c35db5edf0b', 'request_id': 'req-ecfbf50c-c325-4dcd-98a7-8f16f8b2c5bc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:17.948882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ecfbf50c-c325-4dcd-98a7-8f16f8b2c5bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d9dd6b84384f5c9d7c2c35db5edf0b', 'request_id': 'req-ecfbf50c-c325-4dcd-98a7-8f16f8b2c5bc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:17.964148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ecfbf50c-c325-4dcd-98a7-8f16f8b2c5bc admin admin] The token cache is being invalidate because project 57d9dd6b84384f5c9d7c2c35db5edf0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:17.964507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ecfbf50c-c325-4dcd-98a7-8f16f8b2c5bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:17.965302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ecfbf50c-c325-4dcd-98a7-8f16f8b2c5bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:17.971694 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 918/1849] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:17 2022] DELETE /identity/v3/projects/57d9dd6b84384f5c9d7c2c35db5edf0b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:17.973421 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11324445-2376-4f3f-bbd1-df088ae438a0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:17.973893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11324445-2376-4f3f-bbd1-df088ae438a0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:17.973982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11324445-2376-4f3f-bbd1-df088ae438a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:17.996229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-11324445-2376-4f3f-bbd1-df088ae438a0 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:17.997838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-11324445-2376-4f3f-bbd1-df088ae438a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:18.011858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:18.080901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 932/1850] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:18.088956 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49337cf-bfc5-472c-96f6-a9247f6329dd None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:18.089537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49337cf-bfc5-472c-96f6-a9247f6329dd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:18.089537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49337cf-bfc5-472c-96f6-a9247f6329dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:18.113111 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d49337cf-bfc5-472c-96f6-a9247f6329dd None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:18.114372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d49337cf-bfc5-472c-96f6-a9247f6329dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:18.129143 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 919/1851] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:18.130601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11324445-2376-4f3f-bbd1-df088ae438a0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:18.143622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11324445-2376-4f3f-bbd1-df088ae438a0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:18.167298 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38a11-7174-4377-8a38-914c3f8eb9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:18.168323 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38a11-7174-4377-8a38-914c3f8eb9af admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:18.168817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38a11-7174-4377-8a38-914c3f8eb9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:18.169225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38a11-7174-4377-8a38-914c3f8eb9af admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:18.170309 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c38a11-7174-4377-8a38-914c3f8eb9af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:18.170817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c38a11-7174-4377-8a38-914c3f8eb9af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:18.173627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c38a11-7174-4377-8a38-914c3f8eb9af admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:18.244452 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49337cf-bfc5-472c-96f6-a9247f6329dd None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:18.255254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 933/1852] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:10:18.257321 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49337cf-bfc5-472c-96f6-a9247f6329dd None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:18.286887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c98f29-5b6b-45ae-973a-afd42d7d3fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:18.292332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c98f29-5b6b-45ae-973a-afd42d7d3fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:18.292628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c98f29-5b6b-45ae-973a-afd42d7d3fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:18.292910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c98f29-5b6b-45ae-973a-afd42d7d3fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:18.293586 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c98f29-5b6b-45ae-973a-afd42d7d3fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:18.300698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c98f29-5b6b-45ae-973a-afd42d7d3fb9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:18.373245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 920/1853] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:18 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:18.377755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38a11-7174-4377-8a38-914c3f8eb9af admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:18.393685 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38a11-7174-4377-8a38-914c3f8eb9af admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:18.520343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d021cd-66fe-4e49-b749-984127074752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:18.522513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d021cd-66fe-4e49-b749-984127074752 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:18.523030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d021cd-66fe-4e49-b749-984127074752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:18.523501 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d021cd-66fe-4e49-b749-984127074752 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:18.541750 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d021cd-66fe-4e49-b749-984127074752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:18.541750 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d021cd-66fe-4e49-b749-984127074752 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:18.660134 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c98f29-5b6b-45ae-973a-afd42d7d3fb9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:18.665708 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 934/1854] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:18 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:18.672936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c98f29-5b6b-45ae-973a-afd42d7d3fb9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:18.690892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f142784-114b-4d8c-bd5c-d007507b38d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:18.691523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f142784-114b-4d8c-bd5c-d007507b38d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:18.691798 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f142784-114b-4d8c-bd5c-d007507b38d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:18.692097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f142784-114b-4d8c-bd5c-d007507b38d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:18.692754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f142784-114b-4d8c-bd5c-d007507b38d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:18.694388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f142784-114b-4d8c-bd5c-d007507b38d7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:18.729600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 921/1855] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:18.733844 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d021cd-66fe-4e49-b749-984127074752 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:18.747471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d021cd-66fe-4e49-b749-984127074752 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:18.765454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf2f25-f9bd-42fc-b24b-b26b6889a7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:18.766135 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2f25-f9bd-42fc-b24b-b26b6889a7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:18.766418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2f25-f9bd-42fc-b24b-b26b6889a7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:18.766753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2f25-f9bd-42fc-b24b-b26b6889a7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:18.767408 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf2f25-f9bd-42fc-b24b-b26b6889a7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:18.769078 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf2f25-f9bd-42fc-b24b-b26b6889a7d5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:18.816796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 935/1856] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:18.821182 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f142784-114b-4d8c-bd5c-d007507b38d7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:18.837969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f142784-114b-4d8c-bd5c-d007507b38d7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:18.845000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30408e5-1484-4b7a-ac33-b01fde3b2db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:18.845847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30408e5-1484-4b7a-ac33-b01fde3b2db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:18.846122 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30408e5-1484-4b7a-ac33-b01fde3b2db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:18.846385 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30408e5-1484-4b7a-ac33-b01fde3b2db0 admin admin] PATH_INFO: `/v3/projects/26b6820a1cef436e9d8edc09a17f7ed8/users/1d915ca4dc924613bd75c33ab6d69bcc/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:18.878429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30408e5-1484-4b7a-ac33-b01fde3b2db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b6820a1cef436e9d8edc09a17f7ed8, user_id=1d915ca4dc924613bd75c33ab6d69bcc, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:18.881413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30408e5-1484-4b7a-ac33-b01fde3b2db0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:18.912798 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 922/1857] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:18 2022] PUT /identity/v3/projects/26b6820a1cef436e9d8edc09a17f7ed8/users/1d915ca4dc924613bd75c33ab6d69bcc/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:18.929974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7407ab6-ee82-4f69-ae3d-1045366eff24 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:18.930257 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7407ab6-ee82-4f69-ae3d-1045366eff24 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:18.930531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7407ab6-ee82-4f69-ae3d-1045366eff24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:18.991535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d7407ab6-ee82-4f69-ae3d-1045366eff24 None None] MFA Rules not processed for user `1d915ca4dc924613bd75c33ab6d69bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:18.992872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d7407ab6-ee82-4f69-ae3d-1045366eff24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:19.151657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 936/1858] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:19.284654 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30408e5-1484-4b7a-ac33-b01fde3b2db0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:19.287110 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d30408e5-1484-4b7a-ac33-b01fde3b2db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:19.478730 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30408e5-1484-4b7a-ac33-b01fde3b2db0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:19.496014 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643873ba-465d-40b4-8d1c-92206977c85f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:19.496986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643873ba-465d-40b4-8d1c-92206977c85f service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:19.497270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643873ba-465d-40b4-8d1c-92206977c85f service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:19.498879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643873ba-465d-40b4-8d1c-92206977c85f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:19.537646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643873ba-465d-40b4-8d1c-92206977c85f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:19.539100 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643873ba-465d-40b4-8d1c-92206977c85f service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:19.589594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 923/1859] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:19.774328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7407ab6-ee82-4f69-ae3d-1045366eff24 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:19.776327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d7407ab6-ee82-4f69-ae3d-1045366eff24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:19.806798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:19.897698 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7407ab6-ee82-4f69-ae3d-1045366eff24 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:19.903919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00f259-7035-4678-a0b9-11fbbcd40d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:19.904812 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00f259-7035-4678-a0b9-11fbbcd40d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:19.905178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00f259-7035-4678-a0b9-11fbbcd40d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:19.905464 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00f259-7035-4678-a0b9-11fbbcd40d53 admin admin] PATH_INFO: `/v3/users/d4390ef194d74242b90f4584be7df637` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:19.907301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00f259-7035-4678-a0b9-11fbbcd40d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4390ef194d74242b90f4584be7df637)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:19.909310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00f259-7035-4678-a0b9-11fbbcd40d53 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:20.040467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b00f259-7035-4678-a0b9-11fbbcd40d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4390ef194d74242b90f4584be7df637'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:20.051439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b00f259-7035-4678-a0b9-11fbbcd40d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4390ef194d74242b90f4584be7df637'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:20.066663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b00f259-7035-4678-a0b9-11fbbcd40d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4390ef194d74242b90f4584be7df637'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:20.067723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b00f259-7035-4678-a0b9-11fbbcd40d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4390ef194d74242b90f4584be7df637'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:20.090604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b00f259-7035-4678-a0b9-11fbbcd40d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4390ef194d74242b90f4584be7df637'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:20.107611 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424c8e-5548-43e5-b51d-d5c0cd1c6475 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:20.108052 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424c8e-5548-43e5-b51d-d5c0cd1c6475 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:20.108533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424c8e-5548-43e5-b51d-d5c0cd1c6475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:20.114784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 937/1860] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:19 2022] DELETE /identity/v3/users/d4390ef194d74242b90f4584be7df637 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:20.119102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519c536-ccaa-475f-b64c-8acf6b9f2cb4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:20.119387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519c536-ccaa-475f-b64c-8acf6b9f2cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:20.129007 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519c536-ccaa-475f-b64c-8acf6b9f2cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:20.169073 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b519c536-ccaa-475f-b64c-8acf6b9f2cb4 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:20.171183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b519c536-ccaa-475f-b64c-8acf6b9f2cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:20.182314 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-88424c8e-5548-43e5-b51d-d5c0cd1c6475 None None] MFA Rules not processed for user `49b8dde87752484e8a5dacfb3a816adf`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:20.184007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-88424c8e-5548-43e5-b51d-d5c0cd1c6475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:20.206404 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:20.272109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 938/1861] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:20.279978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519c536-ccaa-475f-b64c-8acf6b9f2cb4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:20.281391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b519c536-ccaa-475f-b64c-8acf6b9f2cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:20.282498 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 924/1862] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:20.287567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88424c8e-5548-43e5-b51d-d5c0cd1c6475 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:20.289101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-88424c8e-5548-43e5-b51d-d5c0cd1c6475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:20.304904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88424c8e-5548-43e5-b51d-d5c0cd1c6475 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:20.310175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39a74d-851e-4293-b1b8-c01119a74b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:20.310802 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39a74d-851e-4293-b1b8-c01119a74b97 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:20.311082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39a74d-851e-4293-b1b8-c01119a74b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:20.311356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39a74d-851e-4293-b1b8-c01119a74b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:20.312031 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39a74d-851e-4293-b1b8-c01119a74b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:20.314171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39a74d-851e-4293-b1b8-c01119a74b97 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:20.335534 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:20.359670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 925/1863] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:20 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:20.362443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39a74d-851e-4293-b1b8-c01119a74b97 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:20.372761 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519c536-ccaa-475f-b64c-8acf6b9f2cb4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:20.445893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b23f41-6bc2-4af1-a3c9-3dcf5f07ad28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:20.446841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b23f41-6bc2-4af1-a3c9-3dcf5f07ad28 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:20.447435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b23f41-6bc2-4af1-a3c9-3dcf5f07ad28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:20.448037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b23f41-6bc2-4af1-a3c9-3dcf5f07ad28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:20.459723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39a74d-851e-4293-b1b8-c01119a74b97 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:20.469803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91ef19-d5db-43d5-9603-ec84d18be948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:20.470806 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91ef19-d5db-43d5-9603-ec84d18be948 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:20.471248 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91ef19-d5db-43d5-9603-ec84d18be948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:20.471537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91ef19-d5db-43d5-9603-ec84d18be948 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:20.472212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91ef19-d5db-43d5-9603-ec84d18be948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:20.475208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91ef19-d5db-43d5-9603-ec84d18be948 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:20.500733 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 926/1864] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:20 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:20.504682 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91ef19-d5db-43d5-9603-ec84d18be948 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:20.514512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91ef19-d5db-43d5-9603-ec84d18be948 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:20.519929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954ab2f-afb9-4df6-909a-5dd5abbca2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:20.522271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954ab2f-afb9-4df6-909a-5dd5abbca2db admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:20.522558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954ab2f-afb9-4df6-909a-5dd5abbca2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:20.523401 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954ab2f-afb9-4df6-909a-5dd5abbca2db admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:20.524097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954ab2f-afb9-4df6-909a-5dd5abbca2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:20.525166 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b23f41-6bc2-4af1-a3c9-3dcf5f07ad28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:20.525695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954ab2f-afb9-4df6-909a-5dd5abbca2db admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:20.526907 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b23f41-6bc2-4af1-a3c9-3dcf5f07ad28 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:20.536624 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 927/1865] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:20.538100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 939/1866] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:20.540716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954ab2f-afb9-4df6-909a-5dd5abbca2db admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:20.551490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954ab2f-afb9-4df6-909a-5dd5abbca2db admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:20.556843 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615adad-f784-45ad-a9f1-7e8efb5e54aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:20.557591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615adad-f784-45ad-a9f1-7e8efb5e54aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:20.557895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615adad-f784-45ad-a9f1-7e8efb5e54aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:20.558224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615adad-f784-45ad-a9f1-7e8efb5e54aa admin admin] PATH_INFO: `/v3/projects/f45ca3dfc2174dd98aed3ba49285e5f3/users/feeb77a36efc4a0b86b675518302e7a3/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:20.577871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615adad-f784-45ad-a9f1-7e8efb5e54aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45ca3dfc2174dd98aed3ba49285e5f3, user_id=feeb77a36efc4a0b86b675518302e7a3, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:20.581022 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615adad-f784-45ad-a9f1-7e8efb5e54aa admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:20.597686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 928/1867] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:20 2022] PUT /identity/v3/projects/f45ca3dfc2174dd98aed3ba49285e5f3/users/feeb77a36efc4a0b86b675518302e7a3/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:10:20.602408 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b23f41-6bc2-4af1-a3c9-3dcf5f07ad28 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:20.620594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b23f41-6bc2-4af1-a3c9-3dcf5f07ad28 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:20.710683 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8422192-7d92-4475-8164-6419cbc05814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:20.711513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8422192-7d92-4475-8164-6419cbc05814 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:20.711907 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8422192-7d92-4475-8164-6419cbc05814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:20.712305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8422192-7d92-4475-8164-6419cbc05814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:20.713159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8422192-7d92-4475-8164-6419cbc05814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:20.714984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8422192-7d92-4475-8164-6419cbc05814 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:20.729336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 940/1868] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:20.733405 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615adad-f784-45ad-a9f1-7e8efb5e54aa admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:20.750734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615adad-f784-45ad-a9f1-7e8efb5e54aa admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:20.757520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ff248-bef1-4822-93ae-9b707d39c044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:20.758558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ff248-bef1-4822-93ae-9b707d39c044 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:20.758933 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ff248-bef1-4822-93ae-9b707d39c044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:20.759296 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ff248-bef1-4822-93ae-9b707d39c044 admin admin] PATH_INFO: `/v3/projects/f45ca3dfc2174dd98aed3ba49285e5f3/users/feeb77a36efc4a0b86b675518302e7a3/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:20.764762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ff248-bef1-4822-93ae-9b707d39c044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45ca3dfc2174dd98aed3ba49285e5f3, user_id=feeb77a36efc4a0b86b675518302e7a3, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:20.768414 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ff248-bef1-4822-93ae-9b707d39c044 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:20.786050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 929/1869] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:20 2022] PUT /identity/v3/projects/f45ca3dfc2174dd98aed3ba49285e5f3/users/feeb77a36efc4a0b86b675518302e7a3/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:20.908672 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8422192-7d92-4475-8164-6419cbc05814 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:20.912480 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d8422192-7d92-4475-8164-6419cbc05814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:20.952987 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8422192-7d92-4475-8164-6419cbc05814 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:20.996573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:21.045335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0f682-ad9a-4ddf-8ecb-0ab561b80507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:21.046052 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0f682-ad9a-4ddf-8ecb-0ab561b80507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:21.046266 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0f682-ad9a-4ddf-8ecb-0ab561b80507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:21.046481 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0f682-ad9a-4ddf-8ecb-0ab561b80507 admin admin] PATH_INFO: `/v3/projects/a741d407c2a54e059f5cf8072f65d1ec` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:21.047655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0f682-ad9a-4ddf-8ecb-0ab561b80507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a741d407c2a54e059f5cf8072f65d1ec)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:21.049660 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0f682-ad9a-4ddf-8ecb-0ab561b80507 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:21.109382 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b7e0f682-ad9a-4ddf-8ecb-0ab561b80507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a741d407c2a54e059f5cf8072f65d1ec', 'request_id': 'req-b7e0f682-ad9a-4ddf-8ecb-0ab561b80507'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:21.117004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b7e0f682-ad9a-4ddf-8ecb-0ab561b80507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a741d407c2a54e059f5cf8072f65d1ec', 'request_id': 'req-b7e0f682-ad9a-4ddf-8ecb-0ab561b80507'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:21.125810 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b7e0f682-ad9a-4ddf-8ecb-0ab561b80507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a741d407c2a54e059f5cf8072f65d1ec', 'request_id': 'req-b7e0f682-ad9a-4ddf-8ecb-0ab561b80507'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:21.140393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b7e0f682-ad9a-4ddf-8ecb-0ab561b80507 admin admin] The token cache is being invalidate because project a741d407c2a54e059f5cf8072f65d1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:21.140770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b7e0f682-ad9a-4ddf-8ecb-0ab561b80507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:21.142141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b7e0f682-ad9a-4ddf-8ecb-0ab561b80507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:21.143748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 941/1870] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:20 2022] DELETE /identity/v3/projects/a741d407c2a54e059f5cf8072f65d1ec => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:21.147711 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ff248-bef1-4822-93ae-9b707d39c044 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:21.151135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ab1ff248-bef1-4822-93ae-9b707d39c044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:21.165064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ff248-bef1-4822-93ae-9b707d39c044 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:21.210731 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:21.257864 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3291f-9063-4f46-878d-abb086462c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:21.258662 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3291f-9063-4f46-878d-abb086462c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:21.259185 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3291f-9063-4f46-878d-abb086462c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:21.259490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3291f-9063-4f46-878d-abb086462c37 admin admin] PATH_INFO: `/v3/users/fbb545e6abdc40b89016b192170bce81` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:21.269575 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3291f-9063-4f46-878d-abb086462c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb545e6abdc40b89016b192170bce81)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:21.272191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3291f-9063-4f46-878d-abb086462c37 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:21.357372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2ce3291f-9063-4f46-878d-abb086462c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb545e6abdc40b89016b192170bce81'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:21.390162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2ce3291f-9063-4f46-878d-abb086462c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb545e6abdc40b89016b192170bce81'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:21.412610 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2ce3291f-9063-4f46-878d-abb086462c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb545e6abdc40b89016b192170bce81'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:21.414383 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2ce3291f-9063-4f46-878d-abb086462c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb545e6abdc40b89016b192170bce81'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:21.416059 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2ce3291f-9063-4f46-878d-abb086462c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb545e6abdc40b89016b192170bce81'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:21.452869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 930/1871] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:21 2022] DELETE /identity/v3/users/fbb545e6abdc40b89016b192170bce81 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:22.207066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b81548-8032-44ba-a120-6ed53eeb2340 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:22.207498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b81548-8032-44ba-a120-6ed53eeb2340 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:22.207498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b81548-8032-44ba-a120-6ed53eeb2340 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:22.209198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 942/1872] 10.222.0.48 () {54 vars in 921 bytes} [Tue Aug 30 05:10:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:10:22.232132 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21f99c-44fa-47b0-9951-d35939985e66 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:22.232457 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21f99c-44fa-47b0-9951-d35939985e66 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:22.233065 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21f99c-44fa-47b0-9951-d35939985e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:22.265915 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2a21f99c-44fa-47b0-9951-d35939985e66 None None] MFA Rules not processed for user `1aa002909502426b80c97dbf05dca008`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:22.269243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2a21f99c-44fa-47b0-9951-d35939985e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:22.428362 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae0e93-b247-4bdd-8997-69459dd66c4f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:22.428909 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae0e93-b247-4bdd-8997-69459dd66c4f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:22.429314 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae0e93-b247-4bdd-8997-69459dd66c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:22.482874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 931/1873] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Aug 30 05:10:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:22.496731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-cdae0e93-b247-4bdd-8997-69459dd66c4f None None] MFA Rules not processed for user `feeb77a36efc4a0b86b675518302e7a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:22.497818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cdae0e93-b247-4bdd-8997-69459dd66c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:22.670027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 943/1874] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:22.681891 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262307fc-42ad-434a-b041-ea1fa526f544 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:22.682581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262307fc-42ad-434a-b041-ea1fa526f544 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:22.683130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262307fc-42ad-434a-b041-ea1fa526f544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:22.718523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-262307fc-42ad-434a-b041-ea1fa526f544 None None] MFA Rules not processed for user `49b8dde87752484e8a5dacfb3a816adf`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:22.725533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-262307fc-42ad-434a-b041-ea1fa526f544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:22.772415 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae0e93-b247-4bdd-8997-69459dd66c4f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:22.774128 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cdae0e93-b247-4bdd-8997-69459dd66c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:22.808259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae0e93-b247-4bdd-8997-69459dd66c4f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:22.834305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af12e1-7476-4425-81dc-ce2332a6d653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:22.838941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af12e1-7476-4425-81dc-ce2332a6d653 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:22.840329 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af12e1-7476-4425-81dc-ce2332a6d653 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:22.840690 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af12e1-7476-4425-81dc-ce2332a6d653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:22.846693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:22.878860 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af12e1-7476-4425-81dc-ce2332a6d653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:22.889228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af12e1-7476-4425-81dc-ce2332a6d653 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:22.913264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 932/1875] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:22.940761 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 944/1876] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:23.070585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262307fc-42ad-434a-b041-ea1fa526f544 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:23.073363 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-262307fc-42ad-434a-b041-ea1fa526f544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:23.219721 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af12e1-7476-4425-81dc-ce2332a6d653 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:23.222079 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-64af12e1-7476-4425-81dc-ce2332a6d653 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:23.223788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262307fc-42ad-434a-b041-ea1fa526f544 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:23.230371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1d533-38d7-4923-b0a4-70da37f598ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:23.231905 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1d533-38d7-4923-b0a4-70da37f598ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:23.232365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1d533-38d7-4923-b0a4-70da37f598ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:23.232676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1d533-38d7-4923-b0a4-70da37f598ff admin admin] PATH_INFO: `/v3/projects/559ef12736d040c7ad221b3ecc1da735` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:23.234350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1d533-38d7-4923-b0a4-70da37f598ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=559ef12736d040c7ad221b3ecc1da735)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:23.237680 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1d533-38d7-4923-b0a4-70da37f598ff admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:23.293361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af12e1-7476-4425-81dc-ce2332a6d653 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:23.315298 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b21368-48cd-4ea4-9caa-a15ac6317918 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:23.324785 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b21368-48cd-4ea4-9caa-a15ac6317918 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:23.325722 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b21368-48cd-4ea4-9caa-a15ac6317918 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:23.327830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b21368-48cd-4ea4-9caa-a15ac6317918 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:23.343975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-75b21368-48cd-4ea4-9caa-a15ac6317918 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:23.371045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9fb1d533-38d7-4923-b0a4-70da37f598ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559ef12736d040c7ad221b3ecc1da735', 'request_id': 'req-9fb1d533-38d7-4923-b0a4-70da37f598ff'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:23.373786 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b21368-48cd-4ea4-9caa-a15ac6317918 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:23.376251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b21368-48cd-4ea4-9caa-a15ac6317918 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:23.392488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9fb1d533-38d7-4923-b0a4-70da37f598ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559ef12736d040c7ad221b3ecc1da735', 'request_id': 'req-9fb1d533-38d7-4923-b0a4-70da37f598ff'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:23.398808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 945/1877] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:23.407316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9fb1d533-38d7-4923-b0a4-70da37f598ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559ef12736d040c7ad221b3ecc1da735', 'request_id': 'req-9fb1d533-38d7-4923-b0a4-70da37f598ff'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:23.426601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9fb1d533-38d7-4923-b0a4-70da37f598ff admin admin] The token cache is being invalidate because project 559ef12736d040c7ad221b3ecc1da735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:23.426896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9fb1d533-38d7-4923-b0a4-70da37f598ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:23.427611 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9fb1d533-38d7-4923-b0a4-70da37f598ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:23.432447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 933/1878] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:23 2022] DELETE /identity/v3/projects/559ef12736d040c7ad221b3ecc1da735 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:23.434295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dc7fe-63fb-4eed-b8b2-0498543b539e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:23.434606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dc7fe-63fb-4eed-b8b2-0498543b539e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:23.434874 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dc7fe-63fb-4eed-b8b2-0498543b539e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:23.463575 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2d3dc7fe-63fb-4eed-b8b2-0498543b539e None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:23.464977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2d3dc7fe-63fb-4eed-b8b2-0498543b539e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:23.516825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:23.606558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 946/1879] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:23.617059 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c046c-cdf8-419f-a30c-b3dcf4cc4a77 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:23.617605 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c046c-cdf8-419f-a30c-b3dcf4cc4a77 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:23.618884 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c046c-cdf8-419f-a30c-b3dcf4cc4a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:23.652437 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ee2c046c-cdf8-419f-a30c-b3dcf4cc4a77 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:23.654064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ee2c046c-cdf8-419f-a30c-b3dcf4cc4a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:23.668895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 934/1880] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:23.671366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dc7fe-63fb-4eed-b8b2-0498543b539e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:23.685414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dc7fe-63fb-4eed-b8b2-0498543b539e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:23.692549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ee92e-5e06-4de8-a547-e10bd413c59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:23.693559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ee92e-5e06-4de8-a547-e10bd413c59e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:23.693986 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ee92e-5e06-4de8-a547-e10bd413c59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:23.694581 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ee92e-5e06-4de8-a547-e10bd413c59e admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:23.695379 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ee92e-5e06-4de8-a547-e10bd413c59e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:23.695823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ee92e-5e06-4de8-a547-e10bd413c59e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:23.698237 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ee92e-5e06-4de8-a547-e10bd413c59e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:23.714014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 947/1881] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:23.724440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c046c-cdf8-419f-a30c-b3dcf4cc4a77 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:23.738603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c046c-cdf8-419f-a30c-b3dcf4cc4a77 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:23.743817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25ee3e-c374-453a-ad3b-75270322055e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:23.744529 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25ee3e-c374-453a-ad3b-75270322055e admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:23.744880 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25ee3e-c374-453a-ad3b-75270322055e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:23.745220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25ee3e-c374-453a-ad3b-75270322055e admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:23.745927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25ee3e-c374-453a-ad3b-75270322055e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:23.750141 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25ee3e-c374-453a-ad3b-75270322055e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:23.792315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 935/1882] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:23 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:23.795922 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ee92e-5e06-4de8-a547-e10bd413c59e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:23.809496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ee92e-5e06-4de8-a547-e10bd413c59e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:23.877664 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d45cf-36bd-4164-9871-0621291bcd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:23.878150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d45cf-36bd-4164-9871-0621291bcd16 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:23.878423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d45cf-36bd-4164-9871-0621291bcd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:23.878689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d45cf-36bd-4164-9871-0621291bcd16 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:23.879353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d45cf-36bd-4164-9871-0621291bcd16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:23.881626 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d45cf-36bd-4164-9871-0621291bcd16 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:23.912871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 948/1883] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:23 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:23.918769 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25ee3e-c374-453a-ad3b-75270322055e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:23.929765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25ee3e-c374-453a-ad3b-75270322055e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:23.934482 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29da6b7-33b7-4f2f-878d-e1c8d9be5667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:23.935169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29da6b7-33b7-4f2f-878d-e1c8d9be5667 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:23.935518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29da6b7-33b7-4f2f-878d-e1c8d9be5667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:23.935861 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29da6b7-33b7-4f2f-878d-e1c8d9be5667 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:23.936707 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29da6b7-33b7-4f2f-878d-e1c8d9be5667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:23.938451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29da6b7-33b7-4f2f-878d-e1c8d9be5667 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:23.952410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 936/1884] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:23.954546 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d45cf-36bd-4164-9871-0621291bcd16 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:23.965868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d45cf-36bd-4164-9871-0621291bcd16 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:23.971645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8ca71-47d2-43a9-bf92-372335e112f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:23.972233 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8ca71-47d2-43a9-bf92-372335e112f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:23.972506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8ca71-47d2-43a9-bf92-372335e112f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:23.972773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8ca71-47d2-43a9-bf92-372335e112f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:23.973409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8ca71-47d2-43a9-bf92-372335e112f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:23.974987 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8ca71-47d2-43a9-bf92-372335e112f1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:23.986940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 949/1885] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:23.992848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29da6b7-33b7-4f2f-878d-e1c8d9be5667 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:24.004955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29da6b7-33b7-4f2f-878d-e1c8d9be5667 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:24.011451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87b383-bfda-4156-aa52-d9cac25fb1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:24.011908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87b383-bfda-4156-aa52-d9cac25fb1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:24.012339 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87b383-bfda-4156-aa52-d9cac25fb1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:24.012627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87b383-bfda-4156-aa52-d9cac25fb1f4 admin admin] PATH_INFO: `/v3/projects/7fbb45c252f74eed964a73de45e2e73f/users/625af16c4f704214a35591d658806525/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:24.034198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87b383-bfda-4156-aa52-d9cac25fb1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fbb45c252f74eed964a73de45e2e73f, user_id=625af16c4f704214a35591d658806525, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:24.036956 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87b383-bfda-4156-aa52-d9cac25fb1f4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:24.056007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 937/1886] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:23 2022] PUT /identity/v3/projects/7fbb45c252f74eed964a73de45e2e73f/users/625af16c4f704214a35591d658806525/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:24.064351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ea66-055d-4eb4-a529-f75aff808f7c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:24.065150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ea66-055d-4eb4-a529-f75aff808f7c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:24.066310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ea66-055d-4eb4-a529-f75aff808f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:24.110073 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6899ea66-055d-4eb4-a529-f75aff808f7c None None] MFA Rules not processed for user `625af16c4f704214a35591d658806525`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:24.113334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6899ea66-055d-4eb4-a529-f75aff808f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:24.246256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87b383-bfda-4156-aa52-d9cac25fb1f4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:24.249320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 950/1887] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:24.277875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:24.361929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87b383-bfda-4156-aa52-d9cac25fb1f4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:24.367883 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e47b9-5a76-4b83-8f94-e7b122c18593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:24.368732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e47b9-5a76-4b83-8f94-e7b122c18593 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:24.369246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e47b9-5a76-4b83-8f94-e7b122c18593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:24.369642 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e47b9-5a76-4b83-8f94-e7b122c18593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:24.370359 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e47b9-5a76-4b83-8f94-e7b122c18593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:24.372844 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e47b9-5a76-4b83-8f94-e7b122c18593 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:24.430962 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 938/1888] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:24 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:24.434988 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ea66-055d-4eb4-a529-f75aff808f7c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:24.448677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ea66-055d-4eb4-a529-f75aff808f7c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:24.474587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:24.571809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f8b06-fd78-4e6c-9b7c-1429fe05ff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:24.572926 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f8b06-fd78-4e6c-9b7c-1429fe05ff40 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:24.573212 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f8b06-fd78-4e6c-9b7c-1429fe05ff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:24.573582 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f8b06-fd78-4e6c-9b7c-1429fe05ff40 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:24.574243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f8b06-fd78-4e6c-9b7c-1429fe05ff40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:24.579696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f8b06-fd78-4e6c-9b7c-1429fe05ff40 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:24.637176 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 951/1889] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:24 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:24.657474 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e47b9-5a76-4b83-8f94-e7b122c18593 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:24.677183 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e47b9-5a76-4b83-8f94-e7b122c18593 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:24.683443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58eb19-e684-49ca-a58e-a258a36a194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:24.686259 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58eb19-e684-49ca-a58e-a258a36a194c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:24.686708 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58eb19-e684-49ca-a58e-a258a36a194c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:24.687204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58eb19-e684-49ca-a58e-a258a36a194c admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:24.688855 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58eb19-e684-49ca-a58e-a258a36a194c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:24.691041 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58eb19-e684-49ca-a58e-a258a36a194c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:24.712078 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 939/1890] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:24.713044 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f8b06-fd78-4e6c-9b7c-1429fe05ff40 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:24.738349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f8b06-fd78-4e6c-9b7c-1429fe05ff40 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:24.752614 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b639eed-7f88-4712-a5cb-0149320b5d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:24.753907 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b639eed-7f88-4712-a5cb-0149320b5d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:24.754248 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b639eed-7f88-4712-a5cb-0149320b5d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:24.754561 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b639eed-7f88-4712-a5cb-0149320b5d7f admin admin] PATH_INFO: `/v3/projects/97423a05573c41f58abcc1adee847b44/users/175ffb9a13b14b09ab93214db6ca356c/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:24.803360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b639eed-7f88-4712-a5cb-0149320b5d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=97423a05573c41f58abcc1adee847b44, user_id=175ffb9a13b14b09ab93214db6ca356c, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:24.807552 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b639eed-7f88-4712-a5cb-0149320b5d7f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:24.838700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 952/1891] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:24 2022] PUT /identity/v3/projects/97423a05573c41f58abcc1adee847b44/users/175ffb9a13b14b09ab93214db6ca356c/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:24.843018 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58eb19-e684-49ca-a58e-a258a36a194c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:24.860461 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58eb19-e684-49ca-a58e-a258a36a194c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:25.035660 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b639eed-7f88-4712-a5cb-0149320b5d7f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:25.038107 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3b639eed-7f88-4712-a5cb-0149320b5d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:25.100605 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65f15d-d856-46d3-8a61-d9db91fb636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:25.102206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65f15d-d856-46d3-8a61-d9db91fb636a admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:25.102206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65f15d-d856-46d3-8a61-d9db91fb636a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:25.102206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65f15d-d856-46d3-8a61-d9db91fb636a admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:25.103093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65f15d-d856-46d3-8a61-d9db91fb636a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:25.104859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65f15d-d856-46d3-8a61-d9db91fb636a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:25.130049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 940/1892] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:25.135393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65f15d-d856-46d3-8a61-d9db91fb636a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:25.153070 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b639eed-7f88-4712-a5cb-0149320b5d7f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:25.159873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e5cd6-ad55-4a98-bcc2-508e374d855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:25.160726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e5cd6-ad55-4a98-bcc2-508e374d855d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:25.161010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e5cd6-ad55-4a98-bcc2-508e374d855d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:25.161334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e5cd6-ad55-4a98-bcc2-508e374d855d admin admin] PATH_INFO: `/v3/users/83600379407342fd9cff78b353e2a369` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:25.162664 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e5cd6-ad55-4a98-bcc2-508e374d855d admin admin] RBAC: Authorizing `identity:delete_user(user_id=83600379407342fd9cff78b353e2a369)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:25.165754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e5cd6-ad55-4a98-bcc2-508e374d855d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:25.204036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65f15d-d856-46d3-8a61-d9db91fb636a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:25.229377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b69a0f-7ae1-4d19-b842-48fd154f92df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:25.232718 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b69a0f-7ae1-4d19-b842-48fd154f92df admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:25.233221 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b69a0f-7ae1-4d19-b842-48fd154f92df admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:25.233704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b69a0f-7ae1-4d19-b842-48fd154f92df admin admin] PATH_INFO: `/v3/projects/97423a05573c41f58abcc1adee847b44/users/175ffb9a13b14b09ab93214db6ca356c/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:25.246413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b69a0f-7ae1-4d19-b842-48fd154f92df admin admin] RBAC: Authorizing `identity:create_grant(project_id=97423a05573c41f58abcc1adee847b44, user_id=175ffb9a13b14b09ab93214db6ca356c, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:25.251375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f41e5cd6-ad55-4a98-bcc2-508e374d855d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83600379407342fd9cff78b353e2a369'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:25.254098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b69a0f-7ae1-4d19-b842-48fd154f92df admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:25.271564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f41e5cd6-ad55-4a98-bcc2-508e374d855d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83600379407342fd9cff78b353e2a369'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:25.289503 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f41e5cd6-ad55-4a98-bcc2-508e374d855d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83600379407342fd9cff78b353e2a369'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:25.290439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f41e5cd6-ad55-4a98-bcc2-508e374d855d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83600379407342fd9cff78b353e2a369'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:25.302846 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 941/1893] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:25 2022] PUT /identity/v3/projects/97423a05573c41f58abcc1adee847b44/users/175ffb9a13b14b09ab93214db6ca356c/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:10:25.316435 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01592300-46c3-42aa-b383-6856f7fbb7a2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:25.317162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01592300-46c3-42aa-b383-6856f7fbb7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:25.317792 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01592300-46c3-42aa-b383-6856f7fbb7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:25.324926 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f41e5cd6-ad55-4a98-bcc2-508e374d855d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83600379407342fd9cff78b353e2a369'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:25.336850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 953/1894] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:25 2022] DELETE /identity/v3/users/83600379407342fd9cff78b353e2a369 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:25.338609 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9951f7-0135-4331-8103-e65f95d3121e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:25.338971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9951f7-0135-4331-8103-e65f95d3121e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:25.339661 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9951f7-0135-4331-8103-e65f95d3121e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:25.350149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:25.399268 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8d9951f7-0135-4331-8103-e65f95d3121e None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:25.402537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8d9951f7-0135-4331-8103-e65f95d3121e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:25.448646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-01592300-46c3-42aa-b383-6856f7fbb7a2 None None] MFA Rules not processed for user `175ffb9a13b14b09ab93214db6ca356c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:25.450665 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-01592300-46c3-42aa-b383-6856f7fbb7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:25.557722 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 954/1895] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:25.573297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9951f7-0135-4331-8103-e65f95d3121e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:25.576390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8d9951f7-0135-4331-8103-e65f95d3121e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:25.676004 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:25.682786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 942/1896] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:25.695593 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01592300-46c3-42aa-b383-6856f7fbb7a2 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:25.697533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-01592300-46c3-42aa-b383-6856f7fbb7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:25.727708 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9951f7-0135-4331-8103-e65f95d3121e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:25.732973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365157c2-bb52-418a-b4bd-977da72d4e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:25.734009 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365157c2-bb52-418a-b4bd-977da72d4e33 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:25.734752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365157c2-bb52-418a-b4bd-977da72d4e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:25.735215 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365157c2-bb52-418a-b4bd-977da72d4e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:25.772811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365157c2-bb52-418a-b4bd-977da72d4e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:25.774630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365157c2-bb52-418a-b4bd-977da72d4e33 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:25.789336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 955/1897] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:25.832355 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01592300-46c3-42aa-b383-6856f7fbb7a2 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:25.840355 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029fab4-787b-4890-8ca2-03b04de94d30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:25.842198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029fab4-787b-4890-8ca2-03b04de94d30 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:25.843428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029fab4-787b-4890-8ca2-03b04de94d30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:25.843895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029fab4-787b-4890-8ca2-03b04de94d30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:25.850675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b029fab4-787b-4890-8ca2-03b04de94d30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:26.050150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029fab4-787b-4890-8ca2-03b04de94d30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:26.052136 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029fab4-787b-4890-8ca2-03b04de94d30 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:26.086875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 943/1898] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:26.540800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365157c2-bb52-418a-b4bd-977da72d4e33 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:26.542331 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-365157c2-bb52-418a-b4bd-977da72d4e33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:26.560853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365157c2-bb52-418a-b4bd-977da72d4e33 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:26.566349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4678a08-51ac-45be-ad46-bc05a5b77622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:26.567230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4678a08-51ac-45be-ad46-bc05a5b77622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:26.567657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4678a08-51ac-45be-ad46-bc05a5b77622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:26.568320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4678a08-51ac-45be-ad46-bc05a5b77622 admin admin] PATH_INFO: `/v3/projects/0bad44aa6c7a4289ab734c0383d26943` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:26.569609 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4678a08-51ac-45be-ad46-bc05a5b77622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bad44aa6c7a4289ab734c0383d26943)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:26.571558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4678a08-51ac-45be-ad46-bc05a5b77622 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:26.632313 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e4678a08-51ac-45be-ad46-bc05a5b77622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bad44aa6c7a4289ab734c0383d26943', 'request_id': 'req-e4678a08-51ac-45be-ad46-bc05a5b77622'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:26.640731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e4678a08-51ac-45be-ad46-bc05a5b77622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bad44aa6c7a4289ab734c0383d26943', 'request_id': 'req-e4678a08-51ac-45be-ad46-bc05a5b77622'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:26.649909 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e4678a08-51ac-45be-ad46-bc05a5b77622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bad44aa6c7a4289ab734c0383d26943', 'request_id': 'req-e4678a08-51ac-45be-ad46-bc05a5b77622'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:26.663926 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e4678a08-51ac-45be-ad46-bc05a5b77622 admin admin] The token cache is being invalidate because project 0bad44aa6c7a4289ab734c0383d26943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:26.664445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e4678a08-51ac-45be-ad46-bc05a5b77622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:26.665445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e4678a08-51ac-45be-ad46-bc05a5b77622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:26.667645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 956/1899] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:26 2022] DELETE /identity/v3/projects/0bad44aa6c7a4289ab734c0383d26943 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:26.677440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029fab4-787b-4890-8ca2-03b04de94d30 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:26.689525 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029fab4-787b-4890-8ca2-03b04de94d30 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:26.765777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07995d1-b495-4524-b7a0-438cd203228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:26.766575 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07995d1-b495-4524-b7a0-438cd203228e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:26.766942 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07995d1-b495-4524-b7a0-438cd203228e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:26.767358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07995d1-b495-4524-b7a0-438cd203228e admin admin] PATH_INFO: `/v3/users/7f888bd2c6094979b873bba4216f7006` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:26.776446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07995d1-b495-4524-b7a0-438cd203228e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f888bd2c6094979b873bba4216f7006)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:26.779380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07995d1-b495-4524-b7a0-438cd203228e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:26.856503 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c07995d1-b495-4524-b7a0-438cd203228e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f888bd2c6094979b873bba4216f7006'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:26.866719 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:26.873132 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c07995d1-b495-4524-b7a0-438cd203228e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f888bd2c6094979b873bba4216f7006'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:26.883619 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c07995d1-b495-4524-b7a0-438cd203228e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f888bd2c6094979b873bba4216f7006'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:26.884597 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c07995d1-b495-4524-b7a0-438cd203228e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f888bd2c6094979b873bba4216f7006'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:26.885398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c07995d1-b495-4524-b7a0-438cd203228e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f888bd2c6094979b873bba4216f7006'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:26.901898 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 944/1900] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:26 2022] DELETE /identity/v3/users/7f888bd2c6094979b873bba4216f7006 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:27.198296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4678a08-51ac-45be-ad46-bc05a5b77622 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:27.199758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e4678a08-51ac-45be-ad46-bc05a5b77622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:27.219845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4678a08-51ac-45be-ad46-bc05a5b77622 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:27.253038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:27.298527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9d3c7-74d7-4102-a8d0-202ac6cbc0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:27.298527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9d3c7-74d7-4102-a8d0-202ac6cbc0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:27.298527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9d3c7-74d7-4102-a8d0-202ac6cbc0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:27.298993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9d3c7-74d7-4102-a8d0-202ac6cbc0ef admin admin] PATH_INFO: `/v3/projects/7341e4c7236a45a7bcfe211287f09941` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:27.300066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9d3c7-74d7-4102-a8d0-202ac6cbc0ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7341e4c7236a45a7bcfe211287f09941)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:27.302000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9d3c7-74d7-4102-a8d0-202ac6cbc0ef admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:27.355207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b2d9d3c7-74d7-4102-a8d0-202ac6cbc0ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7341e4c7236a45a7bcfe211287f09941', 'request_id': 'req-b2d9d3c7-74d7-4102-a8d0-202ac6cbc0ef'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:27.360993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b2d9d3c7-74d7-4102-a8d0-202ac6cbc0ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7341e4c7236a45a7bcfe211287f09941', 'request_id': 'req-b2d9d3c7-74d7-4102-a8d0-202ac6cbc0ef'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:27.368720 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b2d9d3c7-74d7-4102-a8d0-202ac6cbc0ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7341e4c7236a45a7bcfe211287f09941', 'request_id': 'req-b2d9d3c7-74d7-4102-a8d0-202ac6cbc0ef'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:27.380848 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b2d9d3c7-74d7-4102-a8d0-202ac6cbc0ef admin admin] The token cache is being invalidate because project 7341e4c7236a45a7bcfe211287f09941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:27.381383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b2d9d3c7-74d7-4102-a8d0-202ac6cbc0ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:27.382037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b2d9d3c7-74d7-4102-a8d0-202ac6cbc0ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:27.383545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 957/1901] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:27 2022] DELETE /identity/v3/projects/7341e4c7236a45a7bcfe211287f09941 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:10:27.388862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b730e7-3f8e-4e7f-8eed-5fb17b33ac83 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:27.389204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b730e7-3f8e-4e7f-8eed-5fb17b33ac83 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:27.389544 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b730e7-3f8e-4e7f-8eed-5fb17b33ac83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:27.412854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-36b730e7-3f8e-4e7f-8eed-5fb17b33ac83 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:27.413907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-36b730e7-3f8e-4e7f-8eed-5fb17b33ac83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:27.491820 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 945/1902] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:27.500636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62a583-f5ec-4987-b8e9-7a38b7b06614 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:27.500973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62a583-f5ec-4987-b8e9-7a38b7b06614 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:27.501297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62a583-f5ec-4987-b8e9-7a38b7b06614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:27.524053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2b62a583-f5ec-4987-b8e9-7a38b7b06614 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:27.525310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2b62a583-f5ec-4987-b8e9-7a38b7b06614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:27.536762 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 958/1903] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:27.540983 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b730e7-3f8e-4e7f-8eed-5fb17b33ac83 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:27.553434 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b730e7-3f8e-4e7f-8eed-5fb17b33ac83 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:27.558764 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3c645-cfcb-4d60-823d-9569456633cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:27.559679 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3c645-cfcb-4d60-823d-9569456633cb admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:27.560054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3c645-cfcb-4d60-823d-9569456633cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:27.560458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3c645-cfcb-4d60-823d-9569456633cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:27.561181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3c645-cfcb-4d60-823d-9569456633cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:27.561549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3c645-cfcb-4d60-823d-9569456633cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:27.568498 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3c645-cfcb-4d60-823d-9569456633cb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:27.590904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 946/1904] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:27.595693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62a583-f5ec-4987-b8e9-7a38b7b06614 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:27.619738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62a583-f5ec-4987-b8e9-7a38b7b06614 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:27.619738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2ebd9-eec5-41e5-8d2a-8111dbbc87c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:27.619738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2ebd9-eec5-41e5-8d2a-8111dbbc87c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:27.619738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2ebd9-eec5-41e5-8d2a-8111dbbc87c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:27.620422 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2ebd9-eec5-41e5-8d2a-8111dbbc87c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:27.620422 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2ebd9-eec5-41e5-8d2a-8111dbbc87c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:27.620422 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2ebd9-eec5-41e5-8d2a-8111dbbc87c0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:27.640511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3c645-cfcb-4d60-823d-9569456633cb admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:27.642441 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d5e3c645-cfcb-4d60-823d-9569456633cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:27.689714 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 959/1905] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:27 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:27.694176 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2ebd9-eec5-41e5-8d2a-8111dbbc87c0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:27.723921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3c645-cfcb-4d60-823d-9569456633cb admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:27.777554 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2ebd9-eec5-41e5-8d2a-8111dbbc87c0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:27.783776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d3a51-74e5-4b7b-8e2a-adb66d91f29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:27.784459 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d3a51-74e5-4b7b-8e2a-adb66d91f29f admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:27.784835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d3a51-74e5-4b7b-8e2a-adb66d91f29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:27.785162 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d3a51-74e5-4b7b-8e2a-adb66d91f29f admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:27.785906 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d3a51-74e5-4b7b-8e2a-adb66d91f29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:27.788297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d3a51-74e5-4b7b-8e2a-adb66d91f29f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:27.793247 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef62ef-b362-47be-8e83-c9a47ae642d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:27.794447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef62ef-b362-47be-8e83-c9a47ae642d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:27.794725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef62ef-b362-47be-8e83-c9a47ae642d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:27.794992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef62ef-b362-47be-8e83-c9a47ae642d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:27.798101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-eeef62ef-b362-47be-8e83-c9a47ae642d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:27.818701 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 960/1906] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:27 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:10:27.822711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d3a51-74e5-4b7b-8e2a-adb66d91f29f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:27.835747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d3a51-74e5-4b7b-8e2a-adb66d91f29f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:27.837277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:27.841213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07839046-ae80-4521-a8a0-fd785add771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:27.841839 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07839046-ae80-4521-a8a0-fd785add771e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:27.842152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07839046-ae80-4521-a8a0-fd785add771e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:27.842427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07839046-ae80-4521-a8a0-fd785add771e admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:27.843070 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07839046-ae80-4521-a8a0-fd785add771e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:27.844973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07839046-ae80-4521-a8a0-fd785add771e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:27.856446 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 961/1907] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:27.861076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07839046-ae80-4521-a8a0-fd785add771e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:27.871809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07839046-ae80-4521-a8a0-fd785add771e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:27.878827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021b252-2057-4d89-a60b-b8250366709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:27.879788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021b252-2057-4d89-a60b-b8250366709a admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:27.880215 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021b252-2057-4d89-a60b-b8250366709a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:27.880642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021b252-2057-4d89-a60b-b8250366709a admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:27.881769 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021b252-2057-4d89-a60b-b8250366709a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:27.882255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef62ef-b362-47be-8e83-c9a47ae642d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:27.883529 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021b252-2057-4d89-a60b-b8250366709a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:27.883687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef62ef-b362-47be-8e83-c9a47ae642d3 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:27.886856 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:27.895479 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 947/1908] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:27.900340 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 962/1909] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:27.904749 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef62ef-b362-47be-8e83-c9a47ae642d3 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:27.916316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef62ef-b362-47be-8e83-c9a47ae642d3 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:27.923317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7a7d0-4124-4491-a395-8db85871cc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:27.924439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7a7d0-4124-4491-a395-8db85871cc05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:27.924439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7a7d0-4124-4491-a395-8db85871cc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:27.924439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7a7d0-4124-4491-a395-8db85871cc05 admin admin] PATH_INFO: `/v3/projects/fcd1ce04a8a74024acf567bcd3d45cd7/users/e484489cc03e45d1b58c6e60f0863595/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:27.953507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7a7d0-4124-4491-a395-8db85871cc05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd1ce04a8a74024acf567bcd3d45cd7, user_id=e484489cc03e45d1b58c6e60f0863595, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:27.958140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7a7d0-4124-4491-a395-8db85871cc05 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:27.981367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 948/1910] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:27 2022] PUT /identity/v3/projects/fcd1ce04a8a74024acf567bcd3d45cd7/users/e484489cc03e45d1b58c6e60f0863595/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:27.993872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f678a1d-fe94-44b7-9020-e63cf20f1570 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:27.994164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f678a1d-fe94-44b7-9020-e63cf20f1570 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:27.994477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f678a1d-fe94-44b7-9020-e63cf20f1570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:28.071474 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1f678a1d-fe94-44b7-9020-e63cf20f1570 None None] MFA Rules not processed for user `e484489cc03e45d1b58c6e60f0863595`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:28.073021 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1f678a1d-fe94-44b7-9020-e63cf20f1570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:28.237899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 963/1911] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:28.243733 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7a7d0-4124-4491-a395-8db85871cc05 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:28.413700 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7a7d0-4124-4491-a395-8db85871cc05 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:28.425299 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0586e1-4584-4da6-b196-846c98917366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:28.426822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0586e1-4584-4da6-b196-846c98917366 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:28.427309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0586e1-4584-4da6-b196-846c98917366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:28.427904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0586e1-4584-4da6-b196-846c98917366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:28.429367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0586e1-4584-4da6-b196-846c98917366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:28.434077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0586e1-4584-4da6-b196-846c98917366 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:28.494136 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 949/1912] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:28 2022] POST /identity/v3/projects => generated 387 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:28.495474 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f678a1d-fe94-44b7-9020-e63cf20f1570 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:28.508420 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f678a1d-fe94-44b7-9020-e63cf20f1570 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:28.585359 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754af38-9734-4565-8a38-216c15128a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:28.586306 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754af38-9734-4565-8a38-216c15128a71 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:28.586644 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754af38-9734-4565-8a38-216c15128a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:28.586908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754af38-9734-4565-8a38-216c15128a71 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:28.587585 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754af38-9734-4565-8a38-216c15128a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:28.589971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754af38-9734-4565-8a38-216c15128a71 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:28.630057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 964/1913] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:28 2022] POST /identity/v3/users => generated 300 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:28.634976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0586e1-4584-4da6-b196-846c98917366 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:28.661822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0586e1-4584-4da6-b196-846c98917366 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:28.678665 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f06f2e-7eee-4a8c-8b5e-7612d74ecd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:28.679807 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f06f2e-7eee-4a8c-8b5e-7612d74ecd8a admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:28.680458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f06f2e-7eee-4a8c-8b5e-7612d74ecd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:28.680735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f06f2e-7eee-4a8c-8b5e-7612d74ecd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:28.681346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f06f2e-7eee-4a8c-8b5e-7612d74ecd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:28.684701 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f06f2e-7eee-4a8c-8b5e-7612d74ecd8a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:28.699086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 950/1914] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:28.704353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754af38-9734-4565-8a38-216c15128a71 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:28.721419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754af38-9734-4565-8a38-216c15128a71 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:28.733434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a970ab9-894b-4441-a08c-ae0d63945c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:28.736855 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a970ab9-894b-4441-a08c-ae0d63945c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:28.737408 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a970ab9-894b-4441-a08c-ae0d63945c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:28.738074 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a970ab9-894b-4441-a08c-ae0d63945c16 admin admin] PATH_INFO: `/v3/projects/fef3c936f5694d1db1c3936450eeb56e/users/546f7fe07c3a4062a14aea44bb9e7fda/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:28.766872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a970ab9-894b-4441-a08c-ae0d63945c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef3c936f5694d1db1c3936450eeb56e, user_id=546f7fe07c3a4062a14aea44bb9e7fda, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:28.771827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a970ab9-894b-4441-a08c-ae0d63945c16 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:28.790267 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 965/1915] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:28 2022] PUT /identity/v3/projects/fef3c936f5694d1db1c3936450eeb56e/users/546f7fe07c3a4062a14aea44bb9e7fda/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:28.794426 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f06f2e-7eee-4a8c-8b5e-7612d74ecd8a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:28.806457 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f06f2e-7eee-4a8c-8b5e-7612d74ecd8a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:28.904796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a8d49-09c9-4bad-8399-a8f6b1686b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:28.905648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a8d49-09c9-4bad-8399-a8f6b1686b79 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:28.906069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a8d49-09c9-4bad-8399-a8f6b1686b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:28.907123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a8d49-09c9-4bad-8399-a8f6b1686b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:28.907913 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a8d49-09c9-4bad-8399-a8f6b1686b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:28.910469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a8d49-09c9-4bad-8399-a8f6b1686b79 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:28.929770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 951/1916] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:28.930563 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a970ab9-894b-4441-a08c-ae0d63945c16 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:28.945411 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a970ab9-894b-4441-a08c-ae0d63945c16 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:28.953252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a0565-2a21-40b3-9b4b-ff9082b92263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:28.953926 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a0565-2a21-40b3-9b4b-ff9082b92263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:28.954203 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a0565-2a21-40b3-9b4b-ff9082b92263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:28.954483 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a0565-2a21-40b3-9b4b-ff9082b92263 admin admin] PATH_INFO: `/v3/projects/fef3c936f5694d1db1c3936450eeb56e/users/546f7fe07c3a4062a14aea44bb9e7fda/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:28.956697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a0565-2a21-40b3-9b4b-ff9082b92263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef3c936f5694d1db1c3936450eeb56e, user_id=546f7fe07c3a4062a14aea44bb9e7fda, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:28.959461 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a0565-2a21-40b3-9b4b-ff9082b92263 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:28.973045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 966/1917] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:28 2022] PUT /identity/v3/projects/fef3c936f5694d1db1c3936450eeb56e/users/546f7fe07c3a4062a14aea44bb9e7fda/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:10:28.985757 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58278e-0c87-4b1a-878b-f3c240454699 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:28.986108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58278e-0c87-4b1a-878b-f3c240454699 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:28.986493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58278e-0c87-4b1a-878b-f3c240454699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:29.020409 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:29.025255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-cf58278e-0c87-4b1a-878b-f3c240454699 None None] MFA Rules not processed for user `546f7fe07c3a4062a14aea44bb9e7fda`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:29.027434 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cf58278e-0c87-4b1a-878b-f3c240454699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:29.132830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 952/1918] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:29.151621 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a0565-2a21-40b3-9b4b-ff9082b92263 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:29.155903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c66a0565-2a21-40b3-9b4b-ff9082b92263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:29.302577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:29.336533 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a0565-2a21-40b3-9b4b-ff9082b92263 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:29.342307 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45de04f-ba21-497f-8ddd-8f0e32746c4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:29.343280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45de04f-ba21-497f-8ddd-8f0e32746c4f service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:29.345269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45de04f-ba21-497f-8ddd-8f0e32746c4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:29.345607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45de04f-ba21-497f-8ddd-8f0e32746c4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:29.360210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45de04f-ba21-497f-8ddd-8f0e32746c4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:29.362754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45de04f-ba21-497f-8ddd-8f0e32746c4f service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:29.376004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 967/1919] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:29.489640 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58278e-0c87-4b1a-878b-f3c240454699 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:29.568872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58278e-0c87-4b1a-878b-f3c240454699 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:29.584893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88b117-1d05-4b7f-9dab-0342d03224bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:29.584893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88b117-1d05-4b7f-9dab-0342d03224bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:29.584893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88b117-1d05-4b7f-9dab-0342d03224bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:29.584893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88b117-1d05-4b7f-9dab-0342d03224bc admin admin] PATH_INFO: `/v3/users/e484489cc03e45d1b58c6e60f0863595` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:29.585172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88b117-1d05-4b7f-9dab-0342d03224bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e484489cc03e45d1b58c6e60f0863595)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:29.585172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88b117-1d05-4b7f-9dab-0342d03224bc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:29.700560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d88b117-1d05-4b7f-9dab-0342d03224bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e484489cc03e45d1b58c6e60f0863595'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:29.716571 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d88b117-1d05-4b7f-9dab-0342d03224bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e484489cc03e45d1b58c6e60f0863595'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:29.727758 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d88b117-1d05-4b7f-9dab-0342d03224bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e484489cc03e45d1b58c6e60f0863595'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:29.728744 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d88b117-1d05-4b7f-9dab-0342d03224bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e484489cc03e45d1b58c6e60f0863595'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:29.729599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d88b117-1d05-4b7f-9dab-0342d03224bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e484489cc03e45d1b58c6e60f0863595'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:29.751474 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 953/1920] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:29 2022] DELETE /identity/v3/users/e484489cc03e45d1b58c6e60f0863595 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:29.753488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caed4d-46c1-420a-a37f-af611a9ea8fc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:29.753967 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caed4d-46c1-420a-a37f-af611a9ea8fc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:29.754252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caed4d-46c1-420a-a37f-af611a9ea8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:29.784115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a9caed4d-46c1-420a-a37f-af611a9ea8fc None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:29.786097 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a9caed4d-46c1-420a-a37f-af611a9ea8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:29.913302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 968/1921] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:29.946202 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88b117-1d05-4b7f-9dab-0342d03224bc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:29.948614 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8d88b117-1d05-4b7f-9dab-0342d03224bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:29.994711 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:30.128570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88b117-1d05-4b7f-9dab-0342d03224bc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:30.135731 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189caf4-d761-465a-88b9-363ce984550f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:30.137075 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189caf4-d761-465a-88b9-363ce984550f service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:30.137075 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189caf4-d761-465a-88b9-363ce984550f service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:30.137075 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189caf4-d761-465a-88b9-363ce984550f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:30.150097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189caf4-d761-465a-88b9-363ce984550f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:30.151895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189caf4-d761-465a-88b9-363ce984550f service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:30.165295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 954/1922] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:30.687331 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caed4d-46c1-420a-a37f-af611a9ea8fc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:30.689444 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a9caed4d-46c1-420a-a37f-af611a9ea8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:30.713120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caed4d-46c1-420a-a37f-af611a9ea8fc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:30.736654 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979f942-1242-4bed-af64-d30e6dfff093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:30.737317 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979f942-1242-4bed-af64-d30e6dfff093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:30.737598 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979f942-1242-4bed-af64-d30e6dfff093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:30.737914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979f942-1242-4bed-af64-d30e6dfff093 admin admin] PATH_INFO: `/v3/projects/fcd1ce04a8a74024acf567bcd3d45cd7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:30.739195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979f942-1242-4bed-af64-d30e6dfff093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd1ce04a8a74024acf567bcd3d45cd7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:30.742498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979f942-1242-4bed-af64-d30e6dfff093 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:30.821962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7979f942-1242-4bed-af64-d30e6dfff093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd1ce04a8a74024acf567bcd3d45cd7', 'request_id': 'req-7979f942-1242-4bed-af64-d30e6dfff093'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:30.835935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7979f942-1242-4bed-af64-d30e6dfff093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd1ce04a8a74024acf567bcd3d45cd7', 'request_id': 'req-7979f942-1242-4bed-af64-d30e6dfff093'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:30.847276 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7979f942-1242-4bed-af64-d30e6dfff093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd1ce04a8a74024acf567bcd3d45cd7', 'request_id': 'req-7979f942-1242-4bed-af64-d30e6dfff093'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:30.864430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7979f942-1242-4bed-af64-d30e6dfff093 admin admin] The token cache is being invalidate because project fcd1ce04a8a74024acf567bcd3d45cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:30.864770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7979f942-1242-4bed-af64-d30e6dfff093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:30.865641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7979f942-1242-4bed-af64-d30e6dfff093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:30.867601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 969/1923] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:30 2022] DELETE /identity/v3/projects/fcd1ce04a8a74024acf567bcd3d45cd7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:30.871713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189caf4-d761-465a-88b9-363ce984550f service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:30.885353 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189caf4-d761-465a-88b9-363ce984550f service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:30.970483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30ec50-3f0a-447b-a2b7-f8687d15034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:30.971116 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30ec50-3f0a-447b-a2b7-f8687d15034a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:30.971391 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30ec50-3f0a-447b-a2b7-f8687d15034a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:30.971655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30ec50-3f0a-447b-a2b7-f8687d15034a admin admin] PATH_INFO: `/v3/users/546f7fe07c3a4062a14aea44bb9e7fda` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:30.972889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30ec50-3f0a-447b-a2b7-f8687d15034a admin admin] RBAC: Authorizing `identity:delete_user(user_id=546f7fe07c3a4062a14aea44bb9e7fda)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:30.974834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30ec50-3f0a-447b-a2b7-f8687d15034a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:31.042607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7e30ec50-3f0a-447b-a2b7-f8687d15034a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546f7fe07c3a4062a14aea44bb9e7fda'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:31.067206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7e30ec50-3f0a-447b-a2b7-f8687d15034a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546f7fe07c3a4062a14aea44bb9e7fda'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:31.075723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7e30ec50-3f0a-447b-a2b7-f8687d15034a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546f7fe07c3a4062a14aea44bb9e7fda'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:31.076688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7e30ec50-3f0a-447b-a2b7-f8687d15034a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546f7fe07c3a4062a14aea44bb9e7fda'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:31.077458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7e30ec50-3f0a-447b-a2b7-f8687d15034a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546f7fe07c3a4062a14aea44bb9e7fda'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:31.104110 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 955/1924] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:30 2022] DELETE /identity/v3/users/546f7fe07c3a4062a14aea44bb9e7fda => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:31.933319 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979f942-1242-4bed-af64-d30e6dfff093 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:31.935362 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7979f942-1242-4bed-af64-d30e6dfff093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:31.950610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979f942-1242-4bed-af64-d30e6dfff093 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:32.073916 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d44db-ffd3-4474-b611-27668056d16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:32.075125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d44db-ffd3-4474-b611-27668056d16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:32.075583 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d44db-ffd3-4474-b611-27668056d16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:32.076057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d44db-ffd3-4474-b611-27668056d16b admin admin] PATH_INFO: `/v3/projects/fef3c936f5694d1db1c3936450eeb56e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:32.078769 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d44db-ffd3-4474-b611-27668056d16b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fef3c936f5694d1db1c3936450eeb56e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:32.081718 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d44db-ffd3-4474-b611-27668056d16b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:32.092312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:32.144332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b18d44db-ffd3-4474-b611-27668056d16b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef3c936f5694d1db1c3936450eeb56e', 'request_id': 'req-b18d44db-ffd3-4474-b611-27668056d16b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:32.151451 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b18d44db-ffd3-4474-b611-27668056d16b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef3c936f5694d1db1c3936450eeb56e', 'request_id': 'req-b18d44db-ffd3-4474-b611-27668056d16b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:32.161180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b18d44db-ffd3-4474-b611-27668056d16b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef3c936f5694d1db1c3936450eeb56e', 'request_id': 'req-b18d44db-ffd3-4474-b611-27668056d16b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:32.178461 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b18d44db-ffd3-4474-b611-27668056d16b admin admin] The token cache is being invalidate because project fef3c936f5694d1db1c3936450eeb56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:32.178760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b18d44db-ffd3-4474-b611-27668056d16b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:32.180016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b18d44db-ffd3-4474-b611-27668056d16b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:32.184073 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 970/1925] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:31 2022] DELETE /identity/v3/projects/fef3c936f5694d1db1c3936450eeb56e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:10:32.190601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d6569-4692-48a7-b122-8b571720aa67 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:32.191213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d6569-4692-48a7-b122-8b571720aa67 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:32.191213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d6569-4692-48a7-b122-8b571720aa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:32.214389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-207d6569-4692-48a7-b122-8b571720aa67 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:32.215718 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-207d6569-4692-48a7-b122-8b571720aa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:32.261192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:32.344733 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 956/1926] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:32.351970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef7f28-02cd-4173-96b1-53d32464864a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:32.352275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef7f28-02cd-4173-96b1-53d32464864a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:32.352571 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef7f28-02cd-4173-96b1-53d32464864a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:32.378711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-feef7f28-02cd-4173-96b1-53d32464864a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:32.379991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-feef7f28-02cd-4173-96b1-53d32464864a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:32.396294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 971/1927] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:32.397390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d6569-4692-48a7-b122-8b571720aa67 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:32.408150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d6569-4692-48a7-b122-8b571720aa67 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:32.415750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ba165-b242-4006-84b8-12ec1a208088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:32.416513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ba165-b242-4006-84b8-12ec1a208088 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:32.417139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ba165-b242-4006-84b8-12ec1a208088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:32.417480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ba165-b242-4006-84b8-12ec1a208088 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:32.418221 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ba165-b242-4006-84b8-12ec1a208088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:32.418741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ba165-b242-4006-84b8-12ec1a208088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:32.420479 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ba165-b242-4006-84b8-12ec1a208088 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:32.435682 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 957/1928] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:32.442890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef7f28-02cd-4173-96b1-53d32464864a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:32.458719 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef7f28-02cd-4173-96b1-53d32464864a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:32.465736 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f07e57-824d-4b76-8692-5d83f11c0aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:32.466606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f07e57-824d-4b76-8692-5d83f11c0aec admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:32.466894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f07e57-824d-4b76-8692-5d83f11c0aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:32.467181 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f07e57-824d-4b76-8692-5d83f11c0aec admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:32.467837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f07e57-824d-4b76-8692-5d83f11c0aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:32.469827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f07e57-824d-4b76-8692-5d83f11c0aec admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:32.505673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 972/1929] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:32 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:32.510266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ba165-b242-4006-84b8-12ec1a208088 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:32.521234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ba165-b242-4006-84b8-12ec1a208088 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:32.600738 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7156234-5794-4783-94e7-7dcacf69db90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:32.601551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7156234-5794-4783-94e7-7dcacf69db90 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:32.601831 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7156234-5794-4783-94e7-7dcacf69db90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:32.602102 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7156234-5794-4783-94e7-7dcacf69db90 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:32.602777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7156234-5794-4783-94e7-7dcacf69db90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:32.605014 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7156234-5794-4783-94e7-7dcacf69db90 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:32.629317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 958/1930] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:32 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:32.634428 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f07e57-824d-4b76-8692-5d83f11c0aec admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:32.646306 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f07e57-824d-4b76-8692-5d83f11c0aec admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:32.652207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1a5b5-e306-46ba-a79c-f5c461c92312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:32.652207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1a5b5-e306-46ba-a79c-f5c461c92312 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:32.652207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1a5b5-e306-46ba-a79c-f5c461c92312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:32.652541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1a5b5-e306-46ba-a79c-f5c461c92312 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:32.653655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1a5b5-e306-46ba-a79c-f5c461c92312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:32.656554 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1a5b5-e306-46ba-a79c-f5c461c92312 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:32.676851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 973/1931] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:32.680802 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7156234-5794-4783-94e7-7dcacf69db90 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:32.695750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7156234-5794-4783-94e7-7dcacf69db90 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:32.706524 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b36b8-8da2-46f9-b8d8-b13aeb917798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:32.707200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b36b8-8da2-46f9-b8d8-b13aeb917798 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:32.707569 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b36b8-8da2-46f9-b8d8-b13aeb917798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:32.707752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b36b8-8da2-46f9-b8d8-b13aeb917798 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:32.708476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b36b8-8da2-46f9-b8d8-b13aeb917798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:32.710167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b36b8-8da2-46f9-b8d8-b13aeb917798 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:32.725867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1a5b5-e306-46ba-a79c-f5c461c92312 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:32.728249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-41d1a5b5-e306-46ba-a79c-f5c461c92312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:32.733031 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 959/1932] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:32.737935 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b36b8-8da2-46f9-b8d8-b13aeb917798 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:32.747655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1a5b5-e306-46ba-a79c-f5c461c92312 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:32.750494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b36b8-8da2-46f9-b8d8-b13aeb917798 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:32.755081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25ed83-9886-4597-a31a-0616043eaad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:32.756684 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25ed83-9886-4597-a31a-0616043eaad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:32.757077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb29097-8dbe-49ff-b3a5-64147eba6143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:32.757295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25ed83-9886-4597-a31a-0616043eaad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:32.757711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25ed83-9886-4597-a31a-0616043eaad3 admin admin] PATH_INFO: `/v3/users/625af16c4f704214a35591d658806525` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:32.758130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb29097-8dbe-49ff-b3a5-64147eba6143 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:32.758551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb29097-8dbe-49ff-b3a5-64147eba6143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:32.759052 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb29097-8dbe-49ff-b3a5-64147eba6143 admin admin] PATH_INFO: `/v3/projects/2ee9b51ccf52442ca066a2f7b63cf808/users/8dabd8f0ea654a72985f6354608638e8/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:32.759480 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25ed83-9886-4597-a31a-0616043eaad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=625af16c4f704214a35591d658806525)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:32.778330 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25ed83-9886-4597-a31a-0616043eaad3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:32.780212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb29097-8dbe-49ff-b3a5-64147eba6143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee9b51ccf52442ca066a2f7b63cf808, user_id=8dabd8f0ea654a72985f6354608638e8, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:32.785049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb29097-8dbe-49ff-b3a5-64147eba6143 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:32.808049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 960/1933] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:32 2022] PUT /identity/v3/projects/2ee9b51ccf52442ca066a2f7b63cf808/users/8dabd8f0ea654a72985f6354608638e8/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:32.820606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf24770-8270-4df1-b0ec-d22a64376b4f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:32.820992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf24770-8270-4df1-b0ec-d22a64376b4f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:32.821404 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf24770-8270-4df1-b0ec-d22a64376b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:32.868446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-dcf24770-8270-4df1-b0ec-d22a64376b4f None None] MFA Rules not processed for user `8dabd8f0ea654a72985f6354608638e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:32.870047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dcf24770-8270-4df1-b0ec-d22a64376b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:32.914285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4b25ed83-9886-4597-a31a-0616043eaad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '625af16c4f704214a35591d658806525'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:32.926466 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4b25ed83-9886-4597-a31a-0616043eaad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '625af16c4f704214a35591d658806525'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:32.957280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4b25ed83-9886-4597-a31a-0616043eaad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '625af16c4f704214a35591d658806525'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:32.961207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4b25ed83-9886-4597-a31a-0616043eaad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '625af16c4f704214a35591d658806525'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:32.970566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 961/1934] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:32.975226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf24770-8270-4df1-b0ec-d22a64376b4f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:32.984796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4b25ed83-9886-4597-a31a-0616043eaad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '625af16c4f704214a35591d658806525'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:32.993951 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:33.000433 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 974/1935] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:32 2022] DELETE /identity/v3/users/625af16c4f704214a35591d658806525 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:33.002119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4d7ee-6a6e-4d38-961b-e120a12fef0e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:33.002407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4d7ee-6a6e-4d38-961b-e120a12fef0e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:33.002688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4d7ee-6a6e-4d38-961b-e120a12fef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:33.048538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-41b4d7ee-6a6e-4d38-961b-e120a12fef0e None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:33.049898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-41b4d7ee-6a6e-4d38-961b-e120a12fef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:33.068238 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf24770-8270-4df1-b0ec-d22a64376b4f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:33.087391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:33.141470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 975/1936] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:33.145717 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4d7ee-6a6e-4d38-961b-e120a12fef0e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:33.147367 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-41b4d7ee-6a6e-4d38-961b-e120a12fef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:33.162111 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbcc90-edb4-47e4-b701-470bd9126ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:33.162926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbcc90-edb4-47e4-b701-470bd9126ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:33.163715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbcc90-edb4-47e4-b701-470bd9126ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:33.163715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbcc90-edb4-47e4-b701-470bd9126ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:33.164324 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbcc90-edb4-47e4-b701-470bd9126ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:33.164426 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4d7ee-6a6e-4d38-961b-e120a12fef0e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:33.166348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbcc90-edb4-47e4-b701-470bd9126ec5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:33.169642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e972f-fc82-4d9f-adb0-bf4c1fa7eb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:33.170814 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e972f-fc82-4d9f-adb0-bf4c1fa7eb8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:33.170814 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e972f-fc82-4d9f-adb0-bf4c1fa7eb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:33.170987 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e972f-fc82-4d9f-adb0-bf4c1fa7eb8d admin admin] PATH_INFO: `/v3/users/1d915ca4dc924613bd75c33ab6d69bcc` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:33.173022 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e972f-fc82-4d9f-adb0-bf4c1fa7eb8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d915ca4dc924613bd75c33ab6d69bcc)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:33.175051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e972f-fc82-4d9f-adb0-bf4c1fa7eb8d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:33.204573 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 962/1937] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:32 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:33.204573 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbcc90-edb4-47e4-b701-470bd9126ec5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:33.209161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1bfbcc90-edb4-47e4-b701-470bd9126ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:33.250376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-845e972f-fc82-4d9f-adb0-bf4c1fa7eb8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d915ca4dc924613bd75c33ab6d69bcc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:33.259595 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-845e972f-fc82-4d9f-adb0-bf4c1fa7eb8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d915ca4dc924613bd75c33ab6d69bcc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:33.272852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-845e972f-fc82-4d9f-adb0-bf4c1fa7eb8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d915ca4dc924613bd75c33ab6d69bcc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:33.274035 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-845e972f-fc82-4d9f-adb0-bf4c1fa7eb8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d915ca4dc924613bd75c33ab6d69bcc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:33.299142 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbcc90-edb4-47e4-b701-470bd9126ec5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:33.303472 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97048b-e4e3-4cae-ba29-7e8bd1c858c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:33.304129 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97048b-e4e3-4cae-ba29-7e8bd1c858c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:33.304410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97048b-e4e3-4cae-ba29-7e8bd1c858c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:33.304684 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97048b-e4e3-4cae-ba29-7e8bd1c858c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:33.307894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-845e972f-fc82-4d9f-adb0-bf4c1fa7eb8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d915ca4dc924613bd75c33ab6d69bcc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:33.308627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6f97048b-e4e3-4cae-ba29-7e8bd1c858c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:33.319523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 976/1938] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:33 2022] DELETE /identity/v3/users/1d915ca4dc924613bd75c33ab6d69bcc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:33.321180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e972f-fc82-4d9f-adb0-bf4c1fa7eb8d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:33.336215 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-845e972f-fc82-4d9f-adb0-bf4c1fa7eb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:33.414960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:33.419996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97048b-e4e3-4cae-ba29-7e8bd1c858c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:33.423205 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97048b-e4e3-4cae-ba29-7e8bd1c858c6 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:33.441893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e972f-fc82-4d9f-adb0-bf4c1fa7eb8d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:33.447558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c8cae-3f4f-4a70-b0fe-2f7dac62df93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:33.448463 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c8cae-3f4f-4a70-b0fe-2f7dac62df93 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:33.449042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c8cae-3f4f-4a70-b0fe-2f7dac62df93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:33.449543 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c8cae-3f4f-4a70-b0fe-2f7dac62df93 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:33.450950 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c8cae-3f4f-4a70-b0fe-2f7dac62df93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:33.451417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 963/1939] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:33.452966 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e4e14-908c-4869-a645-8f698c728543 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:33.453770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e4e14-908c-4869-a645-8f698c728543 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:33.454049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e4e14-908c-4869-a645-8f698c728543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:33.455078 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c8cae-3f4f-4a70-b0fe-2f7dac62df93 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:33.481374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 977/1940] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:33 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:33.485419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c8cae-3f4f-4a70-b0fe-2f7dac62df93 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:33.501129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c8cae-3f4f-4a70-b0fe-2f7dac62df93 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:33.505265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6a6e4e14-908c-4869-a645-8f698c728543 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:33.506932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6a6e4e14-908c-4869-a645-8f698c728543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:33.508387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbce892-24f7-4964-bff1-c7a934ea78c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:33.509333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbce892-24f7-4964-bff1-c7a934ea78c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:33.509790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbce892-24f7-4964-bff1-c7a934ea78c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:33.510235 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbce892-24f7-4964-bff1-c7a934ea78c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:33.511145 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbce892-24f7-4964-bff1-c7a934ea78c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:33.513232 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbce892-24f7-4964-bff1-c7a934ea78c2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:33.526642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 978/1941] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:33.530847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbce892-24f7-4964-bff1-c7a934ea78c2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:33.545589 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 964/1942] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:33.546134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbce892-24f7-4964-bff1-c7a934ea78c2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:33.550257 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e4e14-908c-4869-a645-8f698c728543 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:33.550395 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa55140-adcf-4ff7-9bb4-6f38c8151cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:33.550567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6a6e4e14-908c-4869-a645-8f698c728543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:33.550664 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa55140-adcf-4ff7-9bb4-6f38c8151cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:33.550984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa55140-adcf-4ff7-9bb4-6f38c8151cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:33.551325 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa55140-adcf-4ff7-9bb4-6f38c8151cc4 admin admin] PATH_INFO: `/v3/projects/5b7bb253ef784587aea3742ecca6bebf/users/f1ec391c855f4f13964c57391b00dc85/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:33.576621 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa55140-adcf-4ff7-9bb4-6f38c8151cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7bb253ef784587aea3742ecca6bebf, user_id=f1ec391c855f4f13964c57391b00dc85, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:33.582397 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa55140-adcf-4ff7-9bb4-6f38c8151cc4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:33.585835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:33.605888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 979/1943] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:33 2022] PUT /identity/v3/projects/5b7bb253ef784587aea3742ecca6bebf/users/f1ec391c855f4f13964c57391b00dc85/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:10:33.607578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa55140-adcf-4ff7-9bb4-6f38c8151cc4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:33.697521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e4e14-908c-4869-a645-8f698c728543 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:33.744303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa55140-adcf-4ff7-9bb4-6f38c8151cc4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:33.757139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d31dd-b2e7-42db-8877-3e20cbcc17df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:33.757772 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d31dd-b2e7-42db-8877-3e20cbcc17df admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:33.758467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d31dd-b2e7-42db-8877-3e20cbcc17df admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:33.758744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d31dd-b2e7-42db-8877-3e20cbcc17df admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:33.761600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d31dd-b2e7-42db-8877-3e20cbcc17df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:33.765018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d31dd-b2e7-42db-8877-3e20cbcc17df admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:33.796094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16665bd3-1a00-4aca-b923-9bd4305cd0e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:33.798605 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16665bd3-1a00-4aca-b923-9bd4305cd0e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:33.799045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16665bd3-1a00-4aca-b923-9bd4305cd0e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:33.799470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16665bd3-1a00-4aca-b923-9bd4305cd0e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:33.809950 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 980/1944] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:33.809950 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d31dd-b2e7-42db-8877-3e20cbcc17df admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:33.835658 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d31dd-b2e7-42db-8877-3e20cbcc17df admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:33.840313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16665bd3-1a00-4aca-b923-9bd4305cd0e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:33.843148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16665bd3-1a00-4aca-b923-9bd4305cd0e7 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:33.847164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef6a16-5052-4a49-bd15-f8f3d4c13d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:33.849222 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef6a16-5052-4a49-bd15-f8f3d4c13d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:33.850318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef6a16-5052-4a49-bd15-f8f3d4c13d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:33.850318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef6a16-5052-4a49-bd15-f8f3d4c13d08 admin admin] PATH_INFO: `/v3/projects/5b7bb253ef784587aea3742ecca6bebf/users/f1ec391c855f4f13964c57391b00dc85/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:33.855120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef6a16-5052-4a49-bd15-f8f3d4c13d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7bb253ef784587aea3742ecca6bebf, user_id=f1ec391c855f4f13964c57391b00dc85, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:33.862837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef6a16-5052-4a49-bd15-f8f3d4c13d08 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:33.869699 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 965/1945] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:33.893574 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 981/1946] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:33 2022] PUT /identity/v3/projects/5b7bb253ef784587aea3742ecca6bebf/users/f1ec391c855f4f13964c57391b00dc85/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:33.904452 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a83ff5-918b-4061-a8d7-a1cb80ce1c55 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:33.904842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a83ff5-918b-4061-a8d7-a1cb80ce1c55 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:33.905223 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a83ff5-918b-4061-a8d7-a1cb80ce1c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:33.970776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-00a83ff5-918b-4061-a8d7-a1cb80ce1c55 None None] MFA Rules not processed for user `f1ec391c855f4f13964c57391b00dc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:33.972060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-00a83ff5-918b-4061-a8d7-a1cb80ce1c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:34.146909 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 966/1947] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:34.164214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef6a16-5052-4a49-bd15-f8f3d4c13d08 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:34.172773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cfef6a16-5052-4a49-bd15-f8f3d4c13d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:34.186981 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a83ff5-918b-4061-a8d7-a1cb80ce1c55 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:34.190037 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-00a83ff5-918b-4061-a8d7-a1cb80ce1c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:34.268606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:34.294454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef6a16-5052-4a49-bd15-f8f3d4c13d08 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:34.298741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d06b7-5889-4028-af7b-d70a3bc5aeb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:34.299375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d06b7-5889-4028-af7b-d70a3bc5aeb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:34.299652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d06b7-5889-4028-af7b-d70a3bc5aeb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:34.299921 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d06b7-5889-4028-af7b-d70a3bc5aeb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:34.317412 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d06b7-5889-4028-af7b-d70a3bc5aeb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:34.320860 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d06b7-5889-4028-af7b-d70a3bc5aeb5 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:34.321194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a83ff5-918b-4061-a8d7-a1cb80ce1c55 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:34.326089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:34.326745 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:34.327020 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:34.327287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559 admin admin] PATH_INFO: `/v3/projects/7fbb45c252f74eed964a73de45e2e73f` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:34.328564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fbb45c252f74eed964a73de45e2e73f)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:34.330650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:34.355597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 982/1948] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:34.466129 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fbb45c252f74eed964a73de45e2e73f', 'request_id': 'req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:34.479923 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fbb45c252f74eed964a73de45e2e73f', 'request_id': 'req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:34.497077 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d06b7-5889-4028-af7b-d70a3bc5aeb5 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:34.503249 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fbb45c252f74eed964a73de45e2e73f', 'request_id': 'req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:34.524302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559 admin admin] The token cache is being invalidate because project 7fbb45c252f74eed964a73de45e2e73f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:34.524732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:34.525558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:34.530306 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d06b7-5889-4028-af7b-d70a3bc5aeb5 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:34.531855 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 967/1949] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:34 2022] DELETE /identity/v3/projects/7fbb45c252f74eed964a73de45e2e73f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:34.533074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:34.534639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:34.666118 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235203d8-9e99-4922-8acc-b0034354ecf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:34.666755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235203d8-9e99-4922-8acc-b0034354ecf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:34.668169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235203d8-9e99-4922-8acc-b0034354ecf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:34.668560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235203d8-9e99-4922-8acc-b0034354ecf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:34.673752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-235203d8-9e99-4922-8acc-b0034354ecf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:34.678658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e7aac-76f6-4eaa-b0e9-908a5c7c9559 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:34.685521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517eafd-70b0-48c7-b3f6-8bed6a309da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:34.686174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517eafd-70b0-48c7-b3f6-8bed6a309da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:34.686450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517eafd-70b0-48c7-b3f6-8bed6a309da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:34.686852 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517eafd-70b0-48c7-b3f6-8bed6a309da1 admin admin] PATH_INFO: `/v3/users/175ffb9a13b14b09ab93214db6ca356c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:34.688131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517eafd-70b0-48c7-b3f6-8bed6a309da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=175ffb9a13b14b09ab93214db6ca356c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:34.690223 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517eafd-70b0-48c7-b3f6-8bed6a309da1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:34.724367 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:34.766801 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235203d8-9e99-4922-8acc-b0034354ecf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:34.769476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235203d8-9e99-4922-8acc-b0034354ecf8 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:34.784694 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 983/1950] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:34.795080 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9517eafd-70b0-48c7-b3f6-8bed6a309da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175ffb9a13b14b09ab93214db6ca356c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:34.811425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:34.817718 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9517eafd-70b0-48c7-b3f6-8bed6a309da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175ffb9a13b14b09ab93214db6ca356c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:34.851629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9517eafd-70b0-48c7-b3f6-8bed6a309da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175ffb9a13b14b09ab93214db6ca356c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:34.851629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9517eafd-70b0-48c7-b3f6-8bed6a309da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175ffb9a13b14b09ab93214db6ca356c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:34.851629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9517eafd-70b0-48c7-b3f6-8bed6a309da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175ffb9a13b14b09ab93214db6ca356c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:34.878465 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 968/1951] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:34 2022] DELETE /identity/v3/users/175ffb9a13b14b09ab93214db6ca356c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:35.321136 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235203d8-9e99-4922-8acc-b0034354ecf8 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:35.323631 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-235203d8-9e99-4922-8acc-b0034354ecf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:35.357933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235203d8-9e99-4922-8acc-b0034354ecf8 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:35.447370 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517eafd-70b0-48c7-b3f6-8bed6a309da1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:35.449567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9517eafd-70b0-48c7-b3f6-8bed6a309da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:35.520493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33ef93-0e8d-4ded-ba6b-833fefaed9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:35.521396 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33ef93-0e8d-4ded-ba6b-833fefaed9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:35.521797 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33ef93-0e8d-4ded-ba6b-833fefaed9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:35.522146 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33ef93-0e8d-4ded-ba6b-833fefaed9a2 admin admin] PATH_INFO: `/v3/users/8dabd8f0ea654a72985f6354608638e8` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:35.523573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33ef93-0e8d-4ded-ba6b-833fefaed9a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dabd8f0ea654a72985f6354608638e8)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:35.526322 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33ef93-0e8d-4ded-ba6b-833fefaed9a2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:35.634932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517eafd-70b0-48c7-b3f6-8bed6a309da1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:35.641368 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39464fdc-9565-4b30-8823-892428058120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:35.642201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-df33ef93-0e8d-4ded-ba6b-833fefaed9a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dabd8f0ea654a72985f6354608638e8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:35.643401 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39464fdc-9565-4b30-8823-892428058120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:35.643710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39464fdc-9565-4b30-8823-892428058120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:35.644167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39464fdc-9565-4b30-8823-892428058120 admin admin] PATH_INFO: `/v3/projects/26b6820a1cef436e9d8edc09a17f7ed8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:35.645518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39464fdc-9565-4b30-8823-892428058120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b6820a1cef436e9d8edc09a17f7ed8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:35.648322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39464fdc-9565-4b30-8823-892428058120 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:35.667022 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-df33ef93-0e8d-4ded-ba6b-833fefaed9a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dabd8f0ea654a72985f6354608638e8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:35.683288 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-df33ef93-0e8d-4ded-ba6b-833fefaed9a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dabd8f0ea654a72985f6354608638e8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:35.684216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-df33ef93-0e8d-4ded-ba6b-833fefaed9a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dabd8f0ea654a72985f6354608638e8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:35.719088 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-df33ef93-0e8d-4ded-ba6b-833fefaed9a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dabd8f0ea654a72985f6354608638e8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:35.727401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 984/1952] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:35 2022] DELETE /identity/v3/users/8dabd8f0ea654a72985f6354608638e8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:35.733583 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd366e-0956-49a7-bbf1-60e9f8c93111 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:35.733868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd366e-0956-49a7-bbf1-60e9f8c93111 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:35.734201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd366e-0956-49a7-bbf1-60e9f8c93111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:35.746426 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-39464fdc-9565-4b30-8823-892428058120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b6820a1cef436e9d8edc09a17f7ed8', 'request_id': 'req-39464fdc-9565-4b30-8823-892428058120'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:35.755635 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-39464fdc-9565-4b30-8823-892428058120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b6820a1cef436e9d8edc09a17f7ed8', 'request_id': 'req-39464fdc-9565-4b30-8823-892428058120'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:35.762710 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e2cd366e-0956-49a7-bbf1-60e9f8c93111 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:35.764343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e2cd366e-0956-49a7-bbf1-60e9f8c93111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:35.766668 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-39464fdc-9565-4b30-8823-892428058120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b6820a1cef436e9d8edc09a17f7ed8', 'request_id': 'req-39464fdc-9565-4b30-8823-892428058120'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:35.793595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-39464fdc-9565-4b30-8823-892428058120 admin admin] The token cache is being invalidate because project 26b6820a1cef436e9d8edc09a17f7ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:35.794039 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-39464fdc-9565-4b30-8823-892428058120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:35.794712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-39464fdc-9565-4b30-8823-892428058120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:35.796418 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 969/1953] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:35 2022] DELETE /identity/v3/projects/26b6820a1cef436e9d8edc09a17f7ed8 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:35.802091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dbda7-e0dc-4f48-93fd-e749148ca1f6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:35.802509 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dbda7-e0dc-4f48-93fd-e749148ca1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:35.803312 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dbda7-e0dc-4f48-93fd-e749148ca1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:35.828856 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e68dbda7-e0dc-4f48-93fd-e749148ca1f6 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:35.831145 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:35.831333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e68dbda7-e0dc-4f48-93fd-e749148ca1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:35.850622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 985/1954] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:35.864158 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd366e-0956-49a7-bbf1-60e9f8c93111 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:35.865770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e2cd366e-0956-49a7-bbf1-60e9f8c93111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:35.932548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 970/1955] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:35.941262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87baf1-025b-464d-98b7-6233e1045acb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:35.941597 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87baf1-025b-464d-98b7-6233e1045acb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:35.941824 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87baf1-025b-464d-98b7-6233e1045acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:35.948229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd366e-0956-49a7-bbf1-60e9f8c93111 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:35.954187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c65c9b-ff63-44cd-baba-0111ee4a5419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:35.954811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c65c9b-ff63-44cd-baba-0111ee4a5419 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:35.955091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c65c9b-ff63-44cd-baba-0111ee4a5419 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:35.955707 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c65c9b-ff63-44cd-baba-0111ee4a5419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:35.966160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ed87baf1-025b-464d-98b7-6233e1045acb None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:35.966391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c65c9b-ff63-44cd-baba-0111ee4a5419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:35.967633 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ed87baf1-025b-464d-98b7-6233e1045acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:35.967813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c65c9b-ff63-44cd-baba-0111ee4a5419 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:35.978597 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 971/1956] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:35.982794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87baf1-025b-464d-98b7-6233e1045acb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:35.988112 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 986/1957] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:35.990878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:35.996746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87baf1-025b-464d-98b7-6233e1045acb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:36.003752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6f813-d06d-4be3-91f8-5c27681fbdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:36.004685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6f813-d06d-4be3-91f8-5c27681fbdae admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:36.005193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6f813-d06d-4be3-91f8-5c27681fbdae admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:36.005705 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6f813-d06d-4be3-91f8-5c27681fbdae admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:36.006827 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6f813-d06d-4be3-91f8-5c27681fbdae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:36.007568 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6f813-d06d-4be3-91f8-5c27681fbdae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:36.009773 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6f813-d06d-4be3-91f8-5c27681fbdae admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:36.043717 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c65c9b-ff63-44cd-baba-0111ee4a5419 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:36.044296 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 972/1958] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:36.056857 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c65c9b-ff63-44cd-baba-0111ee4a5419 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:36.063077 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fec39-148d-4b3f-938c-f8c65f326682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:36.063722 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fec39-148d-4b3f-938c-f8c65f326682 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:36.064031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fec39-148d-4b3f-938c-f8c65f326682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:36.064303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fec39-148d-4b3f-938c-f8c65f326682 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:36.064945 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fec39-148d-4b3f-938c-f8c65f326682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:36.067146 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fec39-148d-4b3f-938c-f8c65f326682 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:36.099194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 987/1959] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:36 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:36.103458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6f813-d06d-4be3-91f8-5c27681fbdae admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:36.115557 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6f813-d06d-4be3-91f8-5c27681fbdae admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:36.126191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fec39-148d-4b3f-938c-f8c65f326682 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:36.128286 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6a3fec39-148d-4b3f-938c-f8c65f326682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:36.206616 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893f9b3-1722-499e-9277-3057381deb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:36.207268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893f9b3-1722-499e-9277-3057381deb50 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:36.207682 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893f9b3-1722-499e-9277-3057381deb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:36.207839 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893f9b3-1722-499e-9277-3057381deb50 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:36.210787 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893f9b3-1722-499e-9277-3057381deb50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:36.212849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893f9b3-1722-499e-9277-3057381deb50 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:36.232792 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fec39-148d-4b3f-938c-f8c65f326682 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:36.239452 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2d6e3-a829-443c-a97c-82a8a9bad228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:36.240156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2d6e3-a829-443c-a97c-82a8a9bad228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:36.240434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2d6e3-a829-443c-a97c-82a8a9bad228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:36.240752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2d6e3-a829-443c-a97c-82a8a9bad228 admin admin] PATH_INFO: `/v3/projects/97423a05573c41f58abcc1adee847b44` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:36.242344 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2d6e3-a829-443c-a97c-82a8a9bad228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97423a05573c41f58abcc1adee847b44)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:36.244507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2d6e3-a829-443c-a97c-82a8a9bad228 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:36.249599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 973/1960] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:36 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:36.255222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893f9b3-1722-499e-9277-3057381deb50 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:36.270752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893f9b3-1722-499e-9277-3057381deb50 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:36.279334 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b514b52-a6e8-4a6b-874f-863cb76aa074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:36.280124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b514b52-a6e8-4a6b-874f-863cb76aa074 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:36.280484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b514b52-a6e8-4a6b-874f-863cb76aa074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:36.281017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b514b52-a6e8-4a6b-874f-863cb76aa074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:36.281710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b514b52-a6e8-4a6b-874f-863cb76aa074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:36.283568 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b514b52-a6e8-4a6b-874f-863cb76aa074 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:36.298636 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 974/1961] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:36.302793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b514b52-a6e8-4a6b-874f-863cb76aa074 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:36.315229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c3b2d6e3-a829-443c-a97c-82a8a9bad228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97423a05573c41f58abcc1adee847b44', 'request_id': 'req-c3b2d6e3-a829-443c-a97c-82a8a9bad228'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:36.315783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b514b52-a6e8-4a6b-874f-863cb76aa074 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:36.321704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c3b2d6e3-a829-443c-a97c-82a8a9bad228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97423a05573c41f58abcc1adee847b44', 'request_id': 'req-c3b2d6e3-a829-443c-a97c-82a8a9bad228'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:36.332862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c3b2d6e3-a829-443c-a97c-82a8a9bad228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97423a05573c41f58abcc1adee847b44', 'request_id': 'req-c3b2d6e3-a829-443c-a97c-82a8a9bad228'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:36.352377 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c3b2d6e3-a829-443c-a97c-82a8a9bad228 admin admin] The token cache is being invalidate because project 97423a05573c41f58abcc1adee847b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:36.352971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c3b2d6e3-a829-443c-a97c-82a8a9bad228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:36.354314 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c3b2d6e3-a829-443c-a97c-82a8a9bad228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:36.360865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 988/1962] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:36 2022] DELETE /identity/v3/projects/97423a05573c41f58abcc1adee847b44 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:36.362662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1b196-b10d-4248-8a35-52fe3d1a1d00 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:36.363131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1b196-b10d-4248-8a35-52fe3d1a1d00 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:36.363704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1b196-b10d-4248-8a35-52fe3d1a1d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:36.397774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:36.403750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a940150-e6b1-4fe3-8fea-c3a27d9f102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:36.406512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a940150-e6b1-4fe3-8fea-c3a27d9f102e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:36.406512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a940150-e6b1-4fe3-8fea-c3a27d9f102e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:36.406793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a940150-e6b1-4fe3-8fea-c3a27d9f102e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:36.407438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a940150-e6b1-4fe3-8fea-c3a27d9f102e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:36.410403 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a940150-e6b1-4fe3-8fea-c3a27d9f102e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:36.410808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-82f1b196-b10d-4248-8a35-52fe3d1a1d00 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:36.416595 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-82f1b196-b10d-4248-8a35-52fe3d1a1d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:36.426899 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 975/1963] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:36.431130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a940150-e6b1-4fe3-8fea-c3a27d9f102e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:36.434551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 989/1964] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:36.435270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0a940150-e6b1-4fe3-8fea-c3a27d9f102e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:36.442965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44090c4-c6c7-47b4-8b5f-a5ae878db8ee None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:36.443260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44090c4-c6c7-47b4-8b5f-a5ae878db8ee None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:36.443538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44090c4-c6c7-47b4-8b5f-a5ae878db8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:36.463713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a940150-e6b1-4fe3-8fea-c3a27d9f102e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:36.475097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869251e4-04b9-423c-8478-3890c96a71a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:36.478039 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869251e4-04b9-423c-8478-3890c96a71a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:36.478732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869251e4-04b9-423c-8478-3890c96a71a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:36.479382 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869251e4-04b9-423c-8478-3890c96a71a2 admin admin] PATH_INFO: `/v3/projects/d128cc5b2a55431a934341c1015b12e5/users/0d76ffdd74df41bd89c380798be621a0/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:36.500283 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a44090c4-c6c7-47b4-8b5f-a5ae878db8ee None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:36.501503 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a44090c4-c6c7-47b4-8b5f-a5ae878db8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:36.511878 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 990/1965] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:36.513110 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869251e4-04b9-423c-8478-3890c96a71a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d128cc5b2a55431a934341c1015b12e5, user_id=0d76ffdd74df41bd89c380798be621a0, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:36.517723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44090c4-c6c7-47b4-8b5f-a5ae878db8ee None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:36.520731 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869251e4-04b9-423c-8478-3890c96a71a2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:36.536233 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44090c4-c6c7-47b4-8b5f-a5ae878db8ee None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:36.557794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 976/1966] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:36 2022] PUT /identity/v3/projects/d128cc5b2a55431a934341c1015b12e5/users/0d76ffdd74df41bd89c380798be621a0/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:36.558913 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869251e4-04b9-423c-8478-3890c96a71a2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:36.560733 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-869251e4-04b9-423c-8478-3890c96a71a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:36.633915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2866643-d538-4972-a4e4-9e4bbbeb112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:36.634923 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:36.635149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866643-d538-4972-a4e4-9e4bbbeb112b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:36.635806 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866643-d538-4972-a4e4-9e4bbbeb112b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:36.636184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866643-d538-4972-a4e4-9e4bbbeb112b admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:36.636990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2866643-d538-4972-a4e4-9e4bbbeb112b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:36.637303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2866643-d538-4972-a4e4-9e4bbbeb112b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:36.639246 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2866643-d538-4972-a4e4-9e4bbbeb112b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:36.660584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 991/1967] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:10:36.662210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89391e2-ac76-44ad-b64d-59d90f480ef5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:36.662644 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89391e2-ac76-44ad-b64d-59d90f480ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:36.663099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89391e2-ac76-44ad-b64d-59d90f480ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:36.669510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869251e4-04b9-423c-8478-3890c96a71a2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:36.674991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:36.675727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:36.676093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:36.676439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6 admin admin] PATH_INFO: `/v3/projects/2ee9b51ccf52442ca066a2f7b63cf808` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:36.677650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee9b51ccf52442ca066a2f7b63cf808)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:36.679744 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:36.683826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c89391e2-ac76-44ad-b64d-59d90f480ef5 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:36.685187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c89391e2-ac76-44ad-b64d-59d90f480ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:36.697932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 992/1968] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:36.701320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89391e2-ac76-44ad-b64d-59d90f480ef5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:36.710669 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89391e2-ac76-44ad-b64d-59d90f480ef5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:36.717230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fee1d-70b6-4f3a-82de-29cc7983588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:36.717867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fee1d-70b6-4f3a-82de-29cc7983588c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:36.718148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fee1d-70b6-4f3a-82de-29cc7983588c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:36.719582 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fee1d-70b6-4f3a-82de-29cc7983588c admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:36.720556 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fee1d-70b6-4f3a-82de-29cc7983588c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:36.723270 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fee1d-70b6-4f3a-82de-29cc7983588c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:36.771649 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 993/1969] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:36 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:36.772560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fee1d-70b6-4f3a-82de-29cc7983588c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:36.782614 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-241fee1d-70b6-4f3a-82de-29cc7983588c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:36.794102 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee9b51ccf52442ca066a2f7b63cf808', 'request_id': 'req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:36.801915 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee9b51ccf52442ca066a2f7b63cf808', 'request_id': 'req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:36.808075 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee9b51ccf52442ca066a2f7b63cf808', 'request_id': 'req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:36.823576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6 admin admin] The token cache is being invalidate because project 2ee9b51ccf52442ca066a2f7b63cf808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:36.824277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:36.824779 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:36.826545 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 977/1970] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:36 2022] DELETE /identity/v3/projects/2ee9b51ccf52442ca066a2f7b63cf808 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:36.827112 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:36.833038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:36.865081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fee1d-70b6-4f3a-82de-29cc7983588c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:36.870317 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ff3e4-f5b2-4162-a9aa-06b3bd632bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:36.870946 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ff3e4-f5b2-4162-a9aa-06b3bd632bac service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:36.871573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ff3e4-f5b2-4162-a9aa-06b3bd632bac service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:36.871573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ff3e4-f5b2-4162-a9aa-06b3bd632bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:36.873305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1d0ff3e4-f5b2-4162-a9aa-06b3bd632bac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:36.952686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f2d5d-2477-4f33-b826-d01a7689d2a6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:36.997952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ff3e4-f5b2-4162-a9aa-06b3bd632bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:36.999416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ff3e4-f5b2-4162-a9aa-06b3bd632bac service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:37.012398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 994/1971] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:37.013637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ff3e4-f5b2-4162-a9aa-06b3bd632bac service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:37.015147 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1d0ff3e4-f5b2-4162-a9aa-06b3bd632bac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:37.041728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ff3e4-f5b2-4162-a9aa-06b3bd632bac service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:37.049735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc0b8d-3ab9-420c-ad09-b24cdf96f061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:37.050409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc0b8d-3ab9-420c-ad09-b24cdf96f061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:37.050727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc0b8d-3ab9-420c-ad09-b24cdf96f061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:37.051017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc0b8d-3ab9-420c-ad09-b24cdf96f061 admin admin] PATH_INFO: `/v3/users/f1ec391c855f4f13964c57391b00dc85` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:37.052313 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc0b8d-3ab9-420c-ad09-b24cdf96f061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1ec391c855f4f13964c57391b00dc85)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:37.054552 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc0b8d-3ab9-420c-ad09-b24cdf96f061 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:37.057756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:37.070589 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e9f40-051d-431e-aacf-26fcec0cd610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:37.071222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e9f40-051d-431e-aacf-26fcec0cd610 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:37.071507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e9f40-051d-431e-aacf-26fcec0cd610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:37.072280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e9f40-051d-431e-aacf-26fcec0cd610 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:37.072944 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e9f40-051d-431e-aacf-26fcec0cd610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:37.074964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e9f40-051d-431e-aacf-26fcec0cd610 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:37.158007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 978/1972] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:36 2022] POST /identity/v3/users => generated 290 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:37.158199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93bc0b8d-3ab9-420c-ad09-b24cdf96f061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1ec391c855f4f13964c57391b00dc85'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:37.159763 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e9f40-051d-431e-aacf-26fcec0cd610 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:37.173714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e9f40-051d-431e-aacf-26fcec0cd610 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:37.177416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93bc0b8d-3ab9-420c-ad09-b24cdf96f061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1ec391c855f4f13964c57391b00dc85'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:37.188882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93bc0b8d-3ab9-420c-ad09-b24cdf96f061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1ec391c855f4f13964c57391b00dc85'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:37.189667 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93bc0b8d-3ab9-420c-ad09-b24cdf96f061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1ec391c855f4f13964c57391b00dc85'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:37.193158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d818d0-a3a5-44ea-a1b1-cb5e837873d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:37.195239 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d818d0-a3a5-44ea-a1b1-cb5e837873d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:37.197760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d818d0-a3a5-44ea-a1b1-cb5e837873d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:37.199676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d818d0-a3a5-44ea-a1b1-cb5e837873d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:37.200647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d818d0-a3a5-44ea-a1b1-cb5e837873d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:37.207440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d818d0-a3a5-44ea-a1b1-cb5e837873d0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:37.212218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93bc0b8d-3ab9-420c-ad09-b24cdf96f061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1ec391c855f4f13964c57391b00dc85'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:37.212402 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:37.222846 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 995/1973] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:37 2022] DELETE /identity/v3/users/f1ec391c855f4f13964c57391b00dc85 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:37.238582 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 979/1974] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:37.239330 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc0b8d-3ab9-420c-ad09-b24cdf96f061 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:37.241002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-93bc0b8d-3ab9-420c-ad09-b24cdf96f061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:37.335828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc0b8d-3ab9-420c-ad09-b24cdf96f061 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:37.342550 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefa6da-6663-4fe1-8220-87f32df8ac39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:37.343336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefa6da-6663-4fe1-8220-87f32df8ac39 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:37.344302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefa6da-6663-4fe1-8220-87f32df8ac39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:37.344671 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefa6da-6663-4fe1-8220-87f32df8ac39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:37.345472 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefa6da-6663-4fe1-8220-87f32df8ac39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:37.348091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefa6da-6663-4fe1-8220-87f32df8ac39 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:37.366808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d818d0-a3a5-44ea-a1b1-cb5e837873d0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:37.378136 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 996/1975] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:37.380756 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d818d0-a3a5-44ea-a1b1-cb5e837873d0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:37.386164 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619bc8-8e0f-4921-ac53-5b0668dfb966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:37.386952 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619bc8-8e0f-4921-ac53-5b0668dfb966 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:37.387330 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619bc8-8e0f-4921-ac53-5b0668dfb966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:37.387703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619bc8-8e0f-4921-ac53-5b0668dfb966 admin admin] PATH_INFO: `/v3/projects/779fe4e784f74d98916063169c6c57ba/users/cd60688d15e1443f9b442284a5a27bdc/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:37.413030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98619bc8-8e0f-4921-ac53-5b0668dfb966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779fe4e784f74d98916063169c6c57ba, user_id=cd60688d15e1443f9b442284a5a27bdc, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:37.418905 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98619bc8-8e0f-4921-ac53-5b0668dfb966 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:37.441668 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 980/1976] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:37 2022] PUT /identity/v3/projects/779fe4e784f74d98916063169c6c57ba/users/cd60688d15e1443f9b442284a5a27bdc/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:37.452692 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b94ca8-5815-4e3f-8ae8-de86f1498f2d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:37.453523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b94ca8-5815-4e3f-8ae8-de86f1498f2d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:37.453803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b94ca8-5815-4e3f-8ae8-de86f1498f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:37.529876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e2b94ca8-5815-4e3f-8ae8-de86f1498f2d None None] MFA Rules not processed for user `cd60688d15e1443f9b442284a5a27bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:37.532187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e2b94ca8-5815-4e3f-8ae8-de86f1498f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:37.681618 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 997/1977] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:37.685883 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619bc8-8e0f-4921-ac53-5b0668dfb966 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:37.805810 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619bc8-8e0f-4921-ac53-5b0668dfb966 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:37.811615 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c28d5-5daf-4c0a-a8e1-3a2e825f0af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:37.812293 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c28d5-5daf-4c0a-a8e1-3a2e825f0af1 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:37.812571 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c28d5-5daf-4c0a-a8e1-3a2e825f0af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:37.812840 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c28d5-5daf-4c0a-a8e1-3a2e825f0af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:37.813494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c28d5-5daf-4c0a-a8e1-3a2e825f0af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:37.815690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c28d5-5daf-4c0a-a8e1-3a2e825f0af1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:37.852713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 981/1978] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:37 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:37.856984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b94ca8-5815-4e3f-8ae8-de86f1498f2d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:37.875935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b94ca8-5815-4e3f-8ae8-de86f1498f2d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:37.883118 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:37.981284 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c688a2-ccbe-4f22-9b75-20a9a7113557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:37.982043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c688a2-ccbe-4f22-9b75-20a9a7113557 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:37.982389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c688a2-ccbe-4f22-9b75-20a9a7113557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:37.982728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c688a2-ccbe-4f22-9b75-20a9a7113557 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:37.983471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c688a2-ccbe-4f22-9b75-20a9a7113557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:37.986078 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c688a2-ccbe-4f22-9b75-20a9a7113557 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:38.026684 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 998/1979] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:37 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:10:38.030623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c28d5-5daf-4c0a-a8e1-3a2e825f0af1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:38.069769 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c28d5-5daf-4c0a-a8e1-3a2e825f0af1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:38.097657 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d1459-ab9c-41e7-957c-ec00c9dcda26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:38.098310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d1459-ab9c-41e7-957c-ec00c9dcda26 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:38.098591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d1459-ab9c-41e7-957c-ec00c9dcda26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:38.098867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d1459-ab9c-41e7-957c-ec00c9dcda26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:38.099542 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d1459-ab9c-41e7-957c-ec00c9dcda26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:38.101193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d1459-ab9c-41e7-957c-ec00c9dcda26 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:38.136160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 982/1980] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:38.137990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c688a2-ccbe-4f22-9b75-20a9a7113557 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:38.154804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c688a2-ccbe-4f22-9b75-20a9a7113557 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:38.161161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c894e-f3af-4e2d-a447-7ef649dbb960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:38.161791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c894e-f3af-4e2d-a447-7ef649dbb960 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:38.162071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c894e-f3af-4e2d-a447-7ef649dbb960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:38.162357 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c894e-f3af-4e2d-a447-7ef649dbb960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:38.162983 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c894e-f3af-4e2d-a447-7ef649dbb960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:38.164655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c894e-f3af-4e2d-a447-7ef649dbb960 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:38.177790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 999/1981] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:38.182162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d1459-ab9c-41e7-957c-ec00c9dcda26 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:38.197033 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d1459-ab9c-41e7-957c-ec00c9dcda26 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:38.203270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e732be-7cbd-4fa2-918d-84de7996a497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:38.209209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e732be-7cbd-4fa2-918d-84de7996a497 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:38.209644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e732be-7cbd-4fa2-918d-84de7996a497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:38.209980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e732be-7cbd-4fa2-918d-84de7996a497 admin admin] PATH_INFO: `/v3/projects/2e5a41f64fc244c089da0011d3f58bcf/users/644ae3c4254e4671a0a4da65167be4d1/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:38.238716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e732be-7cbd-4fa2-918d-84de7996a497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5a41f64fc244c089da0011d3f58bcf, user_id=644ae3c4254e4671a0a4da65167be4d1, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:38.242850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e732be-7cbd-4fa2-918d-84de7996a497 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:38.268015 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 983/1982] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:38 2022] PUT /identity/v3/projects/2e5a41f64fc244c089da0011d3f58bcf/users/644ae3c4254e4671a0a4da65167be4d1/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:38.280704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56b1d1-c9fa-45bf-899b-20a650563db2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:38.281755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56b1d1-c9fa-45bf-899b-20a650563db2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:38.282300 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56b1d1-c9fa-45bf-899b-20a650563db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:38.331427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8f56b1d1-c9fa-45bf-899b-20a650563db2 None None] MFA Rules not processed for user `644ae3c4254e4671a0a4da65167be4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:38.332885 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8f56b1d1-c9fa-45bf-899b-20a650563db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:38.378743 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e732be-7cbd-4fa2-918d-84de7996a497 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:38.382752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-26e732be-7cbd-4fa2-918d-84de7996a497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:38.495087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1000/1983] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:38.501282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56b1d1-c9fa-45bf-899b-20a650563db2 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:38.508095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e732be-7cbd-4fa2-918d-84de7996a497 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:38.516692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c1494-b5b5-41db-b9ed-930d4c103226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:38.520510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c1494-b5b5-41db-b9ed-930d4c103226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:38.521665 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c1494-b5b5-41db-b9ed-930d4c103226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:38.522059 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c1494-b5b5-41db-b9ed-930d4c103226 admin admin] PATH_INFO: `/v3/projects/5b7bb253ef784587aea3742ecca6bebf` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:38.524201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56b1d1-c9fa-45bf-899b-20a650563db2 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:38.524625 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c1494-b5b5-41db-b9ed-930d4c103226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7bb253ef784587aea3742ecca6bebf)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:38.527091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c1494-b5b5-41db-b9ed-930d4c103226 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:38.534627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33897eab-61f5-4fc3-9ae0-b545d181360c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:38.535271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33897eab-61f5-4fc3-9ae0-b545d181360c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:38.535552 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33897eab-61f5-4fc3-9ae0-b545d181360c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:38.535825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33897eab-61f5-4fc3-9ae0-b545d181360c admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:38.536517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33897eab-61f5-4fc3-9ae0-b545d181360c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:38.538684 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33897eab-61f5-4fc3-9ae0-b545d181360c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:38.600541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1001/1984] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:38 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:10:38.604979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33897eab-61f5-4fc3-9ae0-b545d181360c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:38.612399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:38.643915 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b73c1494-b5b5-41db-b9ed-930d4c103226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7bb253ef784587aea3742ecca6bebf', 'request_id': 'req-b73c1494-b5b5-41db-b9ed-930d4c103226'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:38.662214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b73c1494-b5b5-41db-b9ed-930d4c103226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7bb253ef784587aea3742ecca6bebf', 'request_id': 'req-b73c1494-b5b5-41db-b9ed-930d4c103226'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:38.678749 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b73c1494-b5b5-41db-b9ed-930d4c103226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7bb253ef784587aea3742ecca6bebf', 'request_id': 'req-b73c1494-b5b5-41db-b9ed-930d4c103226'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:38.712480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b73c1494-b5b5-41db-b9ed-930d4c103226 admin admin] The token cache is being invalidate because project 5b7bb253ef784587aea3742ecca6bebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:38.713271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b73c1494-b5b5-41db-b9ed-930d4c103226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:38.716015 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b73c1494-b5b5-41db-b9ed-930d4c103226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:38.720120 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 984/1985] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:38 2022] DELETE /identity/v3/projects/5b7bb253ef784587aea3742ecca6bebf => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:38.731557 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef0951-5ee2-4946-9bd3-8e502f47bf70 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:38.732477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef0951-5ee2-4946-9bd3-8e502f47bf70 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:38.732880 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef0951-5ee2-4946-9bd3-8e502f47bf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:38.758606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-feef0951-5ee2-4946-9bd3-8e502f47bf70 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:38.760010 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-feef0951-5ee2-4946-9bd3-8e502f47bf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:38.765248 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:38.792703 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33897eab-61f5-4fc3-9ae0-b545d181360c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:38.875510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 985/1986] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:38.875510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6d405-6782-4084-9b10-922a537a3a84 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:38.875510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6d405-6782-4084-9b10-922a537a3a84 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:38.875510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6d405-6782-4084-9b10-922a537a3a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:38.909484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-cec6d405-6782-4084-9b10-922a537a3a84 None None] MFA Rules not processed for user `0d76ffdd74df41bd89c380798be621a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:38.909937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f859df-891c-4396-b339-b8f5afe5355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:38.910954 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cec6d405-6782-4084-9b10-922a537a3a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:38.911173 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f859df-891c-4396-b339-b8f5afe5355f admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:38.911593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f859df-891c-4396-b339-b8f5afe5355f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:38.912039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f859df-891c-4396-b339-b8f5afe5355f admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:38.913164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f859df-891c-4396-b339-b8f5afe5355f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:38.915590 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f859df-891c-4396-b339-b8f5afe5355f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:38.950083 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1002/1987] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:38 2022] POST /identity/v3/users => generated 296 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:38.952424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f6141-41fa-4383-9392-ca663ca592e3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:38.953619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f6141-41fa-4383-9392-ca663ca592e3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:38.953783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f6141-41fa-4383-9392-ca663ca592e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:39.000561 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-964f6141-41fa-4383-9392-ca663ca592e3 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:39.004055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-964f6141-41fa-4383-9392-ca663ca592e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:39.017265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1003/1988] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:39.021939 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f6141-41fa-4383-9392-ca663ca592e3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:39.023819 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-964f6141-41fa-4383-9392-ca663ca592e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:39.047586 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f6141-41fa-4383-9392-ca663ca592e3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:39.054976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53115c9-60bd-403c-bf50-e4619a72123c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:39.055612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53115c9-60bd-403c-bf50-e4619a72123c admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:39.056710 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53115c9-60bd-403c-bf50-e4619a72123c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:39.056710 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53115c9-60bd-403c-bf50-e4619a72123c admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:39.067784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 986/1989] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:39.069109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53115c9-60bd-403c-bf50-e4619a72123c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:39.070747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53115c9-60bd-403c-bf50-e4619a72123c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:39.071769 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6d405-6782-4084-9b10-922a537a3a84 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:39.088449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6d405-6782-4084-9b10-922a537a3a84 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:39.103940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d5da3-b612-4ad6-bfb9-62b350477944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:39.109111 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d5da3-b612-4ad6-bfb9-62b350477944 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:39.109555 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d5da3-b612-4ad6-bfb9-62b350477944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:39.109988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d5da3-b612-4ad6-bfb9-62b350477944 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:39.111655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d5da3-b612-4ad6-bfb9-62b350477944 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:39.112166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d5da3-b612-4ad6-bfb9-62b350477944 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:39.119105 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d5da3-b612-4ad6-bfb9-62b350477944 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:39.141003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1004/1990] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:39.141208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53115c9-60bd-403c-bf50-e4619a72123c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:39.150391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a53115c9-60bd-403c-bf50-e4619a72123c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:39.152934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 987/1991] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:39.153894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d5da3-b612-4ad6-bfb9-62b350477944 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:39.186791 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d5da3-b612-4ad6-bfb9-62b350477944 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:39.213776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcc243-94ac-413a-ace4-502bf52ff4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:39.214483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcc243-94ac-413a-ace4-502bf52ff4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:39.214766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcc243-94ac-413a-ace4-502bf52ff4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:39.215048 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcc243-94ac-413a-ace4-502bf52ff4d8 admin admin] PATH_INFO: `/v3/projects/385bdcf2e8164c05918555eb0ad93f4d/users/9f5e8f51135940099fa1aa90d5d6278a/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:39.256854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53115c9-60bd-403c-bf50-e4619a72123c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:39.262073 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f15d93-f357-4949-8bfc-fb3897ef6768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:39.263167 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f15d93-f357-4949-8bfc-fb3897ef6768 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:39.263584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f15d93-f357-4949-8bfc-fb3897ef6768 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:39.264200 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f15d93-f357-4949-8bfc-fb3897ef6768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:39.267283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcc243-94ac-413a-ace4-502bf52ff4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385bdcf2e8164c05918555eb0ad93f4d, user_id=9f5e8f51135940099fa1aa90d5d6278a, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:39.270015 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcc243-94ac-413a-ace4-502bf52ff4d8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:39.275312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f15d93-f357-4949-8bfc-fb3897ef6768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:39.277008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f15d93-f357-4949-8bfc-fb3897ef6768 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:39.297778 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 988/1992] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:39 2022] PUT /identity/v3/projects/385bdcf2e8164c05918555eb0ad93f4d/users/9f5e8f51135940099fa1aa90d5d6278a/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:39.298721 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcc243-94ac-413a-ace4-502bf52ff4d8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:39.320693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1005/1993] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:39.334453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f15d93-f357-4949-8bfc-fb3897ef6768 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:39.337403 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:39.377499 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f15d93-f357-4949-8bfc-fb3897ef6768 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:39.461561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcc243-94ac-413a-ace4-502bf52ff4d8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:39.468882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611c6e6-0ebb-4d45-86ef-9d9a9e01be42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:39.470338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611c6e6-0ebb-4d45-86ef-9d9a9e01be42 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:39.470924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611c6e6-0ebb-4d45-86ef-9d9a9e01be42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:39.471397 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611c6e6-0ebb-4d45-86ef-9d9a9e01be42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:39.472284 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611c6e6-0ebb-4d45-86ef-9d9a9e01be42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:39.475157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611c6e6-0ebb-4d45-86ef-9d9a9e01be42 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:39.492068 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd869ce7-6c30-412c-8e8a-9a28213a8e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:39.493638 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd869ce7-6c30-412c-8e8a-9a28213a8e6f admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:39.493937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd869ce7-6c30-412c-8e8a-9a28213a8e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:39.494329 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd869ce7-6c30-412c-8e8a-9a28213a8e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:39.495437 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd869ce7-6c30-412c-8e8a-9a28213a8e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:39.497471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd869ce7-6c30-412c-8e8a-9a28213a8e6f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:39.516382 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1006/1994] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:39.521175 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd869ce7-6c30-412c-8e8a-9a28213a8e6f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:39.553248 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd869ce7-6c30-412c-8e8a-9a28213a8e6f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:39.554923 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 989/1995] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:39 2022] POST /identity/v3/projects => generated 383 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:39.558885 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611c6e6-0ebb-4d45-86ef-9d9a9e01be42 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:39.571126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:39.685100 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a0e5a-0fba-44f7-8f0a-df235e2ad558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:39.685790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a0e5a-0fba-44f7-8f0a-df235e2ad558 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:39.686070 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a0e5a-0fba-44f7-8f0a-df235e2ad558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:39.686347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a0e5a-0fba-44f7-8f0a-df235e2ad558 admin admin] PATH_INFO: `/v3/projects/385bdcf2e8164c05918555eb0ad93f4d/users/9f5e8f51135940099fa1aa90d5d6278a/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:39.688377 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a0e5a-0fba-44f7-8f0a-df235e2ad558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385bdcf2e8164c05918555eb0ad93f4d, user_id=9f5e8f51135940099fa1aa90d5d6278a, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:39.691172 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a0e5a-0fba-44f7-8f0a-df235e2ad558 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:39.713564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1007/1996] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:39 2022] PUT /identity/v3/projects/385bdcf2e8164c05918555eb0ad93f4d/users/9f5e8f51135940099fa1aa90d5d6278a/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:10:39.716759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c6103-192e-4060-9fb9-00bb61e879a4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:39.720765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c6103-192e-4060-9fb9-00bb61e879a4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:39.721240 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c6103-192e-4060-9fb9-00bb61e879a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:39.733661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611c6e6-0ebb-4d45-86ef-9d9a9e01be42 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:39.790039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-872c6103-192e-4060-9fb9-00bb61e879a4 None None] MFA Rules not processed for user `9f5e8f51135940099fa1aa90d5d6278a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:39.791295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-872c6103-192e-4060-9fb9-00bb61e879a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:39.892202 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1008/1997] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:39.896857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bb896-e443-4cfb-9cc3-7b69c505bf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:39.897480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bb896-e443-4cfb-9cc3-7b69c505bf81 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:39.897909 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bb896-e443-4cfb-9cc3-7b69c505bf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:39.898182 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bb896-e443-4cfb-9cc3-7b69c505bf81 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:39.898847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bb896-e443-4cfb-9cc3-7b69c505bf81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:39.900826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bb896-e443-4cfb-9cc3-7b69c505bf81 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:39.929006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c6103-192e-4060-9fb9-00bb61e879a4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:39.942389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 990/1998] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:39 2022] POST /identity/v3/users => generated 292 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:39.943446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bb896-e443-4cfb-9cc3-7b69c505bf81 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:39.960190 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bb896-e443-4cfb-9cc3-7b69c505bf81 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:39.966068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb27c7c-5942-4f71-9dad-14412adfe2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:39.967038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb27c7c-5942-4f71-9dad-14412adfe2cc admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:39.967700 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb27c7c-5942-4f71-9dad-14412adfe2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:39.968075 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb27c7c-5942-4f71-9dad-14412adfe2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:39.969273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb27c7c-5942-4f71-9dad-14412adfe2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:39.971022 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb27c7c-5942-4f71-9dad-14412adfe2cc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:39.999173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 991/1999] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:40.003695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb27c7c-5942-4f71-9dad-14412adfe2cc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:40.007194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c6103-192e-4060-9fb9-00bb61e879a4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:40.019222 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721011d-186f-4912-9996-37bbc0c17026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:40.020794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721011d-186f-4912-9996-37bbc0c17026 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:40.021596 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721011d-186f-4912-9996-37bbc0c17026 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:40.022034 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721011d-186f-4912-9996-37bbc0c17026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:40.022601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb27c7c-5942-4f71-9dad-14412adfe2cc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:40.030435 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299baf9-66bb-431e-87cd-78374c422683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:40.031985 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299baf9-66bb-431e-87cd-78374c422683 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:40.032340 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299baf9-66bb-431e-87cd-78374c422683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:40.032537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299baf9-66bb-431e-87cd-78374c422683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:40.033537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299baf9-66bb-431e-87cd-78374c422683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:40.035580 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299baf9-66bb-431e-87cd-78374c422683 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:40.042946 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721011d-186f-4912-9996-37bbc0c17026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:40.044453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721011d-186f-4912-9996-37bbc0c17026 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:40.050434 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 992/2000] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:40.054371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299baf9-66bb-431e-87cd-78374c422683 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:40.055961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1009/2001] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:40.070713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299baf9-66bb-431e-87cd-78374c422683 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:40.083117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddf618-dae7-4507-97a3-6bd2ca33b662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:40.084306 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddf618-dae7-4507-97a3-6bd2ca33b662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:40.084774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddf618-dae7-4507-97a3-6bd2ca33b662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:40.085168 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddf618-dae7-4507-97a3-6bd2ca33b662 admin admin] PATH_INFO: `/v3/projects/08a6c3b2766949589727077ae8d0afdd/users/46adb82627ea4361b4f66e21ec5a8a85/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:40.091196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:40.112683 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddf618-dae7-4507-97a3-6bd2ca33b662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08a6c3b2766949589727077ae8d0afdd, user_id=46adb82627ea4361b4f66e21ec5a8a85, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:40.114934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721011d-186f-4912-9996-37bbc0c17026 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:40.116564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddf618-dae7-4507-97a3-6bd2ca33b662 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:40.116719 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e721011d-186f-4912-9996-37bbc0c17026 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:40.134112 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721011d-186f-4912-9996-37bbc0c17026 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:40.135790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 993/2002] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:40 2022] PUT /identity/v3/projects/08a6c3b2766949589727077ae8d0afdd/users/46adb82627ea4361b4f66e21ec5a8a85/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:40.147905 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45726f-1ac9-484a-a41a-836b73af0a2e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:40.148222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45726f-1ac9-484a-a41a-836b73af0a2e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:40.148488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45726f-1ac9-484a-a41a-836b73af0a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:40.172972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:40.180651 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5f45726f-1ac9-484a-a41a-836b73af0a2e None None] MFA Rules not processed for user `46adb82627ea4361b4f66e21ec5a8a85`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:40.181911 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5f45726f-1ac9-484a-a41a-836b73af0a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:40.197049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3763c-8831-4698-b4db-4b2593c581dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:40.197670 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3763c-8831-4698-b4db-4b2593c581dd service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:40.198055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3763c-8831-4698-b4db-4b2593c581dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:40.198454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3763c-8831-4698-b4db-4b2593c581dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:40.200185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b4f3763c-8831-4698-b4db-4b2593c581dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:40.276762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 994/2003] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:40.281992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45726f-1ac9-484a-a41a-836b73af0a2e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:40.296743 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3763c-8831-4698-b4db-4b2593c581dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:40.298399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3763c-8831-4698-b4db-4b2593c581dd service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:40.309483 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1010/2004] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:40.378257 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45726f-1ac9-484a-a41a-836b73af0a2e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:40.383889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87725c0-9c62-49b2-9c96-b9392bbd66d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:40.385187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87725c0-9c62-49b2-9c96-b9392bbd66d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:40.385187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87725c0-9c62-49b2-9c96-b9392bbd66d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:40.385187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87725c0-9c62-49b2-9c96-b9392bbd66d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:40.385683 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87725c0-9c62-49b2-9c96-b9392bbd66d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:40.387783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87725c0-9c62-49b2-9c96-b9392bbd66d2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:40.423864 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 995/2005] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:40 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:10:40.427979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3763c-8831-4698-b4db-4b2593c581dd service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:40.442472 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3763c-8831-4698-b4db-4b2593c581dd service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:40.513577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af98ed-826c-4f7d-bd9a-1dac35eef5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:40.514285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af98ed-826c-4f7d-bd9a-1dac35eef5cf admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:40.514546 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af98ed-826c-4f7d-bd9a-1dac35eef5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:40.514815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af98ed-826c-4f7d-bd9a-1dac35eef5cf admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:40.515532 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af98ed-826c-4f7d-bd9a-1dac35eef5cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:40.517525 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af98ed-826c-4f7d-bd9a-1dac35eef5cf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:40.544744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1011/2006] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:40 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:10:40.549701 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87725c0-9c62-49b2-9c96-b9392bbd66d2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:40.573218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87725c0-9c62-49b2-9c96-b9392bbd66d2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:40.580895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef768240-6cfd-4a03-819c-d9131cb93ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:40.581595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef768240-6cfd-4a03-819c-d9131cb93ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:40.581866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef768240-6cfd-4a03-819c-d9131cb93ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:40.582130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef768240-6cfd-4a03-819c-d9131cb93ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:40.582783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef768240-6cfd-4a03-819c-d9131cb93ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:40.584417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef768240-6cfd-4a03-819c-d9131cb93ea1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:40.612672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 996/2007] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:40.614223 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af98ed-826c-4f7d-bd9a-1dac35eef5cf admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:40.631764 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af98ed-826c-4f7d-bd9a-1dac35eef5cf admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:40.637288 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80912026-7180-4331-99ce-1f140c9ef0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:40.638311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80912026-7180-4331-99ce-1f140c9ef0af admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:40.638896 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80912026-7180-4331-99ce-1f140c9ef0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:40.639169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80912026-7180-4331-99ce-1f140c9ef0af admin admin] PATH_INFO: `/v3/projects/57e3745bea2744448eb92eef4688dd29/users/4425af90a26d47c09bf6c179afed1089/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:40.676246 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80912026-7180-4331-99ce-1f140c9ef0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e3745bea2744448eb92eef4688dd29, user_id=4425af90a26d47c09bf6c179afed1089, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:40.678978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80912026-7180-4331-99ce-1f140c9ef0af admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:40.699996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1012/2008] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:40 2022] PUT /identity/v3/projects/57e3745bea2744448eb92eef4688dd29/users/4425af90a26d47c09bf6c179afed1089/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:10:40.703073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef768240-6cfd-4a03-819c-d9131cb93ea1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:40.732214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef768240-6cfd-4a03-819c-d9131cb93ea1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:40.797158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:40.816113 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7b59c-fe45-43d6-b009-0d94a8656ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:40.816750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7b59c-fe45-43d6-b009-0d94a8656ead admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:40.817034 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7b59c-fe45-43d6-b009-0d94a8656ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:40.817365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7b59c-fe45-43d6-b009-0d94a8656ead admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:40.817968 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7b59c-fe45-43d6-b009-0d94a8656ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:40.819547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7b59c-fe45-43d6-b009-0d94a8656ead admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:40.833838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 997/2009] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:40.835054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80912026-7180-4331-99ce-1f140c9ef0af admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:40.846927 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80912026-7180-4331-99ce-1f140c9ef0af admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:40.851923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b4082-f148-45e0-ab5a-d0918f4c6208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:40.853201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b4082-f148-45e0-ab5a-d0918f4c6208 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:40.853201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b4082-f148-45e0-ab5a-d0918f4c6208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:40.853410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b4082-f148-45e0-ab5a-d0918f4c6208 admin admin] PATH_INFO: `/v3/projects/57e3745bea2744448eb92eef4688dd29/users/4425af90a26d47c09bf6c179afed1089/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:40.855440 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b4082-f148-45e0-ab5a-d0918f4c6208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e3745bea2744448eb92eef4688dd29, user_id=4425af90a26d47c09bf6c179afed1089, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:40.858184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b4082-f148-45e0-ab5a-d0918f4c6208 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:40.870581 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1013/2010] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:40 2022] PUT /identity/v3/projects/57e3745bea2744448eb92eef4688dd29/users/4425af90a26d47c09bf6c179afed1089/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:40.880721 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb676013-242d-4e28-b4ed-245044e23622 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:40.881010 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb676013-242d-4e28-b4ed-245044e23622 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:40.881575 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb676013-242d-4e28-b4ed-245044e23622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:40.912372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-eb676013-242d-4e28-b4ed-245044e23622 None None] MFA Rules not processed for user `4425af90a26d47c09bf6c179afed1089`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:40.913584 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-eb676013-242d-4e28-b4ed-245044e23622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:41.004768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0b1e7-4004-483a-982f-0e81b5c9b704 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:41.005057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0b1e7-4004-483a-982f-0e81b5c9b704 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:41.005332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0b1e7-4004-483a-982f-0e81b5c9b704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:41.021635 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 998/2011] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:41.032568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-34f0b1e7-4004-483a-982f-0e81b5c9b704 None None] MFA Rules not processed for user `0d76ffdd74df41bd89c380798be621a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:41.034039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-34f0b1e7-4004-483a-982f-0e81b5c9b704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:41.040606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb676013-242d-4e28-b4ed-245044e23622 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:41.094160 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:41.123468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1014/2012] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:41.149490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb676013-242d-4e28-b4ed-245044e23622 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:41.153461 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcadbb-c69b-4696-a38b-70d54420dbb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:41.153977 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcadbb-c69b-4696-a38b-70d54420dbb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:41.154248 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcadbb-c69b-4696-a38b-70d54420dbb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:41.154513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcadbb-c69b-4696-a38b-70d54420dbb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:41.240421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcadbb-c69b-4696-a38b-70d54420dbb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:41.245872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcadbb-c69b-4696-a38b-70d54420dbb1 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:41.255620 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 999/2013] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:43.722180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0b1e7-4004-483a-982f-0e81b5c9b704 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:43.801904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0b1e7-4004-483a-982f-0e81b5c9b704 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:43.807275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3ffa-1ebd-4b3c-8474-62bcc9fd7098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:43.807935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3ffa-1ebd-4b3c-8474-62bcc9fd7098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:43.808257 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3ffa-1ebd-4b3c-8474-62bcc9fd7098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:43.808567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3ffa-1ebd-4b3c-8474-62bcc9fd7098 admin admin] PATH_INFO: `/v3/users/cd60688d15e1443f9b442284a5a27bdc` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:43.809723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee3ffa-1ebd-4b3c-8474-62bcc9fd7098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd60688d15e1443f9b442284a5a27bdc)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:43.811848 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee3ffa-1ebd-4b3c-8474-62bcc9fd7098 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:43.885899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-06ee3ffa-1ebd-4b3c-8474-62bcc9fd7098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd60688d15e1443f9b442284a5a27bdc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:43.895667 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-06ee3ffa-1ebd-4b3c-8474-62bcc9fd7098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd60688d15e1443f9b442284a5a27bdc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:43.910333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-06ee3ffa-1ebd-4b3c-8474-62bcc9fd7098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd60688d15e1443f9b442284a5a27bdc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:43.911126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-06ee3ffa-1ebd-4b3c-8474-62bcc9fd7098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd60688d15e1443f9b442284a5a27bdc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:43.934480 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-06ee3ffa-1ebd-4b3c-8474-62bcc9fd7098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd60688d15e1443f9b442284a5a27bdc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:43.941383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1015/2014] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:43 2022] DELETE /identity/v3/users/cd60688d15e1443f9b442284a5a27bdc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:43.946527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ac9ee-6768-490a-826d-7f6ff43e7277 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:43.946998 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ac9ee-6768-490a-826d-7f6ff43e7277 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:43.947102 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ac9ee-6768-490a-826d-7f6ff43e7277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:43.974453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9f7ac9ee-6768-490a-826d-7f6ff43e7277 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:43.974723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9f7ac9ee-6768-490a-826d-7f6ff43e7277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:44.015900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:44.080305 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1000/2015] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:44.098663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3ffa-1ebd-4b3c-8474-62bcc9fd7098 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:44.100172 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-06ee3ffa-1ebd-4b3c-8474-62bcc9fd7098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:44.192887 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3ffa-1ebd-4b3c-8474-62bcc9fd7098 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:44.200462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f29e67-7293-471e-b019-cb525c0a66d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:44.201507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f29e67-7293-471e-b019-cb525c0a66d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:44.202002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f29e67-7293-471e-b019-cb525c0a66d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:44.202494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f29e67-7293-471e-b019-cb525c0a66d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:44.215437 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f29e67-7293-471e-b019-cb525c0a66d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:44.217501 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f29e67-7293-471e-b019-cb525c0a66d3 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:44.233541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1016/2016] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:45.216426 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ac9ee-6768-490a-826d-7f6ff43e7277 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:45.218711 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9f7ac9ee-6768-490a-826d-7f6ff43e7277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:45.239639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ac9ee-6768-490a-826d-7f6ff43e7277 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:45.246312 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76733e48-4f1c-4d37-bd70-d035ebf21917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:45.247834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76733e48-4f1c-4d37-bd70-d035ebf21917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:45.247834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76733e48-4f1c-4d37-bd70-d035ebf21917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:45.247834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76733e48-4f1c-4d37-bd70-d035ebf21917 admin admin] PATH_INFO: `/v3/projects/779fe4e784f74d98916063169c6c57ba` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:45.249121 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76733e48-4f1c-4d37-bd70-d035ebf21917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=779fe4e784f74d98916063169c6c57ba)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:45.252537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76733e48-4f1c-4d37-bd70-d035ebf21917 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:45.310135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-76733e48-4f1c-4d37-bd70-d035ebf21917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779fe4e784f74d98916063169c6c57ba', 'request_id': 'req-76733e48-4f1c-4d37-bd70-d035ebf21917'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:45.318592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-76733e48-4f1c-4d37-bd70-d035ebf21917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779fe4e784f74d98916063169c6c57ba', 'request_id': 'req-76733e48-4f1c-4d37-bd70-d035ebf21917'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:45.325563 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-76733e48-4f1c-4d37-bd70-d035ebf21917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779fe4e784f74d98916063169c6c57ba', 'request_id': 'req-76733e48-4f1c-4d37-bd70-d035ebf21917'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:45.346936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-76733e48-4f1c-4d37-bd70-d035ebf21917 admin admin] The token cache is being invalidate because project 779fe4e784f74d98916063169c6c57ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:45.347568 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-76733e48-4f1c-4d37-bd70-d035ebf21917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:45.348273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-76733e48-4f1c-4d37-bd70-d035ebf21917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:45.350136 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1001/2017] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:45 2022] DELETE /identity/v3/projects/779fe4e784f74d98916063169c6c57ba => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:45.353931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f29e67-7293-471e-b019-cb525c0a66d3 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:45.365161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f29e67-7293-471e-b019-cb525c0a66d3 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:45.370279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:45.470640 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a406a4-0afd-4d28-8f7f-06447563eaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:45.471702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a406a4-0afd-4d28-8f7f-06447563eaa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:45.471702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a406a4-0afd-4d28-8f7f-06447563eaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:45.471887 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a406a4-0afd-4d28-8f7f-06447563eaa2 admin admin] PATH_INFO: `/v3/users/644ae3c4254e4671a0a4da65167be4d1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:45.472990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a406a4-0afd-4d28-8f7f-06447563eaa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=644ae3c4254e4671a0a4da65167be4d1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:45.475081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a406a4-0afd-4d28-8f7f-06447563eaa2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:45.551627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b8a406a4-0afd-4d28-8f7f-06447563eaa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '644ae3c4254e4671a0a4da65167be4d1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:45.561800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b8a406a4-0afd-4d28-8f7f-06447563eaa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '644ae3c4254e4671a0a4da65167be4d1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:45.577153 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b8a406a4-0afd-4d28-8f7f-06447563eaa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '644ae3c4254e4671a0a4da65167be4d1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:45.577825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b8a406a4-0afd-4d28-8f7f-06447563eaa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '644ae3c4254e4671a0a4da65167be4d1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:45.606802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b8a406a4-0afd-4d28-8f7f-06447563eaa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '644ae3c4254e4671a0a4da65167be4d1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:45.624014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1017/2018] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:45 2022] DELETE /identity/v3/users/644ae3c4254e4671a0a4da65167be4d1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:10:46.026130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76733e48-4f1c-4d37-bd70-d035ebf21917 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:46.027880 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-76733e48-4f1c-4d37-bd70-d035ebf21917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:46.148115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76733e48-4f1c-4d37-bd70-d035ebf21917 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:46.219145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dc625-f1a3-4891-9260-1846aee1da76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:46.221184 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dc625-f1a3-4891-9260-1846aee1da76 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:46.221477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dc625-f1a3-4891-9260-1846aee1da76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:46.221795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dc625-f1a3-4891-9260-1846aee1da76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:46.223677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e24dc625-f1a3-4891-9260-1846aee1da76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:46.240305 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:46.303769 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dc625-f1a3-4891-9260-1846aee1da76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:46.305321 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dc625-f1a3-4891-9260-1846aee1da76 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:46.309749 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a406a4-0afd-4d28-8f7f-06447563eaa2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:46.311296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b8a406a4-0afd-4d28-8f7f-06447563eaa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:46.346104 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1002/2019] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:46.412628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a406a4-0afd-4d28-8f7f-06447563eaa2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:46.426943 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c24f2-99ef-4307-a42c-6196ecaa6715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:46.427619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c24f2-99ef-4307-a42c-6196ecaa6715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:46.427899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c24f2-99ef-4307-a42c-6196ecaa6715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:46.428239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c24f2-99ef-4307-a42c-6196ecaa6715 admin admin] PATH_INFO: `/v3/projects/2e5a41f64fc244c089da0011d3f58bcf` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:46.429642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c24f2-99ef-4307-a42c-6196ecaa6715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5a41f64fc244c089da0011d3f58bcf)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:46.431864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c24f2-99ef-4307-a42c-6196ecaa6715 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:46.483067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:46.514313 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a85c24f2-99ef-4307-a42c-6196ecaa6715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5a41f64fc244c089da0011d3f58bcf', 'request_id': 'req-a85c24f2-99ef-4307-a42c-6196ecaa6715'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:46.524187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a85c24f2-99ef-4307-a42c-6196ecaa6715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5a41f64fc244c089da0011d3f58bcf', 'request_id': 'req-a85c24f2-99ef-4307-a42c-6196ecaa6715'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:46.535391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a85c24f2-99ef-4307-a42c-6196ecaa6715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5a41f64fc244c089da0011d3f58bcf', 'request_id': 'req-a85c24f2-99ef-4307-a42c-6196ecaa6715'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:46.553056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a85c24f2-99ef-4307-a42c-6196ecaa6715 admin admin] The token cache is being invalidate because project 2e5a41f64fc244c089da0011d3f58bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:46.553445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a85c24f2-99ef-4307-a42c-6196ecaa6715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:46.554193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a85c24f2-99ef-4307-a42c-6196ecaa6715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:46.556986 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1018/2020] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:46 2022] DELETE /identity/v3/projects/2e5a41f64fc244c089da0011d3f58bcf => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:10:46.561603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dc625-f1a3-4891-9260-1846aee1da76 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:46.577074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dc625-f1a3-4891-9260-1846aee1da76 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:46.686484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737bca3-dbb9-4d17-8831-ca31ac975030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:46.687833 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737bca3-dbb9-4d17-8831-ca31ac975030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:46.688299 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737bca3-dbb9-4d17-8831-ca31ac975030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:46.688652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737bca3-dbb9-4d17-8831-ca31ac975030 admin admin] PATH_INFO: `/v3/users/9f5e8f51135940099fa1aa90d5d6278a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:46.690096 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737bca3-dbb9-4d17-8831-ca31ac975030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f5e8f51135940099fa1aa90d5d6278a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:46.692849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737bca3-dbb9-4d17-8831-ca31ac975030 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:46.758181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f737bca3-dbb9-4d17-8831-ca31ac975030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f5e8f51135940099fa1aa90d5d6278a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:46.774656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f737bca3-dbb9-4d17-8831-ca31ac975030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f5e8f51135940099fa1aa90d5d6278a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:46.789770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f737bca3-dbb9-4d17-8831-ca31ac975030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f5e8f51135940099fa1aa90d5d6278a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:46.790922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f737bca3-dbb9-4d17-8831-ca31ac975030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f5e8f51135940099fa1aa90d5d6278a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:46.791497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f737bca3-dbb9-4d17-8831-ca31ac975030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f5e8f51135940099fa1aa90d5d6278a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:46.839035 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1003/2021] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:46 2022] DELETE /identity/v3/users/9f5e8f51135940099fa1aa90d5d6278a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:47.248006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c24f2-99ef-4307-a42c-6196ecaa6715 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:47.250050 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a85c24f2-99ef-4307-a42c-6196ecaa6715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:47.267560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c24f2-99ef-4307-a42c-6196ecaa6715 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:47.371318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b4758-4c0f-41ea-8232-68c87dc29505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:47.372071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4758-4c0f-41ea-8232-68c87dc29505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:47.372529 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4758-4c0f-41ea-8232-68c87dc29505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:47.372961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4758-4c0f-41ea-8232-68c87dc29505 admin admin] PATH_INFO: `/v3/projects/385bdcf2e8164c05918555eb0ad93f4d` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:47.374423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b4758-4c0f-41ea-8232-68c87dc29505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=385bdcf2e8164c05918555eb0ad93f4d)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:47.376783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b4758-4c0f-41ea-8232-68c87dc29505 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:47.449830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5c2b4758-4c0f-41ea-8232-68c87dc29505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385bdcf2e8164c05918555eb0ad93f4d', 'request_id': 'req-5c2b4758-4c0f-41ea-8232-68c87dc29505'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:47.460341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5c2b4758-4c0f-41ea-8232-68c87dc29505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385bdcf2e8164c05918555eb0ad93f4d', 'request_id': 'req-5c2b4758-4c0f-41ea-8232-68c87dc29505'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:47.473784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5c2b4758-4c0f-41ea-8232-68c87dc29505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385bdcf2e8164c05918555eb0ad93f4d', 'request_id': 'req-5c2b4758-4c0f-41ea-8232-68c87dc29505'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:47.493576 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5c2b4758-4c0f-41ea-8232-68c87dc29505 admin admin] The token cache is being invalidate because project 385bdcf2e8164c05918555eb0ad93f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:47.493867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5c2b4758-4c0f-41ea-8232-68c87dc29505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:47.494572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5c2b4758-4c0f-41ea-8232-68c87dc29505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:47.496236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1019/2022] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:47 2022] DELETE /identity/v3/projects/385bdcf2e8164c05918555eb0ad93f4d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:47.502568 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598be4dc-bc7a-4da4-ab97-038eb125c755 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:47.503041 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598be4dc-bc7a-4da4-ab97-038eb125c755 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:47.503150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598be4dc-bc7a-4da4-ab97-038eb125c755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:47.532048 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-598be4dc-bc7a-4da4-ab97-038eb125c755 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:47.533657 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-598be4dc-bc7a-4da4-ab97-038eb125c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:47.563904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:47.601667 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1004/2023] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:47.610878 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1267c5-bd74-44ce-855c-87cf06320bec None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:47.611403 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1267c5-bd74-44ce-855c-87cf06320bec None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:47.611781 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1267c5-bd74-44ce-855c-87cf06320bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:47.634058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ba1267c5-bd74-44ce-855c-87cf06320bec None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:47.634831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ba1267c5-bd74-44ce-855c-87cf06320bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:47.646845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1020/2024] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:47.651581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598be4dc-bc7a-4da4-ab97-038eb125c755 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:47.660969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598be4dc-bc7a-4da4-ab97-038eb125c755 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:47.666313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ab06a-b920-4570-951e-d7b2c942d5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:47.667151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ab06a-b920-4570-951e-d7b2c942d5cf admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:47.667581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ab06a-b920-4570-951e-d7b2c942d5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:47.667850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ab06a-b920-4570-951e-d7b2c942d5cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:47.668594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ab06a-b920-4570-951e-d7b2c942d5cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:47.668889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ab06a-b920-4570-951e-d7b2c942d5cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:47.676426 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ab06a-b920-4570-951e-d7b2c942d5cf admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:47.696963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1005/2025] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:47.697456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1267c5-bd74-44ce-855c-87cf06320bec None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:47.713821 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1267c5-bd74-44ce-855c-87cf06320bec None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:47.721128 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7002db-c97b-45fe-a69b-3873b8b2b866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:47.722147 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7002db-c97b-45fe-a69b-3873b8b2b866 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:47.722437 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7002db-c97b-45fe-a69b-3873b8b2b866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:47.722900 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7002db-c97b-45fe-a69b-3873b8b2b866 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:47.730484 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7002db-c97b-45fe-a69b-3873b8b2b866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:47.732650 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7002db-c97b-45fe-a69b-3873b8b2b866 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:47.783348 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1021/2026] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:47 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:10:47.789821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ab06a-b920-4570-951e-d7b2c942d5cf admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:47.801920 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ab06a-b920-4570-951e-d7b2c942d5cf admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:47.903166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e164a-871a-42fd-81f4-42885b3914e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:47.903805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e164a-871a-42fd-81f4-42885b3914e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:47.904106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e164a-871a-42fd-81f4-42885b3914e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:47.904382 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e164a-871a-42fd-81f4-42885b3914e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:47.906597 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e164a-871a-42fd-81f4-42885b3914e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:47.910913 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e164a-871a-42fd-81f4-42885b3914e4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:47.950561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1006/2027] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:47 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:47.950967 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7002db-c97b-45fe-a69b-3873b8b2b866 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:47.964911 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7002db-c97b-45fe-a69b-3873b8b2b866 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:47.972908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f1fbb-b54e-488f-9ac2-043c3796fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:47.973385 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f1fbb-b54e-488f-9ac2-043c3796fa20 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:47.973665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f1fbb-b54e-488f-9ac2-043c3796fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:47.973934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f1fbb-b54e-488f-9ac2-043c3796fa20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:47.974577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f1fbb-b54e-488f-9ac2-043c3796fa20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:47.976367 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f1fbb-b54e-488f-9ac2-043c3796fa20 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:47.994997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1022/2028] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:47.999985 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e164a-871a-42fd-81f4-42885b3914e4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:48.011831 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e164a-871a-42fd-81f4-42885b3914e4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:48.016725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b30e9-a157-465f-a65e-864eea449efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:48.017359 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b30e9-a157-465f-a65e-864eea449efb admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.017635 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b30e9-a157-465f-a65e-864eea449efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.017901 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b30e9-a157-465f-a65e-864eea449efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.018710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b30e9-a157-465f-a65e-864eea449efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:48.020543 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b30e9-a157-465f-a65e-864eea449efb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:48.040003 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1007/2029] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:48.040463 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f1fbb-b54e-488f-9ac2-043c3796fa20 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:48.050862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f1fbb-b54e-488f-9ac2-043c3796fa20 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:48.056430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13288fc0-7377-4576-9279-8d52b15a9060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:48.057301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13288fc0-7377-4576-9279-8d52b15a9060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.057585 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13288fc0-7377-4576-9279-8d52b15a9060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.057885 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13288fc0-7377-4576-9279-8d52b15a9060 admin admin] PATH_INFO: `/v3/projects/59b70f50bccc4b88b57c9d8260ef2118/users/21b7869d3785441f94c3ead92c482a19/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.060484 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:48.097061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13288fc0-7377-4576-9279-8d52b15a9060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b70f50bccc4b88b57c9d8260ef2118, user_id=21b7869d3785441f94c3ead92c482a19, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:48.102327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13288fc0-7377-4576-9279-8d52b15a9060 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:48.125484 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1023/2030] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:48 2022] PUT /identity/v3/projects/59b70f50bccc4b88b57c9d8260ef2118/users/21b7869d3785441f94c3ead92c482a19/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:48.138837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732a6c6-3ebd-427c-a58a-c73163450418 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.138837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732a6c6-3ebd-427c-a58a-c73163450418 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.139167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732a6c6-3ebd-427c-a58a-c73163450418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.176366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32211930-4c5c-4769-9f0e-c5e5f345b725 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.176689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32211930-4c5c-4769-9f0e-c5e5f345b725 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.177140 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32211930-4c5c-4769-9f0e-c5e5f345b725 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.178755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1024/2031] 10.222.0.48 () {54 vars in 921 bytes} [Tue Aug 30 05:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 05:10:48.184457 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5732a6c6-3ebd-427c-a58a-c73163450418 None None] MFA Rules not processed for user `21b7869d3785441f94c3ead92c482a19`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:48.186401 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5732a6c6-3ebd-427c-a58a-c73163450418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:48.194585 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10692e2c-2a0a-4b6c-95af-0bf1d0f32fd6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.194864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10692e2c-2a0a-4b6c-95af-0bf1d0f32fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.195127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10692e2c-2a0a-4b6c-95af-0bf1d0f32fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.220456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-10692e2c-2a0a-4b6c-95af-0bf1d0f32fd6 None None] MFA Rules not processed for user `ed835047051142d2bc98bb1564e3a98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:48.222584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-10692e2c-2a0a-4b6c-95af-0bf1d0f32fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:48.340996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1008/2032] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:48.342530 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732a6c6-3ebd-427c-a58a-c73163450418 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:48.352429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1025/2033] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Aug 30 05:10:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:48.406980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:48.459895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcf3fd-1405-4bd9-9877-48e325e931fc None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.459895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcf3fd-1405-4bd9-9877-48e325e931fc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.460394 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcf3fd-1405-4bd9-9877-48e325e931fc None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.461591 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1026/2034] 10.222.0.48 () {54 vars in 961 bytes} [Tue Aug 30 05:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 05:10:48.469192 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee83ec8-26cf-4715-ac9c-2623c6a854a9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.469394 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee83ec8-26cf-4715-ac9c-2623c6a854a9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.469838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee83ec8-26cf-4715-ac9c-2623c6a854a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.478390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732a6c6-3ebd-427c-a58a-c73163450418 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:48.485576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bfd06-c0a6-498a-a6cc-dd6e0734d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:48.487826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bfd06-c0a6-498a-a6cc-dd6e0734d22e admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.489478 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bfd06-c0a6-498a-a6cc-dd6e0734d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.490088 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bfd06-c0a6-498a-a6cc-dd6e0734d22e admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.492239 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bfd06-c0a6-498a-a6cc-dd6e0734d22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:48.494872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bfd06-c0a6-498a-a6cc-dd6e0734d22e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:48.509726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8ee83ec8-26cf-4715-ac9c-2623c6a854a9 None None] MFA Rules not processed for user `ed835047051142d2bc98bb1564e3a98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:48.527337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8ee83ec8-26cf-4715-ac9c-2623c6a854a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:48.540108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1009/2035] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:48 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:48.540645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1027/2036] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Aug 30 05:10:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:48.541056 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bfd06-c0a6-498a-a6cc-dd6e0734d22e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:48.543068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a94bfd06-c0a6-498a-a6cc-dd6e0734d22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:48.544374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee83ec8-26cf-4715-ac9c-2623c6a854a9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:48.558847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee83ec8-26cf-4715-ac9c-2623c6a854a9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:48.636195 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bfd06-c0a6-498a-a6cc-dd6e0734d22e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:48.636483 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe3516-0ca9-4af1-8028-7f1987b95c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:48.637127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe3516-0ca9-4af1-8028-7f1987b95c03 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.637407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe3516-0ca9-4af1-8028-7f1987b95c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.637674 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe3516-0ca9-4af1-8028-7f1987b95c03 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.638438 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe3516-0ca9-4af1-8028-7f1987b95c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:48.640955 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe3516-0ca9-4af1-8028-7f1987b95c03 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:48.642447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251cae8-758d-4339-b0f2-0c68db47cc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:48.642742 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251cae8-758d-4339-b0f2-0c68db47cc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.643029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251cae8-758d-4339-b0f2-0c68db47cc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.643318 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251cae8-758d-4339-b0f2-0c68db47cc7b admin admin] PATH_INFO: `/v3/users/30a180efbf754d458ed13e4401296bb2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.644589 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251cae8-758d-4339-b0f2-0c68db47cc7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a180efbf754d458ed13e4401296bb2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:48.647009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251cae8-758d-4339-b0f2-0c68db47cc7b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:48.670920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1028/2037] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:48 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:48.675637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe3516-0ca9-4af1-8028-7f1987b95c03 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:48.718474 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f251cae8-758d-4339-b0f2-0c68db47cc7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a180efbf754d458ed13e4401296bb2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:48.744191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f251cae8-758d-4339-b0f2-0c68db47cc7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a180efbf754d458ed13e4401296bb2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:48.755068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f251cae8-758d-4339-b0f2-0c68db47cc7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a180efbf754d458ed13e4401296bb2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:48.755788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f251cae8-758d-4339-b0f2-0c68db47cc7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a180efbf754d458ed13e4401296bb2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:48.756762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f251cae8-758d-4339-b0f2-0c68db47cc7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a180efbf754d458ed13e4401296bb2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:48.760988 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:48.767649 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe3516-0ca9-4af1-8028-7f1987b95c03 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:48.777276 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de6cc4-fe81-4772-aa7b-c47e2f132405 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed835047051142d2bc98bb1564e3a98f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:48.778333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de6cc4-fe81-4772-aa7b-c47e2f132405 service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.778700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de6cc4-fe81-4772-aa7b-c47e2f132405 service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.779095 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de6cc4-fe81-4772-aa7b-c47e2f132405 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.782190 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1010/2038] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:48 2022] DELETE /identity/v3/users/30a180efbf754d458ed13e4401296bb2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:48.783506 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251cae8-758d-4339-b0f2-0c68db47cc7b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:48.785033 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a9de6cc4-fe81-4772-aa7b-c47e2f132405 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:48.794782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f251cae8-758d-4339-b0f2-0c68db47cc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:48.801002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de6cc4-fe81-4772-aa7b-c47e2f132405 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:48.802623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de6cc4-fe81-4772-aa7b-c47e2f132405 service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:48.819294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1029/2039] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:48.854572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:48.899687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251cae8-758d-4339-b0f2-0c68db47cc7b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:48.905117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c0f3d-191c-4d49-8b6a-20603e992c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:48.905921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c0f3d-191c-4d49-8b6a-20603e992c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.906073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c0f3d-191c-4d49-8b6a-20603e992c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.906334 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c0f3d-191c-4d49-8b6a-20603e992c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.906985 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c0f3d-191c-4d49-8b6a-20603e992c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:48.908745 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c0f3d-191c-4d49-8b6a-20603e992c0a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:48.919551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1011/2040] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:48.924832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de6cc4-fe81-4772-aa7b-c47e2f132405 service placement] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:48.935558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de6cc4-fe81-4772-aa7b-c47e2f132405 service placement] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:48.941359 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70097e-4f69-4a11-971e-5393c94c424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:48.941970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70097e-4f69-4a11-971e-5393c94c424b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.942246 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70097e-4f69-4a11-971e-5393c94c424b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.942517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70097e-4f69-4a11-971e-5393c94c424b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.943173 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70097e-4f69-4a11-971e-5393c94c424b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:48.945265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70097e-4f69-4a11-971e-5393c94c424b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:48.956098 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1030/2041] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:48.960100 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c0f3d-191c-4d49-8b6a-20603e992c0a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:48.989249 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c0f3d-191c-4d49-8b6a-20603e992c0a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:48.995418 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc93ff5-c5e9-4189-b5e5-4603dd939207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:48.996363 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc93ff5-c5e9-4189-b5e5-4603dd939207 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.996775 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc93ff5-c5e9-4189-b5e5-4603dd939207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.997066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc93ff5-c5e9-4189-b5e5-4603dd939207 admin admin] PATH_INFO: `/v3/projects/a554be58bae7458795a6c6e5c40970ca/users/297d14e68745476eb292eeb8d1ea2058/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.005047 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70097e-4f69-4a11-971e-5393c94c424b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.007415 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8a70097e-4f69-4a11-971e-5393c94c424b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:49.016294 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc93ff5-c5e9-4189-b5e5-4603dd939207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a554be58bae7458795a6c6e5c40970ca, user_id=297d14e68745476eb292eeb8d1ea2058, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.019894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc93ff5-c5e9-4189-b5e5-4603dd939207 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.029245 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70097e-4f69-4a11-971e-5393c94c424b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.047915 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1012/2042] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:48 2022] PUT /identity/v3/projects/a554be58bae7458795a6c6e5c40970ca/users/297d14e68745476eb292eeb8d1ea2058/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:49.058605 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b867766-b1c1-48c9-bd3d-7478844560dd None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.058973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b867766-b1c1-48c9-bd3d-7478844560dd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.059409 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b867766-b1c1-48c9-bd3d-7478844560dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.064109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec630b-3429-48d6-b741-7ae56d449f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.065000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec630b-3429-48d6-b741-7ae56d449f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.065287 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec630b-3429-48d6-b741-7ae56d449f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.065590 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec630b-3429-48d6-b741-7ae56d449f43 admin admin] PATH_INFO: `/v3/projects/c9e6ba2d4c574792a4383d4f0c902ef4` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.070202 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec630b-3429-48d6-b741-7ae56d449f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e6ba2d4c574792a4383d4f0c902ef4)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.070202 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec630b-3429-48d6-b741-7ae56d449f43 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.092822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7b867766-b1c1-48c9-bd3d-7478844560dd None None] MFA Rules not processed for user `297d14e68745476eb292eeb8d1ea2058`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:49.094013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7b867766-b1c1-48c9-bd3d-7478844560dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:49.127782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-81ec630b-3429-48d6-b741-7ae56d449f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e6ba2d4c574792a4383d4f0c902ef4', 'request_id': 'req-81ec630b-3429-48d6-b741-7ae56d449f43'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.134653 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-81ec630b-3429-48d6-b741-7ae56d449f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e6ba2d4c574792a4383d4f0c902ef4', 'request_id': 'req-81ec630b-3429-48d6-b741-7ae56d449f43'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.144916 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-81ec630b-3429-48d6-b741-7ae56d449f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e6ba2d4c574792a4383d4f0c902ef4', 'request_id': 'req-81ec630b-3429-48d6-b741-7ae56d449f43'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.160165 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-81ec630b-3429-48d6-b741-7ae56d449f43 admin admin] The token cache is being invalidate because project c9e6ba2d4c574792a4383d4f0c902ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:49.160508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-81ec630b-3429-48d6-b741-7ae56d449f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.161366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-81ec630b-3429-48d6-b741-7ae56d449f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.162838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1031/2043] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:49 2022] DELETE /identity/v3/projects/c9e6ba2d4c574792a4383d4f0c902ef4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:10:49.168583 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec5d14-27f6-45f6-84d9-1e3c4073f723 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.168926 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec5d14-27f6-45f6-84d9-1e3c4073f723 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.169121 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec5d14-27f6-45f6-84d9-1e3c4073f723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.175273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1013/2044] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:49.179385 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b867766-b1c1-48c9-bd3d-7478844560dd None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.194526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6bec5d14-27f6-45f6-84d9-1e3c4073f723 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:49.195883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6bec5d14-27f6-45f6-84d9-1e3c4073f723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:49.260294 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b867766-b1c1-48c9-bd3d-7478844560dd None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.267587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6d5e1-75c1-4b21-94fb-c9f7bff50da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.268338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6d5e1-75c1-4b21-94fb-c9f7bff50da2 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.268617 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6d5e1-75c1-4b21-94fb-c9f7bff50da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.268977 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6d5e1-75c1-4b21-94fb-c9f7bff50da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.269622 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6d5e1-75c1-4b21-94fb-c9f7bff50da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.270468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1032/2045] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:49.271608 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6d5e1-75c1-4b21-94fb-c9f7bff50da2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.280345 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4f338-0998-45d9-abc5-fe1fd0a1f38a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.280628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4f338-0998-45d9-abc5-fe1fd0a1f38a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.283584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4f338-0998-45d9-abc5-fe1fd0a1f38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.305462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-72b4f338-0998-45d9-abc5-fe1fd0a1f38a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:49.307272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-72b4f338-0998-45d9-abc5-fe1fd0a1f38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:49.310309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1014/2046] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:49 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:10:49.315381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6d5e1-75c1-4b21-94fb-c9f7bff50da2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.317410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bbb6d5e1-75c1-4b21-94fb-c9f7bff50da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:49.341942 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:49.377797 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1033/2047] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:49.378961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4f338-0998-45d9-abc5-fe1fd0a1f38a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.385761 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:49.390094 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4f338-0998-45d9-abc5-fe1fd0a1f38a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.397248 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6d5e1-75c1-4b21-94fb-c9f7bff50da2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.400446 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af025aa8-8337-4097-bc26-bfd422f0f048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.401128 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025aa8-8337-4097-bc26-bfd422f0f048 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.401484 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025aa8-8337-4097-bc26-bfd422f0f048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.401755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025aa8-8337-4097-bc26-bfd422f0f048 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.402471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af025aa8-8337-4097-bc26-bfd422f0f048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:49.402772 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af025aa8-8337-4097-bc26-bfd422f0f048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.402940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fedda-15ba-4aa5-890b-0fb491744680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.403534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fedda-15ba-4aa5-890b-0fb491744680 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.403815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fedda-15ba-4aa5-890b-0fb491744680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.404193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fedda-15ba-4aa5-890b-0fb491744680 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.404539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af025aa8-8337-4097-bc26-bfd422f0f048 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.404828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14fedda-15ba-4aa5-890b-0fb491744680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.406773 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14fedda-15ba-4aa5-890b-0fb491744680 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.420161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1034/2048] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:49.425452 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af025aa8-8337-4097-bc26-bfd422f0f048 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.439620 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af025aa8-8337-4097-bc26-bfd422f0f048 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.443532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1015/2049] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:49 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:49.444445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fedda-15ba-4aa5-890b-0fb491744680 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.444876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c50e6f-6537-436b-8c0c-b9b29aed7131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.445477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c50e6f-6537-436b-8c0c-b9b29aed7131 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.445755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c50e6f-6537-436b-8c0c-b9b29aed7131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.446026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c50e6f-6537-436b-8c0c-b9b29aed7131 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.446673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c50e6f-6537-436b-8c0c-b9b29aed7131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.448708 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c50e6f-6537-436b-8c0c-b9b29aed7131 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.454888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fedda-15ba-4aa5-890b-0fb491744680 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.460421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb10d2-9c18-4e0b-ba80-d37a856e8d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.460894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb10d2-9c18-4e0b-ba80-d37a856e8d67 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.461245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb10d2-9c18-4e0b-ba80-d37a856e8d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.461785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb10d2-9c18-4e0b-ba80-d37a856e8d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.462345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb10d2-9c18-4e0b-ba80-d37a856e8d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.464223 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb10d2-9c18-4e0b-ba80-d37a856e8d67 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.477617 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1016/2050] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:49.482230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb10d2-9c18-4e0b-ba80-d37a856e8d67 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.493703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb10d2-9c18-4e0b-ba80-d37a856e8d67 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.495848 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1035/2051] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:49 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:49.500987 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c50e6f-6537-436b-8c0c-b9b29aed7131 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.557146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d6a4f-1176-452a-9dbb-267377e76da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.558859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d6a4f-1176-452a-9dbb-267377e76da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.559442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d6a4f-1176-452a-9dbb-267377e76da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.559922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d6a4f-1176-452a-9dbb-267377e76da7 admin admin] PATH_INFO: `/v3/projects/d11468e63c3940a7890d26c93b0a3c36/users/81769ac0ba2843068876d448b38accc7/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.577591 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c50e6f-6537-436b-8c0c-b9b29aed7131 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.579262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d6a4f-1176-452a-9dbb-267377e76da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11468e63c3940a7890d26c93b0a3c36, user_id=81769ac0ba2843068876d448b38accc7, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.582146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d6a4f-1176-452a-9dbb-267377e76da7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.588793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5ba8d-d181-4d3e-9a03-8c6314e03f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.589758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5ba8d-d181-4d3e-9a03-8c6314e03f0b admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.590028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5ba8d-d181-4d3e-9a03-8c6314e03f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.590352 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5ba8d-d181-4d3e-9a03-8c6314e03f0b admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.591171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5ba8d-d181-4d3e-9a03-8c6314e03f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.593343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5ba8d-d181-4d3e-9a03-8c6314e03f0b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.598212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1017/2052] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:49 2022] PUT /identity/v3/projects/d11468e63c3940a7890d26c93b0a3c36/users/81769ac0ba2843068876d448b38accc7/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:10:49.602621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d6a4f-1176-452a-9dbb-267377e76da7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.621139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1036/2053] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:49 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:49.625558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5ba8d-d181-4d3e-9a03-8c6314e03f0b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.638203 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5ba8d-d181-4d3e-9a03-8c6314e03f0b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.681734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d6a4f-1176-452a-9dbb-267377e76da7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.689807 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140b02c-f2c5-4a19-b512-641c37f1d5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.690427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140b02c-f2c5-4a19-b512-641c37f1d5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.690701 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140b02c-f2c5-4a19-b512-641c37f1d5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.690975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140b02c-f2c5-4a19-b512-641c37f1d5b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.691745 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140b02c-f2c5-4a19-b512-641c37f1d5b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.693657 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140b02c-f2c5-4a19-b512-641c37f1d5b6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.709425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1018/2054] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:49.710447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140b02c-f2c5-4a19-b512-641c37f1d5b6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.723393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140b02c-f2c5-4a19-b512-641c37f1d5b6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.728835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af5eb4-6ed0-4dfc-a46a-20ceb3762f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.729096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f9e70-889b-405a-971e-7ee3d90056bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.729501 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af5eb4-6ed0-4dfc-a46a-20ceb3762f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.729778 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af5eb4-6ed0-4dfc-a46a-20ceb3762f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.730092 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af5eb4-6ed0-4dfc-a46a-20ceb3762f3a admin admin] PATH_INFO: `/v3/projects/d11468e63c3940a7890d26c93b0a3c36/users/81769ac0ba2843068876d448b38accc7/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.730287 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f9e70-889b-405a-971e-7ee3d90056bd admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.730573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f9e70-889b-405a-971e-7ee3d90056bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.730989 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f9e70-889b-405a-971e-7ee3d90056bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.731773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f9e70-889b-405a-971e-7ee3d90056bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.732083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af5eb4-6ed0-4dfc-a46a-20ceb3762f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11468e63c3940a7890d26c93b0a3c36, user_id=81769ac0ba2843068876d448b38accc7, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.734470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f9e70-889b-405a-971e-7ee3d90056bd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.735545 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af5eb4-6ed0-4dfc-a46a-20ceb3762f3a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.747193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1037/2055] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:49.748940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1019/2056] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:49 2022] PUT /identity/v3/projects/d11468e63c3940a7890d26c93b0a3c36/users/81769ac0ba2843068876d448b38accc7/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:49.751628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f9e70-889b-405a-971e-7ee3d90056bd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.761771 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e0350-56e1-41bd-a6c2-7fc0c8c14221 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.762059 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e0350-56e1-41bd-a6c2-7fc0c8c14221 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.762360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e0350-56e1-41bd-a6c2-7fc0c8c14221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.771236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f9e70-889b-405a-971e-7ee3d90056bd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.772570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:49.806334 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-529e0350-56e1-41bd-a6c2-7fc0c8c14221 None None] MFA Rules not processed for user `81769ac0ba2843068876d448b38accc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:49.807694 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-529e0350-56e1-41bd-a6c2-7fc0c8c14221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:49.850036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:49.859684 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4acd2-3813-46d8-a307-2a1975caf927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.860348 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4acd2-3813-46d8-a307-2a1975caf927 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.860755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4acd2-3813-46d8-a307-2a1975caf927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.861032 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4acd2-3813-46d8-a307-2a1975caf927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.861677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4acd2-3813-46d8-a307-2a1975caf927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.863267 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4acd2-3813-46d8-a307-2a1975caf927 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.873712 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1038/2057] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:49.877895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4acd2-3813-46d8-a307-2a1975caf927 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.890870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4acd2-3813-46d8-a307-2a1975caf927 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.892669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1020/2058] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:49.899406 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647a20c-a7ed-4e89-ad3a-c948e7c2d2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.900237 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647a20c-a7ed-4e89-ad3a-c948e7c2d2c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.900404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647a20c-a7ed-4e89-ad3a-c948e7c2d2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.900678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647a20c-a7ed-4e89-ad3a-c948e7c2d2c7 admin admin] PATH_INFO: `/v3/projects/45ecef39e63344f596baccb2a655f695/users/b2cd267ec46f4ddc9c47b1e27fbed620/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.905255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e0350-56e1-41bd-a6c2-7fc0c8c14221 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.907353 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-529e0350-56e1-41bd-a6c2-7fc0c8c14221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:49.919362 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647a20c-a7ed-4e89-ad3a-c948e7c2d2c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45ecef39e63344f596baccb2a655f695, user_id=b2cd267ec46f4ddc9c47b1e27fbed620, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.922703 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647a20c-a7ed-4e89-ad3a-c948e7c2d2c7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.936483 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1039/2059] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:49 2022] PUT /identity/v3/projects/45ecef39e63344f596baccb2a655f695/users/b2cd267ec46f4ddc9c47b1e27fbed620/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:10:49.937449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647a20c-a7ed-4e89-ad3a-c948e7c2d2c7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.938986 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5647a20c-a7ed-4e89-ad3a-c948e7c2d2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:49.970490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e0350-56e1-41bd-a6c2-7fc0c8c14221 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.995689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647a20c-a7ed-4e89-ad3a-c948e7c2d2c7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.999392 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75aa5d1-534d-4622-b04e-9802d1c0b24f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.999936 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75aa5d1-534d-4622-b04e-9802d1c0b24f service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.000246 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75aa5d1-534d-4622-b04e-9802d1c0b24f service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.000515 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75aa5d1-534d-4622-b04e-9802d1c0b24f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.002264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d75aa5d1-534d-4622-b04e-9802d1c0b24f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:50.022143 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58207abb-4e9b-4016-bf7d-d97d2c1ce847 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:50.022752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58207abb-4e9b-4016-bf7d-d97d2c1ce847 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.023062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58207abb-4e9b-4016-bf7d-d97d2c1ce847 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.023338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58207abb-4e9b-4016-bf7d-d97d2c1ce847 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.025305 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-58207abb-4e9b-4016-bf7d-d97d2c1ce847 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:50.065923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75aa5d1-534d-4622-b04e-9802d1c0b24f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:50.067358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75aa5d1-534d-4622-b04e-9802d1c0b24f service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:50.077409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1040/2060] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:50.078702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3087b-5bc2-4533-8c9c-470452a6eaa1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.078983 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3087b-5bc2-4533-8c9c-470452a6eaa1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.079256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3087b-5bc2-4533-8c9c-470452a6eaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.085265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58207abb-4e9b-4016-bf7d-d97d2c1ce847 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:50.086910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58207abb-4e9b-4016-bf7d-d97d2c1ce847 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:50.090683 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:50.098936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1021/2061] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:50.114784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-eac3087b-5bc2-4533-8c9c-470452a6eaa1 None None] MFA Rules not processed for user `b2cd267ec46f4ddc9c47b1e27fbed620`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:50.117986 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-eac3087b-5bc2-4533-8c9c-470452a6eaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:50.198099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1041/2062] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:50.211339 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58207abb-4e9b-4016-bf7d-d97d2c1ce847 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:50.213013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-58207abb-4e9b-4016-bf7d-d97d2c1ce847 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:50.306813 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58207abb-4e9b-4016-bf7d-d97d2c1ce847 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:50.314845 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aeb14-4bf9-4cd4-82f6-e8696fc05ef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:50.315754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aeb14-4bf9-4cd4-82f6-e8696fc05ef2 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.315754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aeb14-4bf9-4cd4-82f6-e8696fc05ef2 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.316070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aeb14-4bf9-4cd4-82f6-e8696fc05ef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.329662 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926aeb14-4bf9-4cd4-82f6-e8696fc05ef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:50.332875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926aeb14-4bf9-4cd4-82f6-e8696fc05ef2 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:50.347003 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1022/2063] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:51.653864 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3087b-5bc2-4533-8c9c-470452a6eaa1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:51.663336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3087b-5bc2-4533-8c9c-470452a6eaa1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:51.667517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5e810-66ce-4438-8674-33e4b35dd866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:51.668142 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5e810-66ce-4438-8674-33e4b35dd866 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:51.668419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5e810-66ce-4438-8674-33e4b35dd866 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:51.668689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5e810-66ce-4438-8674-33e4b35dd866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:51.670437 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3af5e810-66ce-4438-8674-33e4b35dd866 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:51.675926 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:51.730553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5e810-66ce-4438-8674-33e4b35dd866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:51.731888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5e810-66ce-4438-8674-33e4b35dd866 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:51.741261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1042/2064] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:51.777864 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aeb14-4bf9-4cd4-82f6-e8696fc05ef2 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:51.779270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-926aeb14-4bf9-4cd4-82f6-e8696fc05ef2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:51.854757 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aeb14-4bf9-4cd4-82f6-e8696fc05ef2 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:51.861278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff96ae-2374-4616-925c-dd426e7e78db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:51.862150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff96ae-2374-4616-925c-dd426e7e78db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:51.862423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff96ae-2374-4616-925c-dd426e7e78db admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:51.862741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff96ae-2374-4616-925c-dd426e7e78db admin admin] PATH_INFO: `/v3/users/46adb82627ea4361b4f66e21ec5a8a85` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:51.863916 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff96ae-2374-4616-925c-dd426e7e78db admin admin] RBAC: Authorizing `identity:delete_user(user_id=46adb82627ea4361b4f66e21ec5a8a85)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:51.865891 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff96ae-2374-4616-925c-dd426e7e78db admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:51.918087 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-98ff96ae-2374-4616-925c-dd426e7e78db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46adb82627ea4361b4f66e21ec5a8a85'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:51.931482 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-98ff96ae-2374-4616-925c-dd426e7e78db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46adb82627ea4361b4f66e21ec5a8a85'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:51.940239 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-98ff96ae-2374-4616-925c-dd426e7e78db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46adb82627ea4361b4f66e21ec5a8a85'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:51.940951 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-98ff96ae-2374-4616-925c-dd426e7e78db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46adb82627ea4361b4f66e21ec5a8a85'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:51.941489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-98ff96ae-2374-4616-925c-dd426e7e78db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46adb82627ea4361b4f66e21ec5a8a85'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:51.957713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1023/2065] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:51 2022] DELETE /identity/v3/users/46adb82627ea4361b4f66e21ec5a8a85 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:51.962341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb50fc-e6a8-45cc-9d57-3856806a236d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:51.962647 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb50fc-e6a8-45cc-9d57-3856806a236d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:51.962910 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb50fc-e6a8-45cc-9d57-3856806a236d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:51.986308 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-33eb50fc-e6a8-45cc-9d57-3856806a236d None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:51.988193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-33eb50fc-e6a8-45cc-9d57-3856806a236d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:52.066212 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1043/2066] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:52.076910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff96ae-2374-4616-925c-dd426e7e78db admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:52.079313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-98ff96ae-2374-4616-925c-dd426e7e78db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:52.085951 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:52.201109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff96ae-2374-4616-925c-dd426e7e78db admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:52.210644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafe1db-35a1-40d3-b931-8544bf0fd5f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:52.213013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafe1db-35a1-40d3-b931-8544bf0fd5f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:52.215112 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafe1db-35a1-40d3-b931-8544bf0fd5f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:52.215387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafe1db-35a1-40d3-b931-8544bf0fd5f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:52.243509 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafe1db-35a1-40d3-b931-8544bf0fd5f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:52.245343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafe1db-35a1-40d3-b931-8544bf0fd5f6 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:52.262902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1024/2067] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:52.489460 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb50fc-e6a8-45cc-9d57-3856806a236d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:52.490901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-33eb50fc-e6a8-45cc-9d57-3856806a236d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:52.555454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb50fc-e6a8-45cc-9d57-3856806a236d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:52.564098 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb0ef3-9330-4fd0-b749-001c5bd9edfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:52.566997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb0ef3-9330-4fd0-b749-001c5bd9edfc service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:52.566997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb0ef3-9330-4fd0-b749-001c5bd9edfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:52.566997 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb0ef3-9330-4fd0-b749-001c5bd9edfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:52.568479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b4bb0ef3-9330-4fd0-b749-001c5bd9edfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:52.614693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafe1db-35a1-40d3-b931-8544bf0fd5f6 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:52.616690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5aafe1db-35a1-40d3-b931-8544bf0fd5f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:52.634282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafe1db-35a1-40d3-b931-8544bf0fd5f6 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:52.639629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ddc11-4d0a-4c0d-8af1-0cec713987b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:52.640345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ddc11-4d0a-4c0d-8af1-0cec713987b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:52.640664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ddc11-4d0a-4c0d-8af1-0cec713987b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:52.641496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ddc11-4d0a-4c0d-8af1-0cec713987b2 admin admin] PATH_INFO: `/v3/projects/08a6c3b2766949589727077ae8d0afdd` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:52.642712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ddc11-4d0a-4c0d-8af1-0cec713987b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08a6c3b2766949589727077ae8d0afdd)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:52.644879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ddc11-4d0a-4c0d-8af1-0cec713987b2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:52.656185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:52.658926 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb0ef3-9330-4fd0-b749-001c5bd9edfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:52.660729 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb0ef3-9330-4fd0-b749-001c5bd9edfc service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:52.689414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1044/2068] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:52.703007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-267ddc11-4d0a-4c0d-8af1-0cec713987b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08a6c3b2766949589727077ae8d0afdd', 'request_id': 'req-267ddc11-4d0a-4c0d-8af1-0cec713987b2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:52.712467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-267ddc11-4d0a-4c0d-8af1-0cec713987b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08a6c3b2766949589727077ae8d0afdd', 'request_id': 'req-267ddc11-4d0a-4c0d-8af1-0cec713987b2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:52.721013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-267ddc11-4d0a-4c0d-8af1-0cec713987b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08a6c3b2766949589727077ae8d0afdd', 'request_id': 'req-267ddc11-4d0a-4c0d-8af1-0cec713987b2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:52.740449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-267ddc11-4d0a-4c0d-8af1-0cec713987b2 admin admin] The token cache is being invalidate because project 08a6c3b2766949589727077ae8d0afdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:52.740988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-267ddc11-4d0a-4c0d-8af1-0cec713987b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:52.741855 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-267ddc11-4d0a-4c0d-8af1-0cec713987b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:52.744481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1025/2069] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:52 2022] DELETE /identity/v3/projects/08a6c3b2766949589727077ae8d0afdd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:52.748619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb0ef3-9330-4fd0-b749-001c5bd9edfc service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:52.763447 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb0ef3-9330-4fd0-b749-001c5bd9edfc service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:52.836394 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22d1e3-b236-44b3-afa5-4544c0a1e19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:52.836993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22d1e3-b236-44b3-afa5-4544c0a1e19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:52.837263 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22d1e3-b236-44b3-afa5-4544c0a1e19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:52.837532 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22d1e3-b236-44b3-afa5-4544c0a1e19f admin admin] PATH_INFO: `/v3/users/4425af90a26d47c09bf6c179afed1089` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:52.838703 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22d1e3-b236-44b3-afa5-4544c0a1e19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4425af90a26d47c09bf6c179afed1089)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:52.840675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22d1e3-b236-44b3-afa5-4544c0a1e19f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:52.903040 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ee22d1e3-b236-44b3-afa5-4544c0a1e19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4425af90a26d47c09bf6c179afed1089'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:52.910823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ee22d1e3-b236-44b3-afa5-4544c0a1e19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4425af90a26d47c09bf6c179afed1089'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:52.919288 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ee22d1e3-b236-44b3-afa5-4544c0a1e19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4425af90a26d47c09bf6c179afed1089'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:52.920107 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ee22d1e3-b236-44b3-afa5-4544c0a1e19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4425af90a26d47c09bf6c179afed1089'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:52.944953 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ee22d1e3-b236-44b3-afa5-4544c0a1e19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4425af90a26d47c09bf6c179afed1089'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:52.958938 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1045/2070] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:52 2022] DELETE /identity/v3/users/4425af90a26d47c09bf6c179afed1089 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:53.248034 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ddc11-4d0a-4c0d-8af1-0cec713987b2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:53.249355 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-267ddc11-4d0a-4c0d-8af1-0cec713987b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:53.252883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22d1e3-b236-44b3-afa5-4544c0a1e19f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:53.254756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ee22d1e3-b236-44b3-afa5-4544c0a1e19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:53.267988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ddc11-4d0a-4c0d-8af1-0cec713987b2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:53.336726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22d1e3-b236-44b3-afa5-4544c0a1e19f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:53.342241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eaa8e-c5d2-4917-b0fb-cbd905c90d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:53.342884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eaa8e-c5d2-4917-b0fb-cbd905c90d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:53.343162 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eaa8e-c5d2-4917-b0fb-cbd905c90d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:53.343459 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eaa8e-c5d2-4917-b0fb-cbd905c90d53 admin admin] PATH_INFO: `/v3/projects/57e3745bea2744448eb92eef4688dd29` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:53.345110 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967db21-38a0-4eb6-a9fa-b8b805d962f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:53.345268 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eaa8e-c5d2-4917-b0fb-cbd905c90d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e3745bea2744448eb92eef4688dd29)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:53.346045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967db21-38a0-4eb6-a9fa-b8b805d962f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:53.346473 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967db21-38a0-4eb6-a9fa-b8b805d962f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:53.346886 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967db21-38a0-4eb6-a9fa-b8b805d962f4 admin admin] PATH_INFO: `/v3/users/b2cd267ec46f4ddc9c47b1e27fbed620` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:53.347228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eaa8e-c5d2-4917-b0fb-cbd905c90d53 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:53.348380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967db21-38a0-4eb6-a9fa-b8b805d962f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2cd267ec46f4ddc9c47b1e27fbed620)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:53.350732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967db21-38a0-4eb6-a9fa-b8b805d962f4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:53.369325 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:53.395163 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:53.415230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-325eaa8e-c5d2-4917-b0fb-cbd905c90d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e3745bea2744448eb92eef4688dd29', 'request_id': 'req-325eaa8e-c5d2-4917-b0fb-cbd905c90d53'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:53.423174 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-325eaa8e-c5d2-4917-b0fb-cbd905c90d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e3745bea2744448eb92eef4688dd29', 'request_id': 'req-325eaa8e-c5d2-4917-b0fb-cbd905c90d53'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:53.427873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1967db21-38a0-4eb6-a9fa-b8b805d962f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2cd267ec46f4ddc9c47b1e27fbed620'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:53.434516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-325eaa8e-c5d2-4917-b0fb-cbd905c90d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e3745bea2744448eb92eef4688dd29', 'request_id': 'req-325eaa8e-c5d2-4917-b0fb-cbd905c90d53'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:53.450903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-325eaa8e-c5d2-4917-b0fb-cbd905c90d53 admin admin] The token cache is being invalidate because project 57e3745bea2744448eb92eef4688dd29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:53.451236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-325eaa8e-c5d2-4917-b0fb-cbd905c90d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:53.452022 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-325eaa8e-c5d2-4917-b0fb-cbd905c90d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:53.454236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1046/2071] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:53 2022] DELETE /identity/v3/projects/57e3745bea2744448eb92eef4688dd29 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:53.457238 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1967db21-38a0-4eb6-a9fa-b8b805d962f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2cd267ec46f4ddc9c47b1e27fbed620'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:53.466279 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1967db21-38a0-4eb6-a9fa-b8b805d962f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2cd267ec46f4ddc9c47b1e27fbed620'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:53.467465 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1967db21-38a0-4eb6-a9fa-b8b805d962f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2cd267ec46f4ddc9c47b1e27fbed620'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:53.468520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1967db21-38a0-4eb6-a9fa-b8b805d962f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2cd267ec46f4ddc9c47b1e27fbed620'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:53.472403 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f1b93-06c2-4878-b8c3-549338dfbde3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:53.473528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f1b93-06c2-4878-b8c3-549338dfbde3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:53.474567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f1b93-06c2-4878-b8c3-549338dfbde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:53.490857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1026/2072] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:53 2022] DELETE /identity/v3/users/b2cd267ec46f4ddc9c47b1e27fbed620 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:53.495628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d832f4-052f-4bd0-b54b-554a9d13e97a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:53.495913 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d832f4-052f-4bd0-b54b-554a9d13e97a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:53.496283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d832f4-052f-4bd0-b54b-554a9d13e97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:53.520091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d3d832f4-052f-4bd0-b54b-554a9d13e97a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:53.520226 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c64f1b93-06c2-4878-b8c3-549338dfbde3 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:53.521331 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c64f1b93-06c2-4878-b8c3-549338dfbde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:53.521451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d3d832f4-052f-4bd0-b54b-554a9d13e97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:53.611412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1027/2073] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:53.619625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1047/2074] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:53.621638 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d531950-c286-45e0-8925-3ead9ede7143 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:53.622319 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d531950-c286-45e0-8925-3ead9ede7143 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:53.622791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d531950-c286-45e0-8925-3ead9ede7143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:53.623725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d832f4-052f-4bd0-b54b-554a9d13e97a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:53.626195 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d3d832f4-052f-4bd0-b54b-554a9d13e97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:53.658915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7d531950-c286-45e0-8925-3ead9ede7143 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:53.660297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7d531950-c286-45e0-8925-3ead9ede7143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:53.673294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1048/2075] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:53.678057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d531950-c286-45e0-8925-3ead9ede7143 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:53.695888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d531950-c286-45e0-8925-3ead9ede7143 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:53.705821 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58744d75-89b3-4cc6-bde9-6e8ce54e68ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:53.706485 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58744d75-89b3-4cc6-bde9-6e8ce54e68ad admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:53.706784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58744d75-89b3-4cc6-bde9-6e8ce54e68ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:53.707088 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58744d75-89b3-4cc6-bde9-6e8ce54e68ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:53.707938 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58744d75-89b3-4cc6-bde9-6e8ce54e68ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:53.708267 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58744d75-89b3-4cc6-bde9-6e8ce54e68ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:53.710015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58744d75-89b3-4cc6-bde9-6e8ce54e68ad admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:53.713579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d832f4-052f-4bd0-b54b-554a9d13e97a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:53.718784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d40458-1981-4ab8-9021-ef2c30cc09a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:53.719440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d40458-1981-4ab8-9021-ef2c30cc09a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:53.719763 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d40458-1981-4ab8-9021-ef2c30cc09a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:53.720118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d40458-1981-4ab8-9021-ef2c30cc09a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:53.724017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1049/2076] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:53.731338 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58744d75-89b3-4cc6-bde9-6e8ce54e68ad admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:53.732202 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d40458-1981-4ab8-9021-ef2c30cc09a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:53.733675 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d40458-1981-4ab8-9021-ef2c30cc09a7 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:53.743287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1028/2077] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:53.744513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58744d75-89b3-4cc6-bde9-6e8ce54e68ad admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:53.749027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9d91-ee7e-4867-b5f3-067a4337efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:53.749628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9d91-ee7e-4867-b5f3-067a4337efd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:53.749937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9d91-ee7e-4867-b5f3-067a4337efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:53.750786 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9d91-ee7e-4867-b5f3-067a4337efd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:53.751526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a9d91-ee7e-4867-b5f3-067a4337efd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:53.753479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a9d91-ee7e-4867-b5f3-067a4337efd4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:53.789109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1050/2078] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:53 2022] POST /identity/v3/projects => generated 359 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:53.793192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d40458-1981-4ab8-9021-ef2c30cc09a7 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:53.803733 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d40458-1981-4ab8-9021-ef2c30cc09a7 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:53.870110 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:53.889008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353b6da-a9a7-48bd-93da-ca96a8d98671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:53.890140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353b6da-a9a7-48bd-93da-ca96a8d98671 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:53.890665 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353b6da-a9a7-48bd-93da-ca96a8d98671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:53.891381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353b6da-a9a7-48bd-93da-ca96a8d98671 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:53.893549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353b6da-a9a7-48bd-93da-ca96a8d98671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:53.896410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353b6da-a9a7-48bd-93da-ca96a8d98671 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:53.925906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1029/2079] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:53 2022] POST /identity/v3/users => generated 280 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:53.931045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9d91-ee7e-4867-b5f3-067a4337efd4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:53.945827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9d91-ee7e-4867-b5f3-067a4337efd4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:53.950633 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced931e4-4f15-4262-be7f-43feb491e6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:53.951414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced931e4-4f15-4262-be7f-43feb491e6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:53.951696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced931e4-4f15-4262-be7f-43feb491e6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:53.951976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced931e4-4f15-4262-be7f-43feb491e6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:53.952659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced931e4-4f15-4262-be7f-43feb491e6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:53.954360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced931e4-4f15-4262-be7f-43feb491e6e6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:53.966422 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1051/2080] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:53.971500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353b6da-a9a7-48bd-93da-ca96a8d98671 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:53.986712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353b6da-a9a7-48bd-93da-ca96a8d98671 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:53.996286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3afff-2977-4e88-8e69-28a3a10c9a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:53.997023 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3afff-2977-4e88-8e69-28a3a10c9a55 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:53.998487 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3afff-2977-4e88-8e69-28a3a10c9a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:53.998487 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3afff-2977-4e88-8e69-28a3a10c9a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:53.999374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3afff-2977-4e88-8e69-28a3a10c9a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:54.002418 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3afff-2977-4e88-8e69-28a3a10c9a55 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:54.021807 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1030/2081] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:54.025954 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced931e4-4f15-4262-be7f-43feb491e6e6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:54.038833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced931e4-4f15-4262-be7f-43feb491e6e6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:54.045319 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5fe1-2a66-40a2-a6f0-387b0a95d9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:54.046066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5fe1-2a66-40a2-a6f0-387b0a95d9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:54.046413 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5fe1-2a66-40a2-a6f0-387b0a95d9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:54.046887 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5fe1-2a66-40a2-a6f0-387b0a95d9e1 admin admin] PATH_INFO: `/v3/projects/245ce493f4ee47ddaa100cd1d295a42a/users/073a22341fa241b5873fc2b25468b208/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:54.070196 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b5fe1-2a66-40a2-a6f0-387b0a95d9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=245ce493f4ee47ddaa100cd1d295a42a, user_id=073a22341fa241b5873fc2b25468b208, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:54.074534 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b5fe1-2a66-40a2-a6f0-387b0a95d9e1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:54.115463 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1052/2082] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:54 2022] PUT /identity/v3/projects/245ce493f4ee47ddaa100cd1d295a42a/users/073a22341fa241b5873fc2b25468b208/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:10:54.118754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0aa00-ff36-441e-9fb5-012e83031667 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:54.119061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0aa00-ff36-441e-9fb5-012e83031667 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:54.119338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0aa00-ff36-441e-9fb5-012e83031667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:54.184260 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-53c0aa00-ff36-441e-9fb5-012e83031667 None None] MFA Rules not processed for user `073a22341fa241b5873fc2b25468b208`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:54.186075 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-53c0aa00-ff36-441e-9fb5-012e83031667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:54.212804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5fe1-2a66-40a2-a6f0-387b0a95d9e1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:54.214845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a74b5fe1-2a66-40a2-a6f0-387b0a95d9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:54.299321 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:54.348073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1031/2083] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:54.380908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5fe1-2a66-40a2-a6f0-387b0a95d9e1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:54.389484 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce7cfb-e7a8-4710-a250-f41bd22350c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:54.390468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce7cfb-e7a8-4710-a250-f41bd22350c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:54.390775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce7cfb-e7a8-4710-a250-f41bd22350c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:54.391120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce7cfb-e7a8-4710-a250-f41bd22350c7 admin admin] PATH_INFO: `/v3/projects/45ecef39e63344f596baccb2a655f695` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:54.392520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce7cfb-e7a8-4710-a250-f41bd22350c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45ecef39e63344f596baccb2a655f695)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:54.394565 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce7cfb-e7a8-4710-a250-f41bd22350c7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:54.395862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0aa00-ff36-441e-9fb5-012e83031667 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:54.397407 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-53c0aa00-ff36-441e-9fb5-012e83031667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:54.478901 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0aa00-ff36-441e-9fb5-012e83031667 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:54.498788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3ce7cfb-e7a8-4710-a250-f41bd22350c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45ecef39e63344f596baccb2a655f695', 'request_id': 'req-b3ce7cfb-e7a8-4710-a250-f41bd22350c7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:54.507360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3ce7cfb-e7a8-4710-a250-f41bd22350c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45ecef39e63344f596baccb2a655f695', 'request_id': 'req-b3ce7cfb-e7a8-4710-a250-f41bd22350c7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:54.523678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3ce7cfb-e7a8-4710-a250-f41bd22350c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45ecef39e63344f596baccb2a655f695', 'request_id': 'req-b3ce7cfb-e7a8-4710-a250-f41bd22350c7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:54.540030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3ce7cfb-e7a8-4710-a250-f41bd22350c7 admin admin] The token cache is being invalidate because project 45ecef39e63344f596baccb2a655f695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:54.540328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3ce7cfb-e7a8-4710-a250-f41bd22350c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:54.541147 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3ce7cfb-e7a8-4710-a250-f41bd22350c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:54.543051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1053/2084] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:54 2022] DELETE /identity/v3/projects/45ecef39e63344f596baccb2a655f695 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:54.548882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4735ac-8f67-475e-b2a6-83df05db362f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:54.549259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4735ac-8f67-475e-b2a6-83df05db362f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:54.549485 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4735ac-8f67-475e-b2a6-83df05db362f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:54.570656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23822602-4b7b-4f05-9fc5-f898b0739cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:54.571754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23822602-4b7b-4f05-9fc5-f898b0739cbe service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:54.572267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23822602-4b7b-4f05-9fc5-f898b0739cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:54.572767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23822602-4b7b-4f05-9fc5-f898b0739cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:54.575655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-23822602-4b7b-4f05-9fc5-f898b0739cbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:54.575940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3c4735ac-8f67-475e-b2a6-83df05db362f None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:54.578304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3c4735ac-8f67-475e-b2a6-83df05db362f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:54.619556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:54.652039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1054/2085] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:54.661369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cc347-29a2-4b92-b434-89baedf64931 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:54.662139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cc347-29a2-4b92-b434-89baedf64931 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:54.662139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cc347-29a2-4b92-b434-89baedf64931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:54.673496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23822602-4b7b-4f05-9fc5-f898b0739cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:54.674992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23822602-4b7b-4f05-9fc5-f898b0739cbe service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:54.684821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1032/2086] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:54.684994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6e4cc347-29a2-4b92-b434-89baedf64931 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:54.686023 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6e4cc347-29a2-4b92-b434-89baedf64931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:54.694640 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1055/2087] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:54.698613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23822602-4b7b-4f05-9fc5-f898b0739cbe service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:54.705268 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cc347-29a2-4b92-b434-89baedf64931 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:54.707282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6e4cc347-29a2-4b92-b434-89baedf64931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:54.711878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23822602-4b7b-4f05-9fc5-f898b0739cbe service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:54.721405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cc347-29a2-4b92-b434-89baedf64931 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:54.727168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf32b8b-3d98-4487-ac34-4e1b8b42bf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:54.727810 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf32b8b-3d98-4487-ac34-4e1b8b42bf42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:54.728135 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf32b8b-3d98-4487-ac34-4e1b8b42bf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:54.728385 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf32b8b-3d98-4487-ac34-4e1b8b42bf42 admin admin] PATH_INFO: `/v3/users/073a22341fa241b5873fc2b25468b208` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:54.730066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62341dc8-479d-43c7-b889-bb2b3f64ed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:54.733465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf32b8b-3d98-4487-ac34-4e1b8b42bf42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=073a22341fa241b5873fc2b25468b208)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:54.733628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62341dc8-479d-43c7-b889-bb2b3f64ed33 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:54.733628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62341dc8-479d-43c7-b889-bb2b3f64ed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:54.733628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62341dc8-479d-43c7-b889-bb2b3f64ed33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:54.733628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62341dc8-479d-43c7-b889-bb2b3f64ed33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:54.733628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62341dc8-479d-43c7-b889-bb2b3f64ed33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:54.734026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf32b8b-3d98-4487-ac34-4e1b8b42bf42 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:54.734127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62341dc8-479d-43c7-b889-bb2b3f64ed33 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:54.765106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1033/2088] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:54.768446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62341dc8-479d-43c7-b889-bb2b3f64ed33 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:54.798385 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62341dc8-479d-43c7-b889-bb2b3f64ed33 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:54.807049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db2e19-e64f-440e-9154-7be644b03488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:54.807664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db2e19-e64f-440e-9154-7be644b03488 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:54.807939 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db2e19-e64f-440e-9154-7be644b03488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:54.808234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db2e19-e64f-440e-9154-7be644b03488 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:54.812748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6cf32b8b-3d98-4487-ac34-4e1b8b42bf42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073a22341fa241b5873fc2b25468b208'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:54.813202 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db2e19-e64f-440e-9154-7be644b03488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:54.815107 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:54.815284 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db2e19-e64f-440e-9154-7be644b03488 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:54.830535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6cf32b8b-3d98-4487-ac34-4e1b8b42bf42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073a22341fa241b5873fc2b25468b208'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:54.841904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6cf32b8b-3d98-4487-ac34-4e1b8b42bf42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073a22341fa241b5873fc2b25468b208'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:54.842582 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6cf32b8b-3d98-4487-ac34-4e1b8b42bf42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073a22341fa241b5873fc2b25468b208'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:54.863994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1034/2089] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:54 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:10:54.866270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db2e19-e64f-440e-9154-7be644b03488 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:54.868553 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d8db2e19-e64f-440e-9154-7be644b03488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:54.875064 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6cf32b8b-3d98-4487-ac34-4e1b8b42bf42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073a22341fa241b5873fc2b25468b208'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:54.885460 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1056/2090] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:54 2022] DELETE /identity/v3/users/073a22341fa241b5873fc2b25468b208 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:54.889107 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463991a-9898-4aa2-8007-889a8534a38a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:54.889894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463991a-9898-4aa2-8007-889a8534a38a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:54.890690 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463991a-9898-4aa2-8007-889a8534a38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:54.920295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4463991a-9898-4aa2-8007-889a8534a38a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:54.922564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4463991a-9898-4aa2-8007-889a8534a38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:54.967982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db2e19-e64f-440e-9154-7be644b03488 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:55.005226 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1057/2091] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:55.017685 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463991a-9898-4aa2-8007-889a8534a38a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:55.019493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4463991a-9898-4aa2-8007-889a8534a38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:55.048021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9978e6-fc7b-4f1c-a7c4-74b2a82e1f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:55.048631 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9978e6-fc7b-4f1c-a7c4-74b2a82e1f26 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:55.048904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9978e6-fc7b-4f1c-a7c4-74b2a82e1f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:55.049171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9978e6-fc7b-4f1c-a7c4-74b2a82e1f26 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:55.049796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9978e6-fc7b-4f1c-a7c4-74b2a82e1f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:55.051860 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9978e6-fc7b-4f1c-a7c4-74b2a82e1f26 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:55.088217 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1035/2092] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:54 2022] POST /identity/v3/users => generated 284 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:10:55.089588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9978e6-fc7b-4f1c-a7c4-74b2a82e1f26 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:55.105908 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9978e6-fc7b-4f1c-a7c4-74b2a82e1f26 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:55.113739 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02503bf-2f62-43cd-a58a-c132aad9ba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:55.114427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02503bf-2f62-43cd-a58a-c132aad9ba3c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:55.114837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02503bf-2f62-43cd-a58a-c132aad9ba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:55.115115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02503bf-2f62-43cd-a58a-c132aad9ba3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:55.115763 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02503bf-2f62-43cd-a58a-c132aad9ba3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:55.118393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02503bf-2f62-43cd-a58a-c132aad9ba3c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:55.119458 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463991a-9898-4aa2-8007-889a8534a38a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:55.123656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50411-9435-4d52-a834-8b3ea1225a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:55.124833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50411-9435-4d52-a834-8b3ea1225a5a service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:55.125865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50411-9435-4d52-a834-8b3ea1225a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:55.125985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50411-9435-4d52-a834-8b3ea1225a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:55.130648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1036/2093] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:55.134647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02503bf-2f62-43cd-a58a-c132aad9ba3c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:55.138229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e50411-9435-4d52-a834-8b3ea1225a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:55.139836 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e50411-9435-4d52-a834-8b3ea1225a5a service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:55.146398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02503bf-2f62-43cd-a58a-c132aad9ba3c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:55.152257 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af6a87-37db-4793-93dd-9f4ed2575d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:55.153019 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af6a87-37db-4793-93dd-9f4ed2575d4c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:55.153379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af6a87-37db-4793-93dd-9f4ed2575d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:55.153708 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af6a87-37db-4793-93dd-9f4ed2575d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:55.154051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1058/2094] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:10:55.154671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af6a87-37db-4793-93dd-9f4ed2575d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:55.157115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af6a87-37db-4793-93dd-9f4ed2575d4c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:55.176819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1037/2095] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:55.181521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50411-9435-4d52-a834-8b3ea1225a5a service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:55.196880 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50411-9435-4d52-a834-8b3ea1225a5a service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:55.202364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a07f1-c65a-448f-bb00-b6f206b013a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:55.203020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a07f1-c65a-448f-bb00-b6f206b013a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:55.203294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a07f1-c65a-448f-bb00-b6f206b013a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:55.204288 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a07f1-c65a-448f-bb00-b6f206b013a0 admin admin] PATH_INFO: `/v3/projects/cf0fd28bd6b945b687373c0023e0af51/users/2af28528f00942558d31bb40636f1277/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:55.222942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a07f1-c65a-448f-bb00-b6f206b013a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0fd28bd6b945b687373c0023e0af51, user_id=2af28528f00942558d31bb40636f1277, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:55.226680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a07f1-c65a-448f-bb00-b6f206b013a0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:55.247033 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1059/2096] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:55 2022] PUT /identity/v3/projects/cf0fd28bd6b945b687373c0023e0af51/users/2af28528f00942558d31bb40636f1277/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:55.259496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f881e5-a54b-4768-9d16-643180916ea6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:55.259777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f881e5-a54b-4768-9d16-643180916ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:55.260080 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f881e5-a54b-4768-9d16-643180916ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:55.290671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:55.305359 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f1f881e5-a54b-4768-9d16-643180916ea6 None None] MFA Rules not processed for user `2af28528f00942558d31bb40636f1277`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:55.307431 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f1f881e5-a54b-4768-9d16-643180916ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:55.403190 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1038/2097] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:55.416652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a07f1-c65a-448f-bb00-b6f206b013a0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:55.418879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-476a07f1-c65a-448f-bb00-b6f206b013a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:55.474711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:55.494523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a07f1-c65a-448f-bb00-b6f206b013a0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:55.500179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9560291-d145-408b-8a23-20075a4dfe23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:55.501474 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9560291-d145-408b-8a23-20075a4dfe23 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:55.501748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9560291-d145-408b-8a23-20075a4dfe23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:55.502014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9560291-d145-408b-8a23-20075a4dfe23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:55.508549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f881e5-a54b-4768-9d16-643180916ea6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:55.510267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f1f881e5-a54b-4768-9d16-643180916ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:55.521804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9560291-d145-408b-8a23-20075a4dfe23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:55.525120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9560291-d145-408b-8a23-20075a4dfe23 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:55.540811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1060/2098] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:55.595499 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f881e5-a54b-4768-9d16-643180916ea6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:55.600869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1f9b6-3874-4de8-a86b-cafea231fe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:55.601503 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f9b6-3874-4de8-a86b-cafea231fe28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:55.601780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f9b6-3874-4de8-a86b-cafea231fe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:55.602055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f9b6-3874-4de8-a86b-cafea231fe28 admin admin] PATH_INFO: `/v3/projects/245ce493f4ee47ddaa100cd1d295a42a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:55.603188 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1f9b6-3874-4de8-a86b-cafea231fe28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=245ce493f4ee47ddaa100cd1d295a42a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:55.605490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1f9b6-3874-4de8-a86b-cafea231fe28 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:55.670869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fac1f9b6-3874-4de8-a86b-cafea231fe28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '245ce493f4ee47ddaa100cd1d295a42a', 'request_id': 'req-fac1f9b6-3874-4de8-a86b-cafea231fe28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:55.683224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fac1f9b6-3874-4de8-a86b-cafea231fe28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '245ce493f4ee47ddaa100cd1d295a42a', 'request_id': 'req-fac1f9b6-3874-4de8-a86b-cafea231fe28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:55.693106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fac1f9b6-3874-4de8-a86b-cafea231fe28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '245ce493f4ee47ddaa100cd1d295a42a', 'request_id': 'req-fac1f9b6-3874-4de8-a86b-cafea231fe28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:55.713638 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fac1f9b6-3874-4de8-a86b-cafea231fe28 admin admin] The token cache is being invalidate because project 245ce493f4ee47ddaa100cd1d295a42a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:55.714211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fac1f9b6-3874-4de8-a86b-cafea231fe28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:55.715317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fac1f9b6-3874-4de8-a86b-cafea231fe28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:55.718722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1039/2099] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:55 2022] DELETE /identity/v3/projects/245ce493f4ee47ddaa100cd1d295a42a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:55.726001 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b46b89-15f2-4f52-837d-5bd345e148dc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:55.726445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b46b89-15f2-4f52-837d-5bd345e148dc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:55.726538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b46b89-15f2-4f52-837d-5bd345e148dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:55.748456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-08b46b89-15f2-4f52-837d-5bd345e148dc None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:55.749924 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-08b46b89-15f2-4f52-837d-5bd345e148dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:55.824264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1061/2100] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:55.833368 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111d9f4-6a7f-4634-adae-991cf0e7e7aa None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:55.833809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111d9f4-6a7f-4634-adae-991cf0e7e7aa None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:55.834267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111d9f4-6a7f-4634-adae-991cf0e7e7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:55.855435 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4111d9f4-6a7f-4634-adae-991cf0e7e7aa None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:55.856756 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4111d9f4-6a7f-4634-adae-991cf0e7e7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:55.865734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1040/2101] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:55.870365 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b46b89-15f2-4f52-837d-5bd345e148dc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:55.881932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b46b89-15f2-4f52-837d-5bd345e148dc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:55.891588 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab611115-a8eb-4cd7-8b24-eb506575fc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:55.892294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab611115-a8eb-4cd7-8b24-eb506575fc6c admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:55.892643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab611115-a8eb-4cd7-8b24-eb506575fc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:55.892993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab611115-a8eb-4cd7-8b24-eb506575fc6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:55.893723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab611115-a8eb-4cd7-8b24-eb506575fc6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:55.894203 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab611115-a8eb-4cd7-8b24-eb506575fc6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:55.896751 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab611115-a8eb-4cd7-8b24-eb506575fc6c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:55.910728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1062/2102] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:55.915075 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111d9f4-6a7f-4634-adae-991cf0e7e7aa None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:55.925439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111d9f4-6a7f-4634-adae-991cf0e7e7aa None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:55.933876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a69549-c096-484d-9c9a-e3659f4eee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:55.933876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a69549-c096-484d-9c9a-e3659f4eee1f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:55.933876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a69549-c096-484d-9c9a-e3659f4eee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:55.933876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a69549-c096-484d-9c9a-e3659f4eee1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:55.934504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a69549-c096-484d-9c9a-e3659f4eee1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:55.936497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a69549-c096-484d-9c9a-e3659f4eee1f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:55.961647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:55.968538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1041/2103] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:55 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:10:55.973386 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab611115-a8eb-4cd7-8b24-eb506575fc6c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:55.985408 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab611115-a8eb-4cd7-8b24-eb506575fc6c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:56.063281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54e779-a839-4e08-aa48-64639a3610b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:56.064016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54e779-a839-4e08-aa48-64639a3610b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:56.064425 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54e779-a839-4e08-aa48-64639a3610b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:56.064734 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54e779-a839-4e08-aa48-64639a3610b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:56.065375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54e779-a839-4e08-aa48-64639a3610b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:56.067510 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54e779-a839-4e08-aa48-64639a3610b1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:56.091232 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1063/2104] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:55 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:56.095820 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a69549-c096-484d-9c9a-e3659f4eee1f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:56.106494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a69549-c096-484d-9c9a-e3659f4eee1f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:56.111564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4aeee0-965f-48db-b578-1fe0f5f86128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:56.112204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aeee0-965f-48db-b578-1fe0f5f86128 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:56.112960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aeee0-965f-48db-b578-1fe0f5f86128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:56.112960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aeee0-965f-48db-b578-1fe0f5f86128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:56.113384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4aeee0-965f-48db-b578-1fe0f5f86128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:56.114995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4aeee0-965f-48db-b578-1fe0f5f86128 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:56.127984 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1042/2105] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:10:56.130663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54e779-a839-4e08-aa48-64639a3610b1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:56.143092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54e779-a839-4e08-aa48-64639a3610b1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:56.147902 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d316d-f7a0-4668-8b11-7e3c23a540c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:56.148578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d316d-f7a0-4668-8b11-7e3c23a540c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:56.148854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d316d-f7a0-4668-8b11-7e3c23a540c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:56.149122 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d316d-f7a0-4668-8b11-7e3c23a540c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:56.149942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d316d-f7a0-4668-8b11-7e3c23a540c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:56.151543 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d316d-f7a0-4668-8b11-7e3c23a540c0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:56.164318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1064/2106] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:56.170650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4aeee0-965f-48db-b578-1fe0f5f86128 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:56.181600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4aeee0-965f-48db-b578-1fe0f5f86128 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:56.186594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b238d46-2e04-4bff-bfbf-14f1d9d41815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:56.187349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b238d46-2e04-4bff-bfbf-14f1d9d41815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:56.187828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b238d46-2e04-4bff-bfbf-14f1d9d41815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:56.188138 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b238d46-2e04-4bff-bfbf-14f1d9d41815 admin admin] PATH_INFO: `/v3/projects/0c8b2a7b974d43c3ae89752bba5bbec4/users/1b38fed124764d69818f8d6a08dbbf16/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:56.204029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b238d46-2e04-4bff-bfbf-14f1d9d41815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8b2a7b974d43c3ae89752bba5bbec4, user_id=1b38fed124764d69818f8d6a08dbbf16, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:56.207057 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b238d46-2e04-4bff-bfbf-14f1d9d41815 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:56.223387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1043/2107] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:56 2022] PUT /identity/v3/projects/0c8b2a7b974d43c3ae89752bba5bbec4/users/1b38fed124764d69818f8d6a08dbbf16/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:56.235122 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5d355-a082-456d-8afd-e2ffd2766bd5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:56.235401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5d355-a082-456d-8afd-e2ffd2766bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:56.235668 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5d355-a082-456d-8afd-e2ffd2766bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:56.265127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a0b5d355-a082-456d-8afd-e2ffd2766bd5 None None] MFA Rules not processed for user `1b38fed124764d69818f8d6a08dbbf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:56.266932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a0b5d355-a082-456d-8afd-e2ffd2766bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:56.311299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:56.336387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1065/2108] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:56.348907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b238d46-2e04-4bff-bfbf-14f1d9d41815 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:56.351109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1b238d46-2e04-4bff-bfbf-14f1d9d41815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:56.417489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b238d46-2e04-4bff-bfbf-14f1d9d41815 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:56.421142 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac2187-476a-48bb-be76-4942fc55776b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:56.421746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac2187-476a-48bb-be76-4942fc55776b service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:56.422024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac2187-476a-48bb-be76-4942fc55776b service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:56.422323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac2187-476a-48bb-be76-4942fc55776b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:56.431260 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac2187-476a-48bb-be76-4942fc55776b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:56.432768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac2187-476a-48bb-be76-4942fc55776b service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:56.442164 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1044/2109] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:56.863817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5d355-a082-456d-8afd-e2ffd2766bd5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:56.865369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a0b5d355-a082-456d-8afd-e2ffd2766bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:56.938641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5d355-a082-456d-8afd-e2ffd2766bd5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:56.943285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30bd25-d502-4354-bb93-1fa7167e4451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:56.943919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30bd25-d502-4354-bb93-1fa7167e4451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:56.944239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30bd25-d502-4354-bb93-1fa7167e4451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:56.944572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30bd25-d502-4354-bb93-1fa7167e4451 admin admin] PATH_INFO: `/v3/users/21b7869d3785441f94c3ead92c482a19` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:56.945718 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30bd25-d502-4354-bb93-1fa7167e4451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b7869d3785441f94c3ead92c482a19)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:56.948840 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30bd25-d502-4354-bb93-1fa7167e4451 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:57.010964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1c30bd25-d502-4354-bb93-1fa7167e4451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b7869d3785441f94c3ead92c482a19'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:57.018343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1c30bd25-d502-4354-bb93-1fa7167e4451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b7869d3785441f94c3ead92c482a19'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:57.026928 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1c30bd25-d502-4354-bb93-1fa7167e4451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b7869d3785441f94c3ead92c482a19'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:57.027549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1c30bd25-d502-4354-bb93-1fa7167e4451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b7869d3785441f94c3ead92c482a19'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:57.048738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1c30bd25-d502-4354-bb93-1fa7167e4451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b7869d3785441f94c3ead92c482a19'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:57.057972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1066/2110] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:56 2022] DELETE /identity/v3/users/21b7869d3785441f94c3ead92c482a19 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:57.059995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27fef6-e039-42a6-8cc1-e66eb4be399b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:57.060282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27fef6-e039-42a6-8cc1-e66eb4be399b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:57.060552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27fef6-e039-42a6-8cc1-e66eb4be399b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:57.081625 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9b27fef6-e039-42a6-8cc1-e66eb4be399b None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:57.082892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9b27fef6-e039-42a6-8cc1-e66eb4be399b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:57.147618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1045/2111] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:57.157825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30bd25-d502-4354-bb93-1fa7167e4451 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:57.159310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1c30bd25-d502-4354-bb93-1fa7167e4451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:57.230746 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30bd25-d502-4354-bb93-1fa7167e4451 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:57.235383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13949aa0-7d7f-47d7-9565-ffc2f1a1ba78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:57.236034 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13949aa0-7d7f-47d7-9565-ffc2f1a1ba78 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:57.236316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13949aa0-7d7f-47d7-9565-ffc2f1a1ba78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:57.236575 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13949aa0-7d7f-47d7-9565-ffc2f1a1ba78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:57.252412 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13949aa0-7d7f-47d7-9565-ffc2f1a1ba78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:57.254058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13949aa0-7d7f-47d7-9565-ffc2f1a1ba78 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:57.266136 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1067/2112] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:57.607646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27fef6-e039-42a6-8cc1-e66eb4be399b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:57.609989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9b27fef6-e039-42a6-8cc1-e66eb4be399b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:57.622458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27fef6-e039-42a6-8cc1-e66eb4be399b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:57.630534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245fdab-ce19-4ab3-a9dd-090ac36155f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:57.631789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245fdab-ce19-4ab3-a9dd-090ac36155f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:57.632311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245fdab-ce19-4ab3-a9dd-090ac36155f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:57.632820 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245fdab-ce19-4ab3-a9dd-090ac36155f1 admin admin] PATH_INFO: `/v3/projects/59b70f50bccc4b88b57c9d8260ef2118` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:57.635162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245fdab-ce19-4ab3-a9dd-090ac36155f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b70f50bccc4b88b57c9d8260ef2118)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:57.638200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245fdab-ce19-4ab3-a9dd-090ac36155f1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:57.770491 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7245fdab-ce19-4ab3-a9dd-090ac36155f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b70f50bccc4b88b57c9d8260ef2118', 'request_id': 'req-7245fdab-ce19-4ab3-a9dd-090ac36155f1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:57.779365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7245fdab-ce19-4ab3-a9dd-090ac36155f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b70f50bccc4b88b57c9d8260ef2118', 'request_id': 'req-7245fdab-ce19-4ab3-a9dd-090ac36155f1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:57.794162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7245fdab-ce19-4ab3-a9dd-090ac36155f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b70f50bccc4b88b57c9d8260ef2118', 'request_id': 'req-7245fdab-ce19-4ab3-a9dd-090ac36155f1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:57.794162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:57.820920 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7245fdab-ce19-4ab3-a9dd-090ac36155f1 admin admin] The token cache is being invalidate because project 59b70f50bccc4b88b57c9d8260ef2118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:57.821287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7245fdab-ce19-4ab3-a9dd-090ac36155f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:57.821854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7245fdab-ce19-4ab3-a9dd-090ac36155f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:57.823376 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1046/2113] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:57 2022] DELETE /identity/v3/projects/59b70f50bccc4b88b57c9d8260ef2118 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:57.827977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13949aa0-7d7f-47d7-9565-ffc2f1a1ba78 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:57.837994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:57.842662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13949aa0-7d7f-47d7-9565-ffc2f1a1ba78 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:57.878472 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a831452-86f4-4300-8f2d-41eda48824cd None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:57.878752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a831452-86f4-4300-8f2d-41eda48824cd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:57.879027 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a831452-86f4-4300-8f2d-41eda48824cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:57.900446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8a831452-86f4-4300-8f2d-41eda48824cd None None] MFA Rules not processed for user `1b38fed124764d69818f8d6a08dbbf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:57.901683 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8a831452-86f4-4300-8f2d-41eda48824cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:57.906474 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6570004-9f84-46f7-b3f7-5eb0eb953291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:57.907270 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6570004-9f84-46f7-b3f7-5eb0eb953291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:57.907547 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6570004-9f84-46f7-b3f7-5eb0eb953291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:57.907821 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6570004-9f84-46f7-b3f7-5eb0eb953291 admin admin] PATH_INFO: `/v3/users/297d14e68745476eb292eeb8d1ea2058` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:57.909198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6570004-9f84-46f7-b3f7-5eb0eb953291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=297d14e68745476eb292eeb8d1ea2058)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:57.911366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6570004-9f84-46f7-b3f7-5eb0eb953291 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:57.959870 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1047/2114] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:57.964471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b6570004-9f84-46f7-b3f7-5eb0eb953291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297d14e68745476eb292eeb8d1ea2058'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:57.972275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b6570004-9f84-46f7-b3f7-5eb0eb953291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297d14e68745476eb292eeb8d1ea2058'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:57.981381 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b6570004-9f84-46f7-b3f7-5eb0eb953291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297d14e68745476eb292eeb8d1ea2058'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:57.982244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b6570004-9f84-46f7-b3f7-5eb0eb953291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297d14e68745476eb292eeb8d1ea2058'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:57.999912 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b6570004-9f84-46f7-b3f7-5eb0eb953291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297d14e68745476eb292eeb8d1ea2058'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:58.006841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1068/2115] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:57 2022] DELETE /identity/v3/users/297d14e68745476eb292eeb8d1ea2058 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:58.537418 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a831452-86f4-4300-8f2d-41eda48824cd None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:58.540332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8a831452-86f4-4300-8f2d-41eda48824cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:58.585928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a831452-86f4-4300-8f2d-41eda48824cd None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:58.696796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a921fc-6292-4183-8545-95bee9aaa97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:58.697495 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a921fc-6292-4183-8545-95bee9aaa97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:58.697727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a921fc-6292-4183-8545-95bee9aaa97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:58.698055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a921fc-6292-4183-8545-95bee9aaa97e admin admin] PATH_INFO: `/v3/projects/a554be58bae7458795a6c6e5c40970ca` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:58.699286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a921fc-6292-4183-8545-95bee9aaa97e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a554be58bae7458795a6c6e5c40970ca)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:58.701451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a921fc-6292-4183-8545-95bee9aaa97e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:58.759008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-63a921fc-6292-4183-8545-95bee9aaa97e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a554be58bae7458795a6c6e5c40970ca', 'request_id': 'req-63a921fc-6292-4183-8545-95bee9aaa97e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:58.769202 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-63a921fc-6292-4183-8545-95bee9aaa97e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a554be58bae7458795a6c6e5c40970ca', 'request_id': 'req-63a921fc-6292-4183-8545-95bee9aaa97e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:58.777924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-63a921fc-6292-4183-8545-95bee9aaa97e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a554be58bae7458795a6c6e5c40970ca', 'request_id': 'req-63a921fc-6292-4183-8545-95bee9aaa97e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:58.791535 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-63a921fc-6292-4183-8545-95bee9aaa97e admin admin] The token cache is being invalidate because project a554be58bae7458795a6c6e5c40970ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:58.791931 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-63a921fc-6292-4183-8545-95bee9aaa97e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:58.792919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-63a921fc-6292-4183-8545-95bee9aaa97e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:58.794922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1048/2116] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:58 2022] DELETE /identity/v3/projects/a554be58bae7458795a6c6e5c40970ca => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:58.800274 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6570004-9f84-46f7-b3f7-5eb0eb953291 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:58.801845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b6570004-9f84-46f7-b3f7-5eb0eb953291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:58.820296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6570004-9f84-46f7-b3f7-5eb0eb953291 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:58.922393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cdfa1-739a-4203-bd12-96c805109814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:58.923920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cdfa1-739a-4203-bd12-96c805109814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:58.924524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cdfa1-739a-4203-bd12-96c805109814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:58.925004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cdfa1-739a-4203-bd12-96c805109814 admin admin] PATH_INFO: `/v3/users/81769ac0ba2843068876d448b38accc7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:58.926548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cdfa1-739a-4203-bd12-96c805109814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81769ac0ba2843068876d448b38accc7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:58.928943 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cdfa1-739a-4203-bd12-96c805109814 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:58.969504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:59.022450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ea9cdfa1-739a-4203-bd12-96c805109814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81769ac0ba2843068876d448b38accc7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:59.037214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ea9cdfa1-739a-4203-bd12-96c805109814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81769ac0ba2843068876d448b38accc7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:59.055178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ea9cdfa1-739a-4203-bd12-96c805109814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81769ac0ba2843068876d448b38accc7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:59.056618 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ea9cdfa1-739a-4203-bd12-96c805109814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81769ac0ba2843068876d448b38accc7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:59.075660 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ea9cdfa1-739a-4203-bd12-96c805109814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81769ac0ba2843068876d448b38accc7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:59.084821 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1069/2117] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:58 2022] DELETE /identity/v3/users/81769ac0ba2843068876d448b38accc7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:59.426267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a921fc-6292-4183-8545-95bee9aaa97e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:59.437542 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-63a921fc-6292-4183-8545-95bee9aaa97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:59.452819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a921fc-6292-4183-8545-95bee9aaa97e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:59.480697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:59.515994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23177981-2465-41c4-a4ac-f7b462166bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:59.516623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23177981-2465-41c4-a4ac-f7b462166bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:59.516897 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23177981-2465-41c4-a4ac-f7b462166bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:59.517165 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23177981-2465-41c4-a4ac-f7b462166bb4 admin admin] PATH_INFO: `/v3/projects/d11468e63c3940a7890d26c93b0a3c36` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:59.518266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23177981-2465-41c4-a4ac-f7b462166bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11468e63c3940a7890d26c93b0a3c36)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:59.520185 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23177981-2465-41c4-a4ac-f7b462166bb4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:59.567462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-23177981-2465-41c4-a4ac-f7b462166bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11468e63c3940a7890d26c93b0a3c36', 'request_id': 'req-23177981-2465-41c4-a4ac-f7b462166bb4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:59.573669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-23177981-2465-41c4-a4ac-f7b462166bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11468e63c3940a7890d26c93b0a3c36', 'request_id': 'req-23177981-2465-41c4-a4ac-f7b462166bb4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:59.579778 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-23177981-2465-41c4-a4ac-f7b462166bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11468e63c3940a7890d26c93b0a3c36', 'request_id': 'req-23177981-2465-41c4-a4ac-f7b462166bb4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:59.593665 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-23177981-2465-41c4-a4ac-f7b462166bb4 admin admin] The token cache is being invalidate because project d11468e63c3940a7890d26c93b0a3c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:59.594607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-23177981-2465-41c4-a4ac-f7b462166bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:59.595699 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-23177981-2465-41c4-a4ac-f7b462166bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:59.597199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1049/2118] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:59 2022] DELETE /identity/v3/projects/d11468e63c3940a7890d26c93b0a3c36 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:59.602312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da137e-460c-400d-8e45-29ea37aa2ed7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:59.602592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da137e-460c-400d-8e45-29ea37aa2ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:59.602862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da137e-460c-400d-8e45-29ea37aa2ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:59.626339 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-36da137e-460c-400d-8e45-29ea37aa2ed7 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:59.627605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-36da137e-460c-400d-8e45-29ea37aa2ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:59.698677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1070/2119] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:59.706235 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a49036-46de-4bed-a1a9-def70d780a27 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:59.707143 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a49036-46de-4bed-a1a9-def70d780a27 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:59.707143 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a49036-46de-4bed-a1a9-def70d780a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:59.732636 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-79a49036-46de-4bed-a1a9-def70d780a27 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:59.734101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-79a49036-46de-4bed-a1a9-def70d780a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:59.748652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1050/2120] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:10:59.749868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da137e-460c-400d-8e45-29ea37aa2ed7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:59.760923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da137e-460c-400d-8e45-29ea37aa2ed7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:59.767980 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a254d7-7a41-459d-a340-a24301953aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:59.768626 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a254d7-7a41-459d-a340-a24301953aac admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:59.768900 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a254d7-7a41-459d-a340-a24301953aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:59.769173 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a254d7-7a41-459d-a340-a24301953aac admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:59.769814 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a254d7-7a41-459d-a340-a24301953aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:59.770114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a254d7-7a41-459d-a340-a24301953aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:59.771707 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a254d7-7a41-459d-a340-a24301953aac admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:59.788901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1071/2121] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:59.790038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a49036-46de-4bed-a1a9-def70d780a27 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:59.807057 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a49036-46de-4bed-a1a9-def70d780a27 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:59.813429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09f76a-777b-4ea5-9944-532af4d5bf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:59.814040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09f76a-777b-4ea5-9944-532af4d5bf1a admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:59.814381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09f76a-777b-4ea5-9944-532af4d5bf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:59.814656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09f76a-777b-4ea5-9944-532af4d5bf1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:59.815302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09f76a-777b-4ea5-9944-532af4d5bf1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:59.817255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09f76a-777b-4ea5-9944-532af4d5bf1a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:59.846744 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1051/2122] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:59 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:59.851462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a254d7-7a41-459d-a340-a24301953aac admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:59.861139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a254d7-7a41-459d-a340-a24301953aac admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:59.921786 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6971da0-93da-4c22-bb2c-c2bb7f39410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:59.922527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6971da0-93da-4c22-bb2c-c2bb7f39410c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:59.923111 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6971da0-93da-4c22-bb2c-c2bb7f39410c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:59.923218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6971da0-93da-4c22-bb2c-c2bb7f39410c admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:59.923867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6971da0-93da-4c22-bb2c-c2bb7f39410c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:59.926003 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6971da0-93da-4c22-bb2c-c2bb7f39410c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:59.950973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1072/2123] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:59 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:59.952290 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09f76a-777b-4ea5-9944-532af4d5bf1a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:59.964455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09f76a-777b-4ea5-9944-532af4d5bf1a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:59.970443 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab6eb9-3c09-43cc-83ba-afd00658abab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:59.971191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab6eb9-3c09-43cc-83ba-afd00658abab admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:59.971474 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab6eb9-3c09-43cc-83ba-afd00658abab admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:59.971753 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab6eb9-3c09-43cc-83ba-afd00658abab admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:59.972445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab6eb9-3c09-43cc-83ba-afd00658abab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:59.974050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab6eb9-3c09-43cc-83ba-afd00658abab admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:59.996039 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1052/2124] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:59.997257 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6971da0-93da-4c22-bb2c-c2bb7f39410c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:00.008398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6971da0-93da-4c22-bb2c-c2bb7f39410c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:00.013618 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00065035-edd8-4183-aa01-372ac5f2ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:00.014226 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00065035-edd8-4183-aa01-372ac5f2ead7 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:00.014507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00065035-edd8-4183-aa01-372ac5f2ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:00.014779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00065035-edd8-4183-aa01-372ac5f2ead7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:00.015579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00065035-edd8-4183-aa01-372ac5f2ead7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:00.017825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00065035-edd8-4183-aa01-372ac5f2ead7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:00.032351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1073/2125] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:00.036413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab6eb9-3c09-43cc-83ba-afd00658abab admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:00.050594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab6eb9-3c09-43cc-83ba-afd00658abab admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:00.056040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a13323-3fe6-469e-b158-764d090e3af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:00.056737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a13323-3fe6-469e-b158-764d090e3af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:00.057266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a13323-3fe6-469e-b158-764d090e3af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:00.057596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a13323-3fe6-469e-b158-764d090e3af2 admin admin] PATH_INFO: `/v3/projects/fde824abf6e84fe0b131c77d423e72ab/users/2619b488acfd4905ac8ce4269907e042/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:00.076751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a13323-3fe6-469e-b158-764d090e3af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde824abf6e84fe0b131c77d423e72ab, user_id=2619b488acfd4905ac8ce4269907e042, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:00.080575 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a13323-3fe6-469e-b158-764d090e3af2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:00.111519 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1053/2126] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:00 2022] PUT /identity/v3/projects/fde824abf6e84fe0b131c77d423e72ab/users/2619b488acfd4905ac8ce4269907e042/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:00.116206 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d2c1c-52ac-4f8e-b252-4bf3aef238b1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:00.116498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d2c1c-52ac-4f8e-b252-4bf3aef238b1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:00.116940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d2c1c-52ac-4f8e-b252-4bf3aef238b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:00.138205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:00.153712 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bd6d2c1c-52ac-4f8e-b252-4bf3aef238b1 None None] MFA Rules not processed for user `2619b488acfd4905ac8ce4269907e042`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:00.155282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bd6d2c1c-52ac-4f8e-b252-4bf3aef238b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:00.272870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1074/2127] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:00.285806 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a13323-3fe6-469e-b158-764d090e3af2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:00.287531 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-62a13323-3fe6-469e-b158-764d090e3af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:00.359929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a13323-3fe6-469e-b158-764d090e3af2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:00.364146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ae726-85c7-46c7-b580-e6de38fcfbd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:00.364689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ae726-85c7-46c7-b580-e6de38fcfbd3 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:00.364966 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ae726-85c7-46c7-b580-e6de38fcfbd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:00.365236 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ae726-85c7-46c7-b580-e6de38fcfbd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:00.372891 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:00.376114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ae726-85c7-46c7-b580-e6de38fcfbd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:00.377572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ae726-85c7-46c7-b580-e6de38fcfbd3 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:00.393801 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1054/2128] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:00.418386 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d2c1c-52ac-4f8e-b252-4bf3aef238b1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:00.520091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d2c1c-52ac-4f8e-b252-4bf3aef238b1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:00.532558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acf962-b4c9-4e24-b170-87e8f8820862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:00.534975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acf962-b4c9-4e24-b170-87e8f8820862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:00.535498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acf962-b4c9-4e24-b170-87e8f8820862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:00.536239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acf962-b4c9-4e24-b170-87e8f8820862 admin admin] PATH_INFO: `/v3/users/2619b488acfd4905ac8ce4269907e042` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:00.538393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acf962-b4c9-4e24-b170-87e8f8820862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2619b488acfd4905ac8ce4269907e042)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:00.541911 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acf962-b4c9-4e24-b170-87e8f8820862 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:00.618282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b7acf962-b4c9-4e24-b170-87e8f8820862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2619b488acfd4905ac8ce4269907e042'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:00.645315 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b7acf962-b4c9-4e24-b170-87e8f8820862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2619b488acfd4905ac8ce4269907e042'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:00.686127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b7acf962-b4c9-4e24-b170-87e8f8820862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2619b488acfd4905ac8ce4269907e042'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:00.689115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b7acf962-b4c9-4e24-b170-87e8f8820862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2619b488acfd4905ac8ce4269907e042'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:00.712641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b7acf962-b4c9-4e24-b170-87e8f8820862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2619b488acfd4905ac8ce4269907e042'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:00.720287 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1075/2129] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:00 2022] DELETE /identity/v3/users/2619b488acfd4905ac8ce4269907e042 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:00.732225 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3580e57-a5c6-45d6-a8d8-da737d0f64e1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:00.732225 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3580e57-a5c6-45d6-a8d8-da737d0f64e1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:00.732225 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3580e57-a5c6-45d6-a8d8-da737d0f64e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:00.752552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d3580e57-a5c6-45d6-a8d8-da737d0f64e1 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:00.753783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d3580e57-a5c6-45d6-a8d8-da737d0f64e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:00.854095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1055/2130] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:00.867805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acf962-b4c9-4e24-b170-87e8f8820862 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:00.869756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b7acf962-b4c9-4e24-b170-87e8f8820862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:00.898208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:00.961733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acf962-b4c9-4e24-b170-87e8f8820862 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:00.966408 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22af9b-a5db-4e93-8b95-c921342b3a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:00.967041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22af9b-a5db-4e93-8b95-c921342b3a30 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:00.967457 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22af9b-a5db-4e93-8b95-c921342b3a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:00.970083 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22af9b-a5db-4e93-8b95-c921342b3a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:00.995873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22af9b-a5db-4e93-8b95-c921342b3a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:00.998280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22af9b-a5db-4e93-8b95-c921342b3a30 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:01.012429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1076/2131] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:01.364955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3580e57-a5c6-45d6-a8d8-da737d0f64e1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:01.366368 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d3580e57-a5c6-45d6-a8d8-da737d0f64e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:01.395368 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3580e57-a5c6-45d6-a8d8-da737d0f64e1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:01.404341 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b6fa2-59df-4c47-a9da-27a52846c201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:01.405463 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b6fa2-59df-4c47-a9da-27a52846c201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:01.407186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b6fa2-59df-4c47-a9da-27a52846c201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:01.408340 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b6fa2-59df-4c47-a9da-27a52846c201 admin admin] PATH_INFO: `/v3/projects/fde824abf6e84fe0b131c77d423e72ab` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:01.412230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b6fa2-59df-4c47-a9da-27a52846c201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde824abf6e84fe0b131c77d423e72ab)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:01.414191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b6fa2-59df-4c47-a9da-27a52846c201 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:01.472617 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fd9b6fa2-59df-4c47-a9da-27a52846c201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde824abf6e84fe0b131c77d423e72ab', 'request_id': 'req-fd9b6fa2-59df-4c47-a9da-27a52846c201'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:01.479074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fd9b6fa2-59df-4c47-a9da-27a52846c201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde824abf6e84fe0b131c77d423e72ab', 'request_id': 'req-fd9b6fa2-59df-4c47-a9da-27a52846c201'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:01.485559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fd9b6fa2-59df-4c47-a9da-27a52846c201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde824abf6e84fe0b131c77d423e72ab', 'request_id': 'req-fd9b6fa2-59df-4c47-a9da-27a52846c201'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:01.498760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fd9b6fa2-59df-4c47-a9da-27a52846c201 admin admin] The token cache is being invalidate because project fde824abf6e84fe0b131c77d423e72ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:01.499049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fd9b6fa2-59df-4c47-a9da-27a52846c201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:01.499701 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fd9b6fa2-59df-4c47-a9da-27a52846c201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:01.501411 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1056/2132] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:01 2022] DELETE /identity/v3/projects/fde824abf6e84fe0b131c77d423e72ab => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:01.507051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422253f-ed98-46b5-bf88-e7c9ddf364c4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:01.507530 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422253f-ed98-46b5-bf88-e7c9ddf364c4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:01.508053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422253f-ed98-46b5-bf88-e7c9ddf364c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:01.533549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8422253f-ed98-46b5-bf88-e7c9ddf364c4 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:01.534690 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8422253f-ed98-46b5-bf88-e7c9ddf364c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:01.616736 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1077/2133] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:01.624722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f197d8f-4303-4222-82a5-66266825d41c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:01.625023 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f197d8f-4303-4222-82a5-66266825d41c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:01.625299 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f197d8f-4303-4222-82a5-66266825d41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:01.656252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0f197d8f-4303-4222-82a5-66266825d41c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:01.658238 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0f197d8f-4303-4222-82a5-66266825d41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:01.670469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1057/2134] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:01.674086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422253f-ed98-46b5-bf88-e7c9ddf364c4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:01.693497 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422253f-ed98-46b5-bf88-e7c9ddf364c4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:01.698879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5125b-bc04-48d0-8320-cc1430b4ea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:01.699498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5125b-bc04-48d0-8320-cc1430b4ea25 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:01.699768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5125b-bc04-48d0-8320-cc1430b4ea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:01.700135 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5125b-bc04-48d0-8320-cc1430b4ea25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:01.700791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5125b-bc04-48d0-8320-cc1430b4ea25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:11:01.701151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5125b-bc04-48d0-8320-cc1430b4ea25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:01.702833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5125b-bc04-48d0-8320-cc1430b4ea25 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:01.718181 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1078/2135] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:11:01.723275 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f197d8f-4303-4222-82a5-66266825d41c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:01.734149 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f197d8f-4303-4222-82a5-66266825d41c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:01.740183 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd5d03-aa73-4f67-83e9-2fca5e523218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:01.740894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd5d03-aa73-4f67-83e9-2fca5e523218 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:01.741519 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd5d03-aa73-4f67-83e9-2fca5e523218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:01.741519 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd5d03-aa73-4f67-83e9-2fca5e523218 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:01.742379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd5d03-aa73-4f67-83e9-2fca5e523218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:01.744409 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd5d03-aa73-4f67-83e9-2fca5e523218 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:01.790021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1058/2136] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:01 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:01.793909 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5125b-bc04-48d0-8320-cc1430b4ea25 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:01.821519 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5125b-bc04-48d0-8320-cc1430b4ea25 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:01.919606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14f89b-ffa0-46ea-8a12-9ddcd546d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:01.920260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14f89b-ffa0-46ea-8a12-9ddcd546d765 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:01.920541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14f89b-ffa0-46ea-8a12-9ddcd546d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:01.921168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14f89b-ffa0-46ea-8a12-9ddcd546d765 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:01.921817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14f89b-ffa0-46ea-8a12-9ddcd546d765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:01.924824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14f89b-ffa0-46ea-8a12-9ddcd546d765 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:01.953016 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1079/2137] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:01 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:01.957915 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd5d03-aa73-4f67-83e9-2fca5e523218 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:01.971076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd5d03-aa73-4f67-83e9-2fca5e523218 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:01.977701 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79169c7-ef47-47b4-83b1-b6cb3662e3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:01.978528 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79169c7-ef47-47b4-83b1-b6cb3662e3dc admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:01.978815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79169c7-ef47-47b4-83b1-b6cb3662e3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:01.979056 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79169c7-ef47-47b4-83b1-b6cb3662e3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:01.979775 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79169c7-ef47-47b4-83b1-b6cb3662e3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:01.981338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79169c7-ef47-47b4-83b1-b6cb3662e3dc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:02.002532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1059/2138] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:02.003803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14f89b-ffa0-46ea-8a12-9ddcd546d765 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:02.016246 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14f89b-ffa0-46ea-8a12-9ddcd546d765 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:02.022727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d658f-cccd-4fc8-a637-746c1abd0665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:02.023292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d658f-cccd-4fc8-a637-746c1abd0665 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:02.024068 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d658f-cccd-4fc8-a637-746c1abd0665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:02.024068 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d658f-cccd-4fc8-a637-746c1abd0665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:02.024696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d658f-cccd-4fc8-a637-746c1abd0665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:02.026415 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d658f-cccd-4fc8-a637-746c1abd0665 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:02.038567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1080/2139] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:02.043574 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79169c7-ef47-47b4-83b1-b6cb3662e3dc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:02.055456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79169c7-ef47-47b4-83b1-b6cb3662e3dc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:02.063090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61921a4-4be2-417a-ab64-d62c34cd53e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:02.064051 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61921a4-4be2-417a-ab64-d62c34cd53e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:02.064376 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61921a4-4be2-417a-ab64-d62c34cd53e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:02.064573 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61921a4-4be2-417a-ab64-d62c34cd53e6 admin admin] PATH_INFO: `/v3/projects/d37f569b67ab40bf9514168d37729ccb/users/317434edeb014db0a656c8e777d875cb/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:02.093116 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61921a4-4be2-417a-ab64-d62c34cd53e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37f569b67ab40bf9514168d37729ccb, user_id=317434edeb014db0a656c8e777d875cb, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:02.095247 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61921a4-4be2-417a-ab64-d62c34cd53e6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:02.113105 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1060/2140] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:02 2022] PUT /identity/v3/projects/d37f569b67ab40bf9514168d37729ccb/users/317434edeb014db0a656c8e777d875cb/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:02.127599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3105c42-3636-4a19-8228-a419da52990f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:02.127903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3105c42-3636-4a19-8228-a419da52990f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:02.128426 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3105c42-3636-4a19-8228-a419da52990f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:02.164915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c3105c42-3636-4a19-8228-a419da52990f None None] MFA Rules not processed for user `317434edeb014db0a656c8e777d875cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:02.166240 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c3105c42-3636-4a19-8228-a419da52990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:02.182479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:02.245273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1081/2141] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:02.257512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61921a4-4be2-417a-ab64-d62c34cd53e6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:02.259751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c61921a4-4be2-417a-ab64-d62c34cd53e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:02.279690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:02.326801 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61921a4-4be2-417a-ab64-d62c34cd53e6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:02.330930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0ac12-8b47-422d-bfe2-6716517c1e30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:02.331532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0ac12-8b47-422d-bfe2-6716517c1e30 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:02.331808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0ac12-8b47-422d-bfe2-6716517c1e30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:02.332105 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0ac12-8b47-422d-bfe2-6716517c1e30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:02.342387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0ac12-8b47-422d-bfe2-6716517c1e30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:02.344570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0ac12-8b47-422d-bfe2-6716517c1e30 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:02.354062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1061/2142] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:02.457261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f03a6-259d-4964-8cd9-f1f39641e9c3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:02.457538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f03a6-259d-4964-8cd9-f1f39641e9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:02.457812 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f03a6-259d-4964-8cd9-f1f39641e9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:02.478563 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-731f03a6-259d-4964-8cd9-f1f39641e9c3 None None] MFA Rules not processed for user `0d76ffdd74df41bd89c380798be621a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:02.479911 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-731f03a6-259d-4964-8cd9-f1f39641e9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:02.596145 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1082/2143] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:05.376488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0ac12-8b47-422d-bfe2-6716517c1e30 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:05.377896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5dd0ac12-8b47-422d-bfe2-6716517c1e30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:05.492068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0ac12-8b47-422d-bfe2-6716517c1e30 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:05.507357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc6c2e-65cc-4e37-ba33-2b6a7038819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:05.508792 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc6c2e-65cc-4e37-ba33-2b6a7038819f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:05.509076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc6c2e-65cc-4e37-ba33-2b6a7038819f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:05.509348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc6c2e-65cc-4e37-ba33-2b6a7038819f admin admin] PATH_INFO: `/v3/users/2af28528f00942558d31bb40636f1277` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:05.510585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc6c2e-65cc-4e37-ba33-2b6a7038819f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af28528f00942558d31bb40636f1277)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:05.512650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc6c2e-65cc-4e37-ba33-2b6a7038819f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:05.583850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-11fc6c2e-65cc-4e37-ba33-2b6a7038819f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af28528f00942558d31bb40636f1277'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:05.605874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-11fc6c2e-65cc-4e37-ba33-2b6a7038819f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af28528f00942558d31bb40636f1277'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:05.618558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-11fc6c2e-65cc-4e37-ba33-2b6a7038819f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af28528f00942558d31bb40636f1277'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:05.619274 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-11fc6c2e-65cc-4e37-ba33-2b6a7038819f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af28528f00942558d31bb40636f1277'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:05.619935 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-11fc6c2e-65cc-4e37-ba33-2b6a7038819f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af28528f00942558d31bb40636f1277'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:05.639655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1062/2144] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:05 2022] DELETE /identity/v3/users/2af28528f00942558d31bb40636f1277 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:05.644828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde2977-9388-4176-91a6-59436167f2ce None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:05.645360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde2977-9388-4176-91a6-59436167f2ce None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:05.645989 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde2977-9388-4176-91a6-59436167f2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:05.668067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2dde2977-9388-4176-91a6-59436167f2ce None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:05.669299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2dde2977-9388-4176-91a6-59436167f2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:05.743719 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1083/2145] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:05.761960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc6c2e-65cc-4e37-ba33-2b6a7038819f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:05.763367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-11fc6c2e-65cc-4e37-ba33-2b6a7038819f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:05.826644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:05.850263 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc6c2e-65cc-4e37-ba33-2b6a7038819f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:05.858659 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455b640-2059-4a39-a0c2-e9359213abb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:05.859967 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455b640-2059-4a39-a0c2-e9359213abb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:05.860459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455b640-2059-4a39-a0c2-e9359213abb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:05.861514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455b640-2059-4a39-a0c2-e9359213abb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:05.876743 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455b640-2059-4a39-a0c2-e9359213abb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:05.878204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455b640-2059-4a39-a0c2-e9359213abb2 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:05.899977 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1063/2146] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:06.477300 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde2977-9388-4176-91a6-59436167f2ce None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:06.478818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2dde2977-9388-4176-91a6-59436167f2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:06.497345 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde2977-9388-4176-91a6-59436167f2ce None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:06.502989 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bc41a-994a-460f-813f-73a8230db064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:06.503646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bc41a-994a-460f-813f-73a8230db064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:06.503934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bc41a-994a-460f-813f-73a8230db064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:06.504232 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bc41a-994a-460f-813f-73a8230db064 admin admin] PATH_INFO: `/v3/projects/cf0fd28bd6b945b687373c0023e0af51` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:06.505405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bc41a-994a-460f-813f-73a8230db064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0fd28bd6b945b687373c0023e0af51)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:06.507587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bc41a-994a-460f-813f-73a8230db064 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:06.558750 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7b1bc41a-994a-460f-813f-73a8230db064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0fd28bd6b945b687373c0023e0af51', 'request_id': 'req-7b1bc41a-994a-460f-813f-73a8230db064'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:06.564526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:06.566087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7b1bc41a-994a-460f-813f-73a8230db064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0fd28bd6b945b687373c0023e0af51', 'request_id': 'req-7b1bc41a-994a-460f-813f-73a8230db064'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:06.574644 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7b1bc41a-994a-460f-813f-73a8230db064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0fd28bd6b945b687373c0023e0af51', 'request_id': 'req-7b1bc41a-994a-460f-813f-73a8230db064'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:06.588825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7b1bc41a-994a-460f-813f-73a8230db064 admin admin] The token cache is being invalidate because project cf0fd28bd6b945b687373c0023e0af51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:06.589169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7b1bc41a-994a-460f-813f-73a8230db064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:06.589851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7b1bc41a-994a-460f-813f-73a8230db064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:06.591356 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1084/2147] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:06 2022] DELETE /identity/v3/projects/cf0fd28bd6b945b687373c0023e0af51 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:11:06.596398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f298e0f-b8aa-44c3-9b4d-2b248fad314c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:06.596896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f298e0f-b8aa-44c3-9b4d-2b248fad314c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:06.596896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f298e0f-b8aa-44c3-9b4d-2b248fad314c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:06.617412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0f298e0f-b8aa-44c3-9b4d-2b248fad314c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:06.618649 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0f298e0f-b8aa-44c3-9b4d-2b248fad314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:06.682210 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1064/2148] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:06.690638 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f92f7-1042-42cc-b590-1693286b7d3e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:06.691098 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f92f7-1042-42cc-b590-1693286b7d3e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:06.691216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f92f7-1042-42cc-b590-1693286b7d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:06.712062 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-855f92f7-1042-42cc-b590-1693286b7d3e None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:06.713353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-855f92f7-1042-42cc-b590-1693286b7d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:06.723584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1085/2149] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:06.728069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f298e0f-b8aa-44c3-9b4d-2b248fad314c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:06.738285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f298e0f-b8aa-44c3-9b4d-2b248fad314c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:06.742918 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b0454-d9f3-4aa9-8b70-7bbac55169bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:06.743524 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b0454-d9f3-4aa9-8b70-7bbac55169bd admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:06.743803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b0454-d9f3-4aa9-8b70-7bbac55169bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:06.744172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b0454-d9f3-4aa9-8b70-7bbac55169bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:06.744824 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b0454-d9f3-4aa9-8b70-7bbac55169bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:11:06.745198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b0454-d9f3-4aa9-8b70-7bbac55169bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:06.746767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b0454-d9f3-4aa9-8b70-7bbac55169bd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:06.760301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1065/2150] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:11:06.764447 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f92f7-1042-42cc-b590-1693286b7d3e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:06.775119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f92f7-1042-42cc-b590-1693286b7d3e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:06.780713 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49ef03-c357-4f7d-a016-4ffd8e12ed07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:06.782303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49ef03-c357-4f7d-a016-4ffd8e12ed07 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:06.782711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49ef03-c357-4f7d-a016-4ffd8e12ed07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:06.783048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49ef03-c357-4f7d-a016-4ffd8e12ed07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:06.783742 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49ef03-c357-4f7d-a016-4ffd8e12ed07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:06.785715 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49ef03-c357-4f7d-a016-4ffd8e12ed07 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:06.821666 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1086/2151] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:06 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:06.822965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b0454-d9f3-4aa9-8b70-7bbac55169bd admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:06.833156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b0454-d9f3-4aa9-8b70-7bbac55169bd admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:06.897189 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1918eeb-739d-4b1a-958d-6501b6ee0795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:06.898066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1918eeb-739d-4b1a-958d-6501b6ee0795 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:06.898438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1918eeb-739d-4b1a-958d-6501b6ee0795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:06.898805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1918eeb-739d-4b1a-958d-6501b6ee0795 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:06.899546 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1918eeb-739d-4b1a-958d-6501b6ee0795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:06.901641 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1918eeb-739d-4b1a-958d-6501b6ee0795 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:06.929334 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1066/2152] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:06 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:06.933673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49ef03-c357-4f7d-a016-4ffd8e12ed07 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:06.945432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49ef03-c357-4f7d-a016-4ffd8e12ed07 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:06.951746 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c65aa5-dc9e-4729-b70c-fbbee98116d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:06.951746 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c65aa5-dc9e-4729-b70c-fbbee98116d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:06.952266 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c65aa5-dc9e-4729-b70c-fbbee98116d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:06.952659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c65aa5-dc9e-4729-b70c-fbbee98116d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:06.953445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c65aa5-dc9e-4729-b70c-fbbee98116d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:06.955122 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c65aa5-dc9e-4729-b70c-fbbee98116d5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:06.967993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1087/2153] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:06.971589 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1918eeb-739d-4b1a-958d-6501b6ee0795 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:06.983445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1918eeb-739d-4b1a-958d-6501b6ee0795 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:06.989816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27162766-07c5-4b18-af98-d7460faa5679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:06.990554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27162766-07c5-4b18-af98-d7460faa5679 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:06.990946 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27162766-07c5-4b18-af98-d7460faa5679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:06.991721 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27162766-07c5-4b18-af98-d7460faa5679 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:06.992055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27162766-07c5-4b18-af98-d7460faa5679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:06.993742 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27162766-07c5-4b18-af98-d7460faa5679 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:07.009323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1067/2154] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:11:07.013659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c65aa5-dc9e-4729-b70c-fbbee98116d5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:07.024040 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c65aa5-dc9e-4729-b70c-fbbee98116d5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:07.028759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fe622-5b8e-41de-964f-cd2513beb013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:07.029422 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fe622-5b8e-41de-964f-cd2513beb013 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:07.029699 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fe622-5b8e-41de-964f-cd2513beb013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:07.029970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fe622-5b8e-41de-964f-cd2513beb013 admin admin] PATH_INFO: `/v3/projects/eb3e835d1d5849e68d9b065ae8a2718d/users/0e667f2fe52d4bd48709dc4e3dc5cb2a/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:07.047715 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fe622-5b8e-41de-964f-cd2513beb013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb3e835d1d5849e68d9b065ae8a2718d, user_id=0e667f2fe52d4bd48709dc4e3dc5cb2a, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:07.050750 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fe622-5b8e-41de-964f-cd2513beb013 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:07.104138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1088/2155] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:07 2022] PUT /identity/v3/projects/eb3e835d1d5849e68d9b065ae8a2718d/users/0e667f2fe52d4bd48709dc4e3dc5cb2a/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:07.110348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c181f5-10ba-4582-bb0d-95bf543cc392 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:07.110348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c181f5-10ba-4582-bb0d-95bf543cc392 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:07.110348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c181f5-10ba-4582-bb0d-95bf543cc392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:07.140970 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-45c181f5-10ba-4582-bb0d-95bf543cc392 None None] MFA Rules not processed for user `0e667f2fe52d4bd48709dc4e3dc5cb2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:07.142322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-45c181f5-10ba-4582-bb0d-95bf543cc392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:07.223692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:07.276484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1068/2156] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:07.286209 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fe622-5b8e-41de-964f-cd2513beb013 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:07.382015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fe622-5b8e-41de-964f-cd2513beb013 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:07.403922 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5e1bf-4c2c-4a60-9e03-db6c293f412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:07.405840 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5e1bf-4c2c-4a60-9e03-db6c293f412e admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:07.408026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5e1bf-4c2c-4a60-9e03-db6c293f412e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:07.408687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5e1bf-4c2c-4a60-9e03-db6c293f412e admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:07.412017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5e1bf-4c2c-4a60-9e03-db6c293f412e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:07.414810 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5e1bf-4c2c-4a60-9e03-db6c293f412e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:07.461941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1089/2157] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:07 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:07.463140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c181f5-10ba-4582-bb0d-95bf543cc392 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:07.483240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c181f5-10ba-4582-bb0d-95bf543cc392 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:07.570098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c98687-65d0-4719-ab56-6ad1edc147c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:07.570937 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c98687-65d0-4719-ab56-6ad1edc147c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:07.571359 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c98687-65d0-4719-ab56-6ad1edc147c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:07.571772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c98687-65d0-4719-ab56-6ad1edc147c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:07.572599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c98687-65d0-4719-ab56-6ad1edc147c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:07.574684 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c98687-65d0-4719-ab56-6ad1edc147c7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:07.610455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1069/2158] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:07 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:07.614124 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5e1bf-4c2c-4a60-9e03-db6c293f412e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:07.632183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5e1bf-4c2c-4a60-9e03-db6c293f412e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:07.637646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59f230-1c4f-4d73-9224-b21b7902ed6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:07.638275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59f230-1c4f-4d73-9224-b21b7902ed6b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:07.639388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59f230-1c4f-4d73-9224-b21b7902ed6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:07.639673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59f230-1c4f-4d73-9224-b21b7902ed6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:07.641036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59f230-1c4f-4d73-9224-b21b7902ed6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:07.642870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59f230-1c4f-4d73-9224-b21b7902ed6b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:07.664258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1090/2159] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:07.668278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c98687-65d0-4719-ab56-6ad1edc147c7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:07.685269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c98687-65d0-4719-ab56-6ad1edc147c7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:07.693976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa191e9-d4a8-4a13-890d-4aa9a0beafac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:07.694653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa191e9-d4a8-4a13-890d-4aa9a0beafac admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:07.694960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa191e9-d4a8-4a13-890d-4aa9a0beafac admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:07.695198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa191e9-d4a8-4a13-890d-4aa9a0beafac admin admin] PATH_INFO: `/v3/projects/36120c4fd9a9412fa4aaef0b5396177c/users/454e6126f4c540f29e49dc394a4ad92c/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:07.733567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa191e9-d4a8-4a13-890d-4aa9a0beafac admin admin] RBAC: Authorizing `identity:create_grant(project_id=36120c4fd9a9412fa4aaef0b5396177c, user_id=454e6126f4c540f29e49dc394a4ad92c, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:07.745982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa191e9-d4a8-4a13-890d-4aa9a0beafac admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:07.776064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1070/2160] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:07 2022] PUT /identity/v3/projects/36120c4fd9a9412fa4aaef0b5396177c/users/454e6126f4c540f29e49dc394a4ad92c/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:07.778015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59f230-1c4f-4d73-9224-b21b7902ed6b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:07.792877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59f230-1c4f-4d73-9224-b21b7902ed6b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:07.882423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:07.892238 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1457b3-2543-437e-aa84-277e09d869c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:07.893342 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1457b3-2543-437e-aa84-277e09d869c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:07.893868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1457b3-2543-437e-aa84-277e09d869c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:07.895913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1457b3-2543-437e-aa84-277e09d869c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:07.896768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1457b3-2543-437e-aa84-277e09d869c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:07.898459 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1457b3-2543-437e-aa84-277e09d869c9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:07.916285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1091/2161] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:07.917903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa191e9-d4a8-4a13-890d-4aa9a0beafac admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:07.937076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa191e9-d4a8-4a13-890d-4aa9a0beafac admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:07.942607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5408f5-4f2b-4a9b-a97f-5010d57ced99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:07.943330 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5408f5-4f2b-4a9b-a97f-5010d57ced99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:07.944258 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5408f5-4f2b-4a9b-a97f-5010d57ced99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:07.944648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5408f5-4f2b-4a9b-a97f-5010d57ced99 admin admin] PATH_INFO: `/v3/projects/36120c4fd9a9412fa4aaef0b5396177c/users/454e6126f4c540f29e49dc394a4ad92c/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:07.947096 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5408f5-4f2b-4a9b-a97f-5010d57ced99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36120c4fd9a9412fa4aaef0b5396177c, user_id=454e6126f4c540f29e49dc394a4ad92c, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:07.950506 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5408f5-4f2b-4a9b-a97f-5010d57ced99 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:07.977543 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1071/2162] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:07 2022] PUT /identity/v3/projects/36120c4fd9a9412fa4aaef0b5396177c/users/454e6126f4c540f29e49dc394a4ad92c/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:07.979480 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c67557-c943-48f1-8f6a-4c038c2539bb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:07.979763 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c67557-c943-48f1-8f6a-4c038c2539bb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:07.980068 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c67557-c943-48f1-8f6a-4c038c2539bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:08.036092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e2c67557-c943-48f1-8f6a-4c038c2539bb None None] MFA Rules not processed for user `454e6126f4c540f29e49dc394a4ad92c`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:08.038585 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e2c67557-c943-48f1-8f6a-4c038c2539bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:08.185380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1092/2163] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:08.198974 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5408f5-4f2b-4a9b-a97f-5010d57ced99 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:08.201345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7c5408f5-4f2b-4a9b-a97f-5010d57ced99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:08.292513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5408f5-4f2b-4a9b-a97f-5010d57ced99 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:08.296606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1c5fd-8e33-4012-8971-722fa033d0b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:08.297943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1c5fd-8e33-4012-8971-722fa033d0b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:08.298931 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1c5fd-8e33-4012-8971-722fa033d0b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:08.299276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1c5fd-8e33-4012-8971-722fa033d0b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:08.311395 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1c5fd-8e33-4012-8971-722fa033d0b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:08.314663 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1c5fd-8e33-4012-8971-722fa033d0b5 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:08.341014 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1072/2164] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:08.915417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c67557-c943-48f1-8f6a-4c038c2539bb None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:08.994148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c67557-c943-48f1-8f6a-4c038c2539bb None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:09.000167 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59534e29-0297-4a87-a02b-71c9bb2c9c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:09.001060 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534e29-0297-4a87-a02b-71c9bb2c9c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:09.001522 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534e29-0297-4a87-a02b-71c9bb2c9c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:09.001946 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534e29-0297-4a87-a02b-71c9bb2c9c00 admin admin] PATH_INFO: `/v3/users/0e667f2fe52d4bd48709dc4e3dc5cb2a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:09.003245 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59534e29-0297-4a87-a02b-71c9bb2c9c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e667f2fe52d4bd48709dc4e3dc5cb2a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:09.006589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59534e29-0297-4a87-a02b-71c9bb2c9c00 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:09.090082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-59534e29-0297-4a87-a02b-71c9bb2c9c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e667f2fe52d4bd48709dc4e3dc5cb2a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:09.102152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-59534e29-0297-4a87-a02b-71c9bb2c9c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e667f2fe52d4bd48709dc4e3dc5cb2a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:09.118209 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-59534e29-0297-4a87-a02b-71c9bb2c9c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e667f2fe52d4bd48709dc4e3dc5cb2a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:09.118944 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-59534e29-0297-4a87-a02b-71c9bb2c9c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e667f2fe52d4bd48709dc4e3dc5cb2a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:09.141754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:09.143822 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-59534e29-0297-4a87-a02b-71c9bb2c9c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e667f2fe52d4bd48709dc4e3dc5cb2a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:09.153197 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1093/2165] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:08 2022] DELETE /identity/v3/users/0e667f2fe52d4bd48709dc4e3dc5cb2a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:09.158493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43f99f-923c-455a-a3a4-803b6ce4d6b9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:09.158963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43f99f-923c-455a-a3a4-803b6ce4d6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:09.161132 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43f99f-923c-455a-a3a4-803b6ce4d6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:09.191162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-dd43f99f-923c-455a-a3a4-803b6ce4d6b9 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:09.192412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dd43f99f-923c-455a-a3a4-803b6ce4d6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:09.253779 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:09.309381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1073/2166] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:09.318443 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59534e29-0297-4a87-a02b-71c9bb2c9c00 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:09.319877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-59534e29-0297-4a87-a02b-71c9bb2c9c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:09.412488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59534e29-0297-4a87-a02b-71c9bb2c9c00 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:09.416937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06194140-653d-4e2a-be9b-444a4c28436b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:09.420413 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06194140-653d-4e2a-be9b-444a4c28436b service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:09.420693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06194140-653d-4e2a-be9b-444a4c28436b service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:09.420965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06194140-653d-4e2a-be9b-444a4c28436b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:09.430538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06194140-653d-4e2a-be9b-444a4c28436b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:09.432024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06194140-653d-4e2a-be9b-444a4c28436b service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:09.442732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1094/2167] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:09.746127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43f99f-923c-455a-a3a4-803b6ce4d6b9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:09.747611 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dd43f99f-923c-455a-a3a4-803b6ce4d6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:09.787164 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43f99f-923c-455a-a3a4-803b6ce4d6b9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:09.793784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fece4b-6b65-4525-a794-5ed68071d183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:09.794523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fece4b-6b65-4525-a794-5ed68071d183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:09.794897 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fece4b-6b65-4525-a794-5ed68071d183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:09.795300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fece4b-6b65-4525-a794-5ed68071d183 admin admin] PATH_INFO: `/v3/projects/eb3e835d1d5849e68d9b065ae8a2718d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:09.797456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fece4b-6b65-4525-a794-5ed68071d183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb3e835d1d5849e68d9b065ae8a2718d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:09.799609 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fece4b-6b65-4525-a794-5ed68071d183 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:09.863250 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-93fece4b-6b65-4525-a794-5ed68071d183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb3e835d1d5849e68d9b065ae8a2718d', 'request_id': 'req-93fece4b-6b65-4525-a794-5ed68071d183'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:09.873874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-93fece4b-6b65-4525-a794-5ed68071d183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb3e835d1d5849e68d9b065ae8a2718d', 'request_id': 'req-93fece4b-6b65-4525-a794-5ed68071d183'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:09.897320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-93fece4b-6b65-4525-a794-5ed68071d183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb3e835d1d5849e68d9b065ae8a2718d', 'request_id': 'req-93fece4b-6b65-4525-a794-5ed68071d183'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:09.912895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-93fece4b-6b65-4525-a794-5ed68071d183 admin admin] The token cache is being invalidate because project eb3e835d1d5849e68d9b065ae8a2718d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:09.913192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-93fece4b-6b65-4525-a794-5ed68071d183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:09.914038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-93fece4b-6b65-4525-a794-5ed68071d183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:09.915879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1074/2168] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:09 2022] DELETE /identity/v3/projects/eb3e835d1d5849e68d9b065ae8a2718d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:09.919727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06194140-653d-4e2a-be9b-444a4c28436b service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:09.932237 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06194140-653d-4e2a-be9b-444a4c28436b service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:09.998142 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5f20f-9ede-40bf-a392-b4afbf187f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:09.998782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5f20f-9ede-40bf-a392-b4afbf187f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:09.999065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5f20f-9ede-40bf-a392-b4afbf187f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:09.999336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5f20f-9ede-40bf-a392-b4afbf187f8a admin admin] PATH_INFO: `/v3/users/454e6126f4c540f29e49dc394a4ad92c` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:10.000659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5f20f-9ede-40bf-a392-b4afbf187f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=454e6126f4c540f29e49dc394a4ad92c)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:10.002646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5f20f-9ede-40bf-a392-b4afbf187f8a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:10.067261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-72f5f20f-9ede-40bf-a392-b4afbf187f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454e6126f4c540f29e49dc394a4ad92c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:10.074748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-72f5f20f-9ede-40bf-a392-b4afbf187f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454e6126f4c540f29e49dc394a4ad92c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:10.082609 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-72f5f20f-9ede-40bf-a392-b4afbf187f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454e6126f4c540f29e49dc394a4ad92c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:10.083470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-72f5f20f-9ede-40bf-a392-b4afbf187f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454e6126f4c540f29e49dc394a4ad92c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:10.096454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-72f5f20f-9ede-40bf-a392-b4afbf187f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454e6126f4c540f29e49dc394a4ad92c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:10.103116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1095/2169] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:09 2022] DELETE /identity/v3/users/454e6126f4c540f29e49dc394a4ad92c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:10.508688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fece4b-6b65-4525-a794-5ed68071d183 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:10.510836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-93fece4b-6b65-4525-a794-5ed68071d183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:10.525493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fece4b-6b65-4525-a794-5ed68071d183 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:10.596491 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74520324-de3d-4c96-931c-21faaf1c5e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:10.597408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74520324-de3d-4c96-931c-21faaf1c5e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:10.597694 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74520324-de3d-4c96-931c-21faaf1c5e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:10.597967 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74520324-de3d-4c96-931c-21faaf1c5e08 admin admin] PATH_INFO: `/v3/projects/36120c4fd9a9412fa4aaef0b5396177c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:10.599126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74520324-de3d-4c96-931c-21faaf1c5e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36120c4fd9a9412fa4aaef0b5396177c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:10.601808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74520324-de3d-4c96-931c-21faaf1c5e08 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:10.658532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74520324-de3d-4c96-931c-21faaf1c5e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36120c4fd9a9412fa4aaef0b5396177c', 'request_id': 'req-74520324-de3d-4c96-931c-21faaf1c5e08'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:10.665782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74520324-de3d-4c96-931c-21faaf1c5e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36120c4fd9a9412fa4aaef0b5396177c', 'request_id': 'req-74520324-de3d-4c96-931c-21faaf1c5e08'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:10.668202 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:10.678118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74520324-de3d-4c96-931c-21faaf1c5e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36120c4fd9a9412fa4aaef0b5396177c', 'request_id': 'req-74520324-de3d-4c96-931c-21faaf1c5e08'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:10.691225 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74520324-de3d-4c96-931c-21faaf1c5e08 admin admin] The token cache is being invalidate because project 36120c4fd9a9412fa4aaef0b5396177c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:10.691616 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74520324-de3d-4c96-931c-21faaf1c5e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:10.692273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74520324-de3d-4c96-931c-21faaf1c5e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:10.693779 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1075/2170] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:10 2022] DELETE /identity/v3/projects/36120c4fd9a9412fa4aaef0b5396177c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:10.698966 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069edb7-975d-4e93-a980-62d5a860fef6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:10.699261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069edb7-975d-4e93-a980-62d5a860fef6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:10.699642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069edb7-975d-4e93-a980-62d5a860fef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:10.721718 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b069edb7-975d-4e93-a980-62d5a860fef6 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:10.722974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b069edb7-975d-4e93-a980-62d5a860fef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:10.735885 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:10.787299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1096/2171] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:10.795167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe48d1-4c3e-4c26-8706-18c2ea858086 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:10.795449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe48d1-4c3e-4c26-8706-18c2ea858086 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:10.795752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe48d1-4c3e-4c26-8706-18c2ea858086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:10.815533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-43fe48d1-4c3e-4c26-8706-18c2ea858086 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:10.816771 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-43fe48d1-4c3e-4c26-8706-18c2ea858086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:10.824889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1076/2172] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:10.829825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069edb7-975d-4e93-a980-62d5a860fef6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:10.839503 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069edb7-975d-4e93-a980-62d5a860fef6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:10.844127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d144461-7b3c-42a8-aa03-3a6d7c057bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:10.844654 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d144461-7b3c-42a8-aa03-3a6d7c057bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:10.844925 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d144461-7b3c-42a8-aa03-3a6d7c057bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:10.845190 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d144461-7b3c-42a8-aa03-3a6d7c057bcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:10.845824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d144461-7b3c-42a8-aa03-3a6d7c057bcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:11:10.846117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d144461-7b3c-42a8-aa03-3a6d7c057bcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:10.847705 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d144461-7b3c-42a8-aa03-3a6d7c057bcf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:10.863244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1097/2173] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:11:10.864840 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe48d1-4c3e-4c26-8706-18c2ea858086 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:10.875381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe48d1-4c3e-4c26-8706-18c2ea858086 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:10.880224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3691f91-2900-4c04-8d04-058bf3ac0b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:10.880896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3691f91-2900-4c04-8d04-058bf3ac0b14 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:10.881491 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3691f91-2900-4c04-8d04-058bf3ac0b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:10.881828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3691f91-2900-4c04-8d04-058bf3ac0b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:10.882590 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3691f91-2900-4c04-8d04-058bf3ac0b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:10.884549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3691f91-2900-4c04-8d04-058bf3ac0b14 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:10.915421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1077/2174] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:10 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:10.920163 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d144461-7b3c-42a8-aa03-3a6d7c057bcf admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:10.931642 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d144461-7b3c-42a8-aa03-3a6d7c057bcf admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:10.999509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae0ae4-a66c-4979-9a0b-73c016294596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:11.000756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae0ae4-a66c-4979-9a0b-73c016294596 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:11.001038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae0ae4-a66c-4979-9a0b-73c016294596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:11.001312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae0ae4-a66c-4979-9a0b-73c016294596 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:11.002006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae0ae4-a66c-4979-9a0b-73c016294596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:11.004082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae0ae4-a66c-4979-9a0b-73c016294596 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:11.031857 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1098/2175] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:10 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:11.032108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3691f91-2900-4c04-8d04-058bf3ac0b14 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:11.045847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3691f91-2900-4c04-8d04-058bf3ac0b14 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:11.051436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aa2d1-03df-4897-9aea-1bcd1536cc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:11.052089 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aa2d1-03df-4897-9aea-1bcd1536cc61 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:11.052413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aa2d1-03df-4897-9aea-1bcd1536cc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:11.052712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aa2d1-03df-4897-9aea-1bcd1536cc61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:11.053320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aa2d1-03df-4897-9aea-1bcd1536cc61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:11.054910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aa2d1-03df-4897-9aea-1bcd1536cc61 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:11.066885 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1078/2176] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:11.070771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae0ae4-a66c-4979-9a0b-73c016294596 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:11.081995 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae0ae4-a66c-4979-9a0b-73c016294596 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:11.087405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74b7a4-a735-433b-b299-a0d8ba42699c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:11.088054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74b7a4-a735-433b-b299-a0d8ba42699c admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:11.088392 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74b7a4-a735-433b-b299-a0d8ba42699c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:11.088814 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74b7a4-a735-433b-b299-a0d8ba42699c admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:11.089497 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74b7a4-a735-433b-b299-a0d8ba42699c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:11.091094 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74b7a4-a735-433b-b299-a0d8ba42699c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:11.102931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1099/2177] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:11.107497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aa2d1-03df-4897-9aea-1bcd1536cc61 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:11.118570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aa2d1-03df-4897-9aea-1bcd1536cc61 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:11.123379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da35cbf-6512-4848-8693-ea53c114ffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:11.124161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35cbf-6512-4848-8693-ea53c114ffd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:11.124503 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35cbf-6512-4848-8693-ea53c114ffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:11.124617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2152764-bce8-4e02-93f3-f4b98ce1b4d4 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:11.125518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35cbf-6512-4848-8693-ea53c114ffd6 admin admin] PATH_INFO: `/v3/projects/4431ecaa251b49398617641c78fec736/users/a9fc85862a92437f85c8b144694e4998/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:11.125681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2152764-bce8-4e02-93f3-f4b98ce1b4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:11.125962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2152764-bce8-4e02-93f3-f4b98ce1b4d4 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:11.127598 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1100/2178] 10.222.0.48 () {54 vars in 921 bytes} [Tue Aug 30 05:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 05:11:11.141596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da35cbf-6512-4848-8693-ea53c114ffd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4431ecaa251b49398617641c78fec736, user_id=a9fc85862a92437f85c8b144694e4998, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:11.144446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da35cbf-6512-4848-8693-ea53c114ffd6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:11.156842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49758043-b420-4d0c-bd14-39630268088e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:11.157125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49758043-b420-4d0c-bd14-39630268088e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:11.157447 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49758043-b420-4d0c-bd14-39630268088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:11.174761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1079/2179] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:11 2022] PUT /identity/v3/projects/4431ecaa251b49398617641c78fec736/users/a9fc85862a92437f85c8b144694e4998/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:11.178930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970b597-0f47-44ab-af8b-f1f54cd1a012 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:11.179321 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970b597-0f47-44ab-af8b-f1f54cd1a012 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:11.180264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970b597-0f47-44ab-af8b-f1f54cd1a012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:11.190773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-49758043-b420-4d0c-bd14-39630268088e None None] MFA Rules not processed for user `ed835047051142d2bc98bb1564e3a98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:11.193777 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-49758043-b420-4d0c-bd14-39630268088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:11.243091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3970b597-0f47-44ab-af8b-f1f54cd1a012 None None] MFA Rules not processed for user `a9fc85862a92437f85c8b144694e4998`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:11.244874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3970b597-0f47-44ab-af8b-f1f54cd1a012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:11.305094 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1101/2180] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Aug 30 05:11:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:11.317809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49758043-b420-4d0c-bd14-39630268088e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:11.319488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-49758043-b420-4d0c-bd14-39630268088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:11.336043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49758043-b420-4d0c-bd14-39630268088e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:11.343709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba02f7-b7d4-4521-9bf4-365bc4c3248f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed835047051142d2bc98bb1564e3a98f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:11.344950 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba02f7-b7d4-4521-9bf4-365bc4c3248f service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:11.345410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba02f7-b7d4-4521-9bf4-365bc4c3248f service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:11.345881 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba02f7-b7d4-4521-9bf4-365bc4c3248f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:11.356667 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba02f7-b7d4-4521-9bf4-365bc4c3248f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:11.371795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba02f7-b7d4-4521-9bf4-365bc4c3248f service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:11.382633 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1080/2181] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:11.387266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970b597-0f47-44ab-af8b-f1f54cd1a012 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:11.387882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1102/2182] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:11:11.541308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970b597-0f47-44ab-af8b-f1f54cd1a012 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:11.551842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6d880-2f2e-4581-9cb7-03da9418019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:11.552867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d880-2f2e-4581-9cb7-03da9418019c admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:11.553376 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d880-2f2e-4581-9cb7-03da9418019c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:11.555814 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d880-2f2e-4581-9cb7-03da9418019c admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:11.558508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6d880-2f2e-4581-9cb7-03da9418019c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:11.560797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6d880-2f2e-4581-9cb7-03da9418019c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:11.587481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:11.613895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1081/2183] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:11 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:11:11.614969 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba02f7-b7d4-4521-9bf4-365bc4c3248f service placement] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:11.627490 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba02f7-b7d4-4521-9bf4-365bc4c3248f service placement] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:11.631655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:11.700058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ec093-748e-43ce-8791-c7bac5e02f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:11.700804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ec093-748e-43ce-8791-c7bac5e02f50 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:11.701149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ec093-748e-43ce-8791-c7bac5e02f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:11.701492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ec093-748e-43ce-8791-c7bac5e02f50 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:11.702261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ec093-748e-43ce-8791-c7bac5e02f50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:11.705721 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ec093-748e-43ce-8791-c7bac5e02f50 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:11.735965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1103/2184] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:11 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:11.736778 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6d880-2f2e-4581-9cb7-03da9418019c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:11.749533 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6d880-2f2e-4581-9cb7-03da9418019c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:11.755916 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d8b61-f5ec-4900-a1ba-ac50917f2ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:11.756371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d8b61-f5ec-4900-a1ba-ac50917f2ddd admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:11.756828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d8b61-f5ec-4900-a1ba-ac50917f2ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:11.757221 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d8b61-f5ec-4900-a1ba-ac50917f2ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:11.757883 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d8b61-f5ec-4900-a1ba-ac50917f2ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:11.760798 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d8b61-f5ec-4900-a1ba-ac50917f2ddd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:11.772397 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1082/2185] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:11.776365 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ec093-748e-43ce-8791-c7bac5e02f50 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:11.789474 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ec093-748e-43ce-8791-c7bac5e02f50 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:11.794730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5029d-35fa-4b2f-a6c7-3ea035c44910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:11.795599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5029d-35fa-4b2f-a6c7-3ea035c44910 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:11.795981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5029d-35fa-4b2f-a6c7-3ea035c44910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:11.797167 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5029d-35fa-4b2f-a6c7-3ea035c44910 admin admin] PATH_INFO: `/v3/projects/923ed913b638493aac47999d8969842c/users/a365b082f4de4593be437fc425ba8784/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:11.817296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5029d-35fa-4b2f-a6c7-3ea035c44910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923ed913b638493aac47999d8969842c, user_id=a365b082f4de4593be437fc425ba8784, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:11.819970 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5029d-35fa-4b2f-a6c7-3ea035c44910 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:11.836320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1104/2186] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:11 2022] PUT /identity/v3/projects/923ed913b638493aac47999d8969842c/users/a365b082f4de4593be437fc425ba8784/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:11.840883 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d8b61-f5ec-4900-a1ba-ac50917f2ddd admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:11.857197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d8b61-f5ec-4900-a1ba-ac50917f2ddd admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:11.938098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd439673-e669-411d-a155-98fc543c453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:11.938830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd439673-e669-411d-a155-98fc543c453e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:11.939113 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd439673-e669-411d-a155-98fc543c453e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:11.939315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd439673-e669-411d-a155-98fc543c453e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:11.940082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd439673-e669-411d-a155-98fc543c453e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:11.941792 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd439673-e669-411d-a155-98fc543c453e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:11.953160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1083/2187] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:11.957111 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5029d-35fa-4b2f-a6c7-3ea035c44910 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:11.967722 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5029d-35fa-4b2f-a6c7-3ea035c44910 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:11.974106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd439673-e669-411d-a155-98fc543c453e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:11.976312 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fd439673-e669-411d-a155-98fc543c453e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:11.980402 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dd19f-3a7d-4e8d-b848-34f06639b750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:11.981353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dd19f-3a7d-4e8d-b848-34f06639b750 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:11.982324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dd19f-3a7d-4e8d-b848-34f06639b750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:11.982699 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dd19f-3a7d-4e8d-b848-34f06639b750 admin admin] PATH_INFO: `/v3/projects/923ed913b638493aac47999d8969842c/users/a365b082f4de4593be437fc425ba8784/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:11.985911 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dd19f-3a7d-4e8d-b848-34f06639b750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923ed913b638493aac47999d8969842c, user_id=a365b082f4de4593be437fc425ba8784, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:11.988951 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dd19f-3a7d-4e8d-b848-34f06639b750 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:11.995938 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd439673-e669-411d-a155-98fc543c453e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:12.001178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1105/2188] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:11 2022] PUT /identity/v3/projects/923ed913b638493aac47999d8969842c/users/a365b082f4de4593be437fc425ba8784/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:12.011988 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899caa3-f175-4100-9456-91d39a1203eb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:12.012263 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899caa3-f175-4100-9456-91d39a1203eb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:12.012538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899caa3-f175-4100-9456-91d39a1203eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:12.042643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0899caa3-f175-4100-9456-91d39a1203eb None None] MFA Rules not processed for user `a365b082f4de4593be437fc425ba8784`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:12.044027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0899caa3-f175-4100-9456-91d39a1203eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:12.058070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd770a1-f55b-4073-aa5a-884c251dc77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:12.058710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd770a1-f55b-4073-aa5a-884c251dc77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:12.058981 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd770a1-f55b-4073-aa5a-884c251dc77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:12.059249 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd770a1-f55b-4073-aa5a-884c251dc77e admin admin] PATH_INFO: `/v3/users/49b8dde87752484e8a5dacfb3a816adf` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:12.060406 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd770a1-f55b-4073-aa5a-884c251dc77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b8dde87752484e8a5dacfb3a816adf)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:12.063002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd770a1-f55b-4073-aa5a-884c251dc77e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:12.112100 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-abd770a1-f55b-4073-aa5a-884c251dc77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b8dde87752484e8a5dacfb3a816adf'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:12.116607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1106/2189] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:12.128195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899caa3-f175-4100-9456-91d39a1203eb None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:12.129357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-abd770a1-f55b-4073-aa5a-884c251dc77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b8dde87752484e8a5dacfb3a816adf'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:12.129540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0899caa3-f175-4100-9456-91d39a1203eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:12.136836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-abd770a1-f55b-4073-aa5a-884c251dc77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b8dde87752484e8a5dacfb3a816adf'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:12.137627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-abd770a1-f55b-4073-aa5a-884c251dc77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b8dde87752484e8a5dacfb3a816adf'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:12.138256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-abd770a1-f55b-4073-aa5a-884c251dc77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b8dde87752484e8a5dacfb3a816adf'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:12.147994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:12.156518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1084/2190] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:11 2022] DELETE /identity/v3/users/49b8dde87752484e8a5dacfb3a816adf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:12.192213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:12.206165 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899caa3-f175-4100-9456-91d39a1203eb None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:12.274126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10229a-1f24-4101-8fd9-e1985e60759d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:12.275192 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10229a-1f24-4101-8fd9-e1985e60759d service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:12.275467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10229a-1f24-4101-8fd9-e1985e60759d service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:12.275736 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10229a-1f24-4101-8fd9-e1985e60759d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:12.277554 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fc10229a-1f24-4101-8fd9-e1985e60759d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:12.348677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10229a-1f24-4101-8fd9-e1985e60759d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:12.350541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10229a-1f24-4101-8fd9-e1985e60759d service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:12.370522 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1107/2191] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:11:12.773426 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd770a1-f55b-4073-aa5a-884c251dc77e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:12.775517 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-abd770a1-f55b-4073-aa5a-884c251dc77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:12.869954 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd770a1-f55b-4073-aa5a-884c251dc77e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:12.880179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:12.881954 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:12.882235 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:12.883305 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6 admin admin] PATH_INFO: `/v3/projects/0cdf6e8adc1a42a99d30243dbd6d3762` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:12.884767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cdf6e8adc1a42a99d30243dbd6d3762)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:12.888666 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:12.948949 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cdf6e8adc1a42a99d30243dbd6d3762', 'request_id': 'req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:12.956008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cdf6e8adc1a42a99d30243dbd6d3762', 'request_id': 'req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:12.968875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cdf6e8adc1a42a99d30243dbd6d3762', 'request_id': 'req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:12.977561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6 admin admin] The token cache is being invalidate because project 0cdf6e8adc1a42a99d30243dbd6d3762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:12.977849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:12.978532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:12.980498 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1085/2192] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:12 2022] DELETE /identity/v3/projects/0cdf6e8adc1a42a99d30243dbd6d3762 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:12.985341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10229a-1f24-4101-8fd9-e1985e60759d service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:12.996347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10229a-1f24-4101-8fd9-e1985e60759d service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:13.056334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75104aef-2c97-4c2e-8c90-40a3c1440c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:13.056979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104aef-2c97-4c2e-8c90-40a3c1440c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:13.057258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104aef-2c97-4c2e-8c90-40a3c1440c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:13.057533 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104aef-2c97-4c2e-8c90-40a3c1440c13 admin admin] PATH_INFO: `/v3/users/feeb77a36efc4a0b86b675518302e7a3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:13.058655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75104aef-2c97-4c2e-8c90-40a3c1440c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feeb77a36efc4a0b86b675518302e7a3)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:13.060742 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75104aef-2c97-4c2e-8c90-40a3c1440c13 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:13.110335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-75104aef-2c97-4c2e-8c90-40a3c1440c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feeb77a36efc4a0b86b675518302e7a3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:13.117775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-75104aef-2c97-4c2e-8c90-40a3c1440c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feeb77a36efc4a0b86b675518302e7a3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:13.119493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:13.126593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-75104aef-2c97-4c2e-8c90-40a3c1440c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feeb77a36efc4a0b86b675518302e7a3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:13.127675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-75104aef-2c97-4c2e-8c90-40a3c1440c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feeb77a36efc4a0b86b675518302e7a3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:13.141168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-75104aef-2c97-4c2e-8c90-40a3c1440c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feeb77a36efc4a0b86b675518302e7a3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:13.147330 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1108/2193] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:12 2022] DELETE /identity/v3/users/feeb77a36efc4a0b86b675518302e7a3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:13.342092 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:13.344158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:13.363775 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763b4ac-d17f-4bf7-87ce-4b5b97d167f6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:13.423690 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6fc01-b488-4479-8a51-3526cf03e02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:13.424364 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6fc01-b488-4479-8a51-3526cf03e02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:13.424642 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6fc01-b488-4479-8a51-3526cf03e02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:13.424914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6fc01-b488-4479-8a51-3526cf03e02d admin admin] PATH_INFO: `/v3/projects/f45ca3dfc2174dd98aed3ba49285e5f3` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:13.426052 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6fc01-b488-4479-8a51-3526cf03e02d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45ca3dfc2174dd98aed3ba49285e5f3)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:13.427998 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6fc01-b488-4479-8a51-3526cf03e02d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:13.470161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:13.484715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e9d6fc01-b488-4479-8a51-3526cf03e02d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45ca3dfc2174dd98aed3ba49285e5f3', 'request_id': 'req-e9d6fc01-b488-4479-8a51-3526cf03e02d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:13.491846 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e9d6fc01-b488-4479-8a51-3526cf03e02d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45ca3dfc2174dd98aed3ba49285e5f3', 'request_id': 'req-e9d6fc01-b488-4479-8a51-3526cf03e02d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:13.497423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e9d6fc01-b488-4479-8a51-3526cf03e02d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45ca3dfc2174dd98aed3ba49285e5f3', 'request_id': 'req-e9d6fc01-b488-4479-8a51-3526cf03e02d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:13.510988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e9d6fc01-b488-4479-8a51-3526cf03e02d admin admin] The token cache is being invalidate because project f45ca3dfc2174dd98aed3ba49285e5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:13.511278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e9d6fc01-b488-4479-8a51-3526cf03e02d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:13.511927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e9d6fc01-b488-4479-8a51-3526cf03e02d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:13.513442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1086/2194] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:13 2022] DELETE /identity/v3/projects/f45ca3dfc2174dd98aed3ba49285e5f3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:13.519735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d30184-6893-4c27-bbfd-c757f20c6b72 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:13.520247 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d30184-6893-4c27-bbfd-c757f20c6b72 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:13.520527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d30184-6893-4c27-bbfd-c757f20c6b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:13.541583 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-70d30184-6893-4c27-bbfd-c757f20c6b72 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:13.542818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-70d30184-6893-4c27-bbfd-c757f20c6b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:13.576458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6fc01-b488-4479-8a51-3526cf03e02d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:13.578562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e9d6fc01-b488-4479-8a51-3526cf03e02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:13.605360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1109/2195] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:13.612982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e8f3d-9d1d-4f19-bce0-4151b8d4b913 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:13.613264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e8f3d-9d1d-4f19-bce0-4151b8d4b913 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:13.613532 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e8f3d-9d1d-4f19-bce0-4151b8d4b913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:13.632538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3e0e8f3d-9d1d-4f19-bce0-4151b8d4b913 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:13.633747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3e0e8f3d-9d1d-4f19-bce0-4151b8d4b913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:13.642020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1110/2196] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:11:13.643726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6fc01-b488-4479-8a51-3526cf03e02d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:13.645977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e8f3d-9d1d-4f19-bce0-4151b8d4b913 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:13.648368 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f19d2-a3c0-4637-8f6e-34f674a52b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:13.649016 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f19d2-a3c0-4637-8f6e-34f674a52b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:13.649280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f19d2-a3c0-4637-8f6e-34f674a52b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:13.649551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f19d2-a3c0-4637-8f6e-34f674a52b0b admin admin] PATH_INFO: `/v3/users/317434edeb014db0a656c8e777d875cb` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:13.650688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f19d2-a3c0-4637-8f6e-34f674a52b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=317434edeb014db0a656c8e777d875cb)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:13.652645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f19d2-a3c0-4637-8f6e-34f674a52b0b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:13.654939 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e8f3d-9d1d-4f19-bce0-4151b8d4b913 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:13.660031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f2b25-539a-4bd0-9d04-38950aecfdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:13.660612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f2b25-539a-4bd0-9d04-38950aecfdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:13.660883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f2b25-539a-4bd0-9d04-38950aecfdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:13.661152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f2b25-539a-4bd0-9d04-38950aecfdb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:13.661855 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f2b25-539a-4bd0-9d04-38950aecfdb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:11:13.662157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f2b25-539a-4bd0-9d04-38950aecfdb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:13.663726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f2b25-539a-4bd0-9d04-38950aecfdb4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:13.675214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1111/2197] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:11:13.679776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f2b25-539a-4bd0-9d04-38950aecfdb4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:13.689627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f2b25-539a-4bd0-9d04-38950aecfdb4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:13.694495 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2830d-f1e0-45ee-9de0-bc2e5f837c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:13.695095 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2830d-f1e0-45ee-9de0-bc2e5f837c6b admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:13.695358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2830d-f1e0-45ee-9de0-bc2e5f837c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:13.695624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2830d-f1e0-45ee-9de0-bc2e5f837c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:13.696309 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2830d-f1e0-45ee-9de0-bc2e5f837c6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:13.698175 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2830d-f1e0-45ee-9de0-bc2e5f837c6b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:13.699413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-085f19d2-a3c0-4637-8f6e-34f674a52b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '317434edeb014db0a656c8e777d875cb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:13.713691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-085f19d2-a3c0-4637-8f6e-34f674a52b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '317434edeb014db0a656c8e777d875cb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:13.722445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-085f19d2-a3c0-4637-8f6e-34f674a52b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '317434edeb014db0a656c8e777d875cb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:13.723106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-085f19d2-a3c0-4637-8f6e-34f674a52b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '317434edeb014db0a656c8e777d875cb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:13.723834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-085f19d2-a3c0-4637-8f6e-34f674a52b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '317434edeb014db0a656c8e777d875cb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:13.730217 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1112/2198] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:13 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:13.734420 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2830d-f1e0-45ee-9de0-bc2e5f837c6b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:13.736317 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9cb2830d-f1e0-45ee-9de0-bc2e5f837c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:13.740317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1087/2199] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:13 2022] DELETE /identity/v3/users/317434edeb014db0a656c8e777d875cb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:11:13.744840 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a48f9-4493-4453-974e-c299d6cd0d00 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:13.745286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a48f9-4493-4453-974e-c299d6cd0d00 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:13.745584 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a48f9-4493-4453-974e-c299d6cd0d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:13.766497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0c5a48f9-4493-4453-974e-c299d6cd0d00 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:13.767828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0c5a48f9-4493-4453-974e-c299d6cd0d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:13.805346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:13.826654 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2830d-f1e0-45ee-9de0-bc2e5f837c6b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:13.837359 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1088/2200] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:11:13.847632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a48f9-4493-4453-974e-c299d6cd0d00 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:13.849395 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0c5a48f9-4493-4453-974e-c299d6cd0d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:13.868914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:13.895370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcba09-6e68-4174-9d5c-bc6af72ea37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:13.896590 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcba09-6e68-4174-9d5c-bc6af72ea37a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:13.896968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcba09-6e68-4174-9d5c-bc6af72ea37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:13.897277 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcba09-6e68-4174-9d5c-bc6af72ea37a admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:13.898385 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcba09-6e68-4174-9d5c-bc6af72ea37a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:13.900865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcba09-6e68-4174-9d5c-bc6af72ea37a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:13.917303 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a48f9-4493-4453-974e-c299d6cd0d00 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:13.922130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b436e-da92-4fc6-8fac-15ee2ffa8b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:13.922742 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b436e-da92-4fc6-8fac-15ee2ffa8b7c service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:13.923160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b436e-da92-4fc6-8fac-15ee2ffa8b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:13.923440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b436e-da92-4fc6-8fac-15ee2ffa8b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:13.927561 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1113/2201] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:13 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:11:13.928984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcba09-6e68-4174-9d5c-bc6af72ea37a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:13.935398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b436e-da92-4fc6-8fac-15ee2ffa8b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:13.937714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b436e-da92-4fc6-8fac-15ee2ffa8b7c service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:13.945832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcba09-6e68-4174-9d5c-bc6af72ea37a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:13.954491 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1089/2202] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:11:13.955221 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb2d84-125d-4b5b-86a1-0b2168ed39da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:13.956256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb2d84-125d-4b5b-86a1-0b2168ed39da admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:13.956256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb2d84-125d-4b5b-86a1-0b2168ed39da admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:13.956904 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb2d84-125d-4b5b-86a1-0b2168ed39da admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:13.957712 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb2d84-125d-4b5b-86a1-0b2168ed39da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:13.960399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb2d84-125d-4b5b-86a1-0b2168ed39da admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:13.973929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1114/2203] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:13.979866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b436e-da92-4fc6-8fac-15ee2ffa8b7c service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:14.008786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b436e-da92-4fc6-8fac-15ee2ffa8b7c service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:14.013702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d305212-d5bb-4001-9313-77f9b18c33fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:14.014440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d305212-d5bb-4001-9313-77f9b18c33fb admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:14.014627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d305212-d5bb-4001-9313-77f9b18c33fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:14.014906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d305212-d5bb-4001-9313-77f9b18c33fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:14.016151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d305212-d5bb-4001-9313-77f9b18c33fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:14.017816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d305212-d5bb-4001-9313-77f9b18c33fb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:14.055141 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1090/2204] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:14.059331 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb2d84-125d-4b5b-86a1-0b2168ed39da admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:14.072209 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb2d84-125d-4b5b-86a1-0b2168ed39da admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:14.077051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc510162-9488-4a64-b8e4-b2c204fff02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:14.078331 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510162-9488-4a64-b8e4-b2c204fff02d admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:14.078651 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510162-9488-4a64-b8e4-b2c204fff02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:14.078931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510162-9488-4a64-b8e4-b2c204fff02d admin admin] PATH_INFO: `/v3/projects/24ace8aa6491418f83fbd70c26cc948d/users/5d0ac18977b141e9aad592109e744d8a/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:14.098256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc510162-9488-4a64-b8e4-b2c204fff02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ace8aa6491418f83fbd70c26cc948d, user_id=5d0ac18977b141e9aad592109e744d8a, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:14.098764 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc510162-9488-4a64-b8e4-b2c204fff02d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:14.116757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1115/2205] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:14 2022] PUT /identity/v3/projects/24ace8aa6491418f83fbd70c26cc948d/users/5d0ac18977b141e9aad592109e744d8a/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:14.130687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ece9ba-1a89-4ee2-8532-9daae1aef190 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:14.130687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ece9ba-1a89-4ee2-8532-9daae1aef190 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:14.131336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ece9ba-1a89-4ee2-8532-9daae1aef190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:14.178985 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a9ece9ba-1a89-4ee2-8532-9daae1aef190 None None] MFA Rules not processed for user `5d0ac18977b141e9aad592109e744d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:14.181114 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a9ece9ba-1a89-4ee2-8532-9daae1aef190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:14.284740 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1091/2206] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:11:14.295781 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc510162-9488-4a64-b8e4-b2c204fff02d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:14.300025 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bc510162-9488-4a64-b8e4-b2c204fff02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:14.417379 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc510162-9488-4a64-b8e4-b2c204fff02d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:14.427325 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe29fd-ed50-4707-b53e-a56bc616f5d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d3889156524b388b761cedfac8ed6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:14.428095 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe29fd-ed50-4707-b53e-a56bc616f5d2 service glance] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:14.428297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe29fd-ed50-4707-b53e-a56bc616f5d2 service glance] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:14.428519 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe29fd-ed50-4707-b53e-a56bc616f5d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:14.448271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe29fd-ed50-4707-b53e-a56bc616f5d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:14.449951 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe29fd-ed50-4707-b53e-a56bc616f5d2 service glance] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:14.476808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1116/2207] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:14.569167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ece9ba-1a89-4ee2-8532-9daae1aef190 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:14.571368 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a9ece9ba-1a89-4ee2-8532-9daae1aef190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:14.661677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ece9ba-1a89-4ee2-8532-9daae1aef190 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:14.666484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99d577-9ac2-43e9-9f44-0b88968c889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:14.667206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99d577-9ac2-43e9-9f44-0b88968c889e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:14.668079 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99d577-9ac2-43e9-9f44-0b88968c889e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:14.668079 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99d577-9ac2-43e9-9f44-0b88968c889e admin admin] PATH_INFO: `/v3/projects/d37f569b67ab40bf9514168d37729ccb` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:14.669212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99d577-9ac2-43e9-9f44-0b88968c889e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37f569b67ab40bf9514168d37729ccb)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:14.672315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99d577-9ac2-43e9-9f44-0b88968c889e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:14.675392 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:14.754213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7f99d577-9ac2-43e9-9f44-0b88968c889e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37f569b67ab40bf9514168d37729ccb', 'request_id': 'req-7f99d577-9ac2-43e9-9f44-0b88968c889e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:14.767169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7f99d577-9ac2-43e9-9f44-0b88968c889e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37f569b67ab40bf9514168d37729ccb', 'request_id': 'req-7f99d577-9ac2-43e9-9f44-0b88968c889e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:14.774943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7f99d577-9ac2-43e9-9f44-0b88968c889e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37f569b67ab40bf9514168d37729ccb', 'request_id': 'req-7f99d577-9ac2-43e9-9f44-0b88968c889e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:14.794057 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7f99d577-9ac2-43e9-9f44-0b88968c889e admin admin] The token cache is being invalidate because project d37f569b67ab40bf9514168d37729ccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:14.795132 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7f99d577-9ac2-43e9-9f44-0b88968c889e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:14.796353 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7f99d577-9ac2-43e9-9f44-0b88968c889e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:14.799668 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1092/2208] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:14 2022] DELETE /identity/v3/projects/d37f569b67ab40bf9514168d37729ccb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:14.805177 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374b6de-de70-4cf7-83c3-417455e964da None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:14.805514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374b6de-de70-4cf7-83c3-417455e964da None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:14.805877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374b6de-de70-4cf7-83c3-417455e964da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:14.831971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1374b6de-de70-4cf7-83c3-417455e964da None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:14.833899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1374b6de-de70-4cf7-83c3-417455e964da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:14.914529 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1117/2209] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:14.922860 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a3a3e-5c95-4d7a-a746-7d30553c7317 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:14.923288 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a3a3e-5c95-4d7a-a746-7d30553c7317 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:14.923371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a3a3e-5c95-4d7a-a746-7d30553c7317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:14.944548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-668a3a3e-5c95-4d7a-a746-7d30553c7317 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:14.945881 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-668a3a3e-5c95-4d7a-a746-7d30553c7317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:14.959329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1093/2210] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:14.960404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374b6de-de70-4cf7-83c3-417455e964da None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:14.971243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374b6de-de70-4cf7-83c3-417455e964da None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:14.977259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353e9b5-4a83-4dac-91de-eb918f4b8bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:14.978079 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353e9b5-4a83-4dac-91de-eb918f4b8bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:14.978382 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353e9b5-4a83-4dac-91de-eb918f4b8bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:14.978638 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353e9b5-4a83-4dac-91de-eb918f4b8bcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:14.979356 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353e9b5-4a83-4dac-91de-eb918f4b8bcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:11:14.979744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353e9b5-4a83-4dac-91de-eb918f4b8bcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:14.982005 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353e9b5-4a83-4dac-91de-eb918f4b8bcd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:14.996403 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1118/2211] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:11:14.999901 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a3a3e-5c95-4d7a-a746-7d30553c7317 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:15.010061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a3a3e-5c95-4d7a-a746-7d30553c7317 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:15.039858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e90939-3c46-4d2b-b1dd-d2dc63509554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:15.039858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e90939-3c46-4d2b-b1dd-d2dc63509554 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:15.039858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e90939-3c46-4d2b-b1dd-d2dc63509554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:15.039858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e90939-3c46-4d2b-b1dd-d2dc63509554 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:15.041830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e90939-3c46-4d2b-b1dd-d2dc63509554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:15.044045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e90939-3c46-4d2b-b1dd-d2dc63509554 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:15.086837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1094/2212] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:14 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:15.092607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353e9b5-4a83-4dac-91de-eb918f4b8bcd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:15.102270 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:15.107730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353e9b5-4a83-4dac-91de-eb918f4b8bcd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:15.137206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e90939-3c46-4d2b-b1dd-d2dc63509554 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:15.139530 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-91e90939-3c46-4d2b-b1dd-d2dc63509554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:15.189040 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517008a6-1621-49a2-b482-91d0ca54b909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:15.189635 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517008a6-1621-49a2-b482-91d0ca54b909 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:15.190039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517008a6-1621-49a2-b482-91d0ca54b909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:15.190170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517008a6-1621-49a2-b482-91d0ca54b909 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:15.190838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517008a6-1621-49a2-b482-91d0ca54b909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:15.192782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517008a6-1621-49a2-b482-91d0ca54b909 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:15.200106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e90939-3c46-4d2b-b1dd-d2dc63509554 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:15.204535 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a078187-d3bc-4afd-989f-19c2b87fae3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:15.204980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a078187-d3bc-4afd-989f-19c2b87fae3d service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:15.205250 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a078187-d3bc-4afd-989f-19c2b87fae3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:15.205521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a078187-d3bc-4afd-989f-19c2b87fae3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:15.207344 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5a078187-d3bc-4afd-989f-19c2b87fae3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:15.215985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1119/2213] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:15 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:11:15.219778 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517008a6-1621-49a2-b482-91d0ca54b909 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:15.229567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517008a6-1621-49a2-b482-91d0ca54b909 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:15.234087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73f764-59d9-46d8-9472-c6a7a03248d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:15.234666 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73f764-59d9-46d8-9472-c6a7a03248d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:15.234938 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73f764-59d9-46d8-9472-c6a7a03248d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:15.235208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73f764-59d9-46d8-9472-c6a7a03248d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:15.235832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73f764-59d9-46d8-9472-c6a7a03248d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:15.237467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73f764-59d9-46d8-9472-c6a7a03248d6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:15.248081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1120/2214] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:15.252429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73f764-59d9-46d8-9472-c6a7a03248d6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:15.264090 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73f764-59d9-46d8-9472-c6a7a03248d6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:15.269178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c168e-9a79-4797-b945-2a26fa000de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:15.269770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c168e-9a79-4797-b945-2a26fa000de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:15.270045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c168e-9a79-4797-b945-2a26fa000de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:15.270341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c168e-9a79-4797-b945-2a26fa000de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:15.271007 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c168e-9a79-4797-b945-2a26fa000de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:15.272614 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c168e-9a79-4797-b945-2a26fa000de1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:15.274510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a078187-d3bc-4afd-989f-19c2b87fae3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:15.275931 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a078187-d3bc-4afd-989f-19c2b87fae3d service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:15.282915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1121/2215] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:11:15.287002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c168e-9a79-4797-b945-2a26fa000de1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:15.287826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1095/2216] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:15.298338 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c168e-9a79-4797-b945-2a26fa000de1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:15.303359 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d045663-87fc-44ee-bf48-7b05d3151065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:15.303789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d045663-87fc-44ee-bf48-7b05d3151065 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:15.304095 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d045663-87fc-44ee-bf48-7b05d3151065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:15.304365 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d045663-87fc-44ee-bf48-7b05d3151065 admin admin] PATH_INFO: `/v3/projects/5dbb6e071e0849ad9f34fb67207d2fe7/users/d6ba100ea236427ba6e6466bb2c358fa/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:15.320570 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d045663-87fc-44ee-bf48-7b05d3151065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dbb6e071e0849ad9f34fb67207d2fe7, user_id=d6ba100ea236427ba6e6466bb2c358fa, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:15.323254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d045663-87fc-44ee-bf48-7b05d3151065 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:15.338667 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1122/2217] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:15 2022] PUT /identity/v3/projects/5dbb6e071e0849ad9f34fb67207d2fe7/users/d6ba100ea236427ba6e6466bb2c358fa/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:15.344586 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdd5f0-879f-48a8-a2ff-f17c6c44f7b2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:15.345034 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdd5f0-879f-48a8-a2ff-f17c6c44f7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:15.345480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdd5f0-879f-48a8-a2ff-f17c6c44f7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:15.368133 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3ccdd5f0-879f-48a8-a2ff-f17c6c44f7b2 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:15.369438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3ccdd5f0-879f-48a8-a2ff-f17c6c44f7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:15.379545 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:15.451998 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1096/2218] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:15.461377 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d045663-87fc-44ee-bf48-7b05d3151065 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:15.463104 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4d045663-87fc-44ee-bf48-7b05d3151065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:15.563232 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d045663-87fc-44ee-bf48-7b05d3151065 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:15.568158 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d02d26-fa95-4c14-95fe-502e57b66b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:15.569120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d02d26-fa95-4c14-95fe-502e57b66b13 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:15.570669 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d02d26-fa95-4c14-95fe-502e57b66b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:15.570669 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d02d26-fa95-4c14-95fe-502e57b66b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:15.581922 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d02d26-fa95-4c14-95fe-502e57b66b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:15.583470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d02d26-fa95-4c14-95fe-502e57b66b13 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:15.602086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1123/2219] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:20.435267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eee53-88ca-453e-a5dd-227dca7b2a7f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:20.436256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eee53-88ca-453e-a5dd-227dca7b2a7f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:20.436722 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eee53-88ca-453e-a5dd-227dca7b2a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:20.463899 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ff0eee53-88ca-453e-a5dd-227dca7b2a7f None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:20.465850 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ff0eee53-88ca-453e-a5dd-227dca7b2a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:20.553636 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1097/2220] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Aug 30 05:11:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:20.631279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d02d26-fa95-4c14-95fe-502e57b66b13 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:20.632845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a8d02d26-fa95-4c14-95fe-502e57b66b13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:20.707060 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:20.741133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d02d26-fa95-4c14-95fe-502e57b66b13 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:20.778230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfc7f2-48e5-4c4d-8e78-f3da59aae466 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:20.778996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfc7f2-48e5-4c4d-8e78-f3da59aae466 service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:20.779275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfc7f2-48e5-4c4d-8e78-f3da59aae466 service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:20.779544 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfc7f2-48e5-4c4d-8e78-f3da59aae466 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:20.807006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfc7f2-48e5-4c4d-8e78-f3da59aae466 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:20.808837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfc7f2-48e5-4c4d-8e78-f3da59aae466 service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:20.825933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1124/2221] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:11:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:11:21.873628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b73d3-adb7-4493-be50-ee005123fcab None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:21.874151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b73d3-adb7-4493-be50-ee005123fcab None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:21.874438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b73d3-adb7-4493-be50-ee005123fcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:21.909943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3f9b73d3-adb7-4493-be50-ee005123fcab None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:21.911245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3f9b73d3-adb7-4493-be50-ee005123fcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:21.921569 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1098/2222] 10.222.0.48 () {58 vars in 967 bytes} [Tue Aug 30 05:11:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:21.935160 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfc7f2-48e5-4c4d-8e78-f3da59aae466 service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:21.947788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfc7f2-48e5-4c4d-8e78-f3da59aae466 service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:21.953495 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60eba9-6d89-45e5-bf96-bf8e3582ecde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:21.954370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60eba9-6d89-45e5-bf96-bf8e3582ecde service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:21.954821 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60eba9-6d89-45e5-bf96-bf8e3582ecde service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:21.955268 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60eba9-6d89-45e5-bf96-bf8e3582ecde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:21.969605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60eba9-6d89-45e5-bf96-bf8e3582ecde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:21.971443 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60eba9-6d89-45e5-bf96-bf8e3582ecde service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:21.990376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1125/2223] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:11:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 05:11:22.330584 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e61a3-df4e-4ecc-a39c-260bcd90598a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:22.331101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e61a3-df4e-4ecc-a39c-260bcd90598a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:22.331555 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e61a3-df4e-4ecc-a39c-260bcd90598a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:22.353577 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-df7e61a3-df4e-4ecc-a39c-260bcd90598a None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:22.355225 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-df7e61a3-df4e-4ecc-a39c-260bcd90598a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:22.369120 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1099/2224] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Aug 30 05:11:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:22.387805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60eba9-6d89-45e5-bf96-bf8e3582ecde service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:22.404867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60eba9-6d89-45e5-bf96-bf8e3582ecde service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:22.414429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bfdcc-b868-4db8-8d77-7f2231b2c576 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:22.415860 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bfdcc-b868-4db8-8d77-7f2231b2c576 service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:22.416439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bfdcc-b868-4db8-8d77-7f2231b2c576 service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:22.417364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bfdcc-b868-4db8-8d77-7f2231b2c576 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:22.430349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bfdcc-b868-4db8-8d77-7f2231b2c576 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:22.432284 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bfdcc-b868-4db8-8d77-7f2231b2c576 service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:22.445207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1126/2225] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:11:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 05:11:23.201085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59248178-d7eb-4657-9556-99e6af38ce1e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:23.201548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59248178-d7eb-4657-9556-99e6af38ce1e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:23.201627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59248178-d7eb-4657-9556-99e6af38ce1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:23.208304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa562-2b42-410e-b7ca-fa753c143264 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:23.209142 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa562-2b42-410e-b7ca-fa753c143264 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:23.209622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa562-2b42-410e-b7ca-fa753c143264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:23.232061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-59248178-d7eb-4657-9556-99e6af38ce1e None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:23.233521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-59248178-d7eb-4657-9556-99e6af38ce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:23.247897 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1100/2226] 10.222.0.48 () {58 vars in 967 bytes} [Tue Aug 30 05:11:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:23.267888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8f2aa562-2b42-410e-b7ca-fa753c143264 None None] MFA Rules not processed for user `d6ba100ea236427ba6e6466bb2c358fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:23.270197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59248178-d7eb-4657-9556-99e6af38ce1e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:23.270399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8f2aa562-2b42-410e-b7ca-fa753c143264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:23.284663 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59248178-d7eb-4657-9556-99e6af38ce1e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:23.292334 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee445d-5b9a-43ca-813e-cf965a993947 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:23.293435 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee445d-5b9a-43ca-813e-cf965a993947 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:23.293869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee445d-5b9a-43ca-813e-cf965a993947 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:23.294240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee445d-5b9a-43ca-813e-cf965a993947 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:23.304988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee445d-5b9a-43ca-813e-cf965a993947 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:23.307679 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee445d-5b9a-43ca-813e-cf965a993947 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:23.318446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1101/2227] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:11:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:11:23.396200 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1127/2228] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:11:23.401787 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee445d-5b9a-43ca-813e-cf965a993947 service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:23.414704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee445d-5b9a-43ca-813e-cf965a993947 service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:23.424969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43921813-2775-4dee-b2f0-96bde692abd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:23.425923 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43921813-2775-4dee-b2f0-96bde692abd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:23.426760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43921813-2775-4dee-b2f0-96bde692abd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:23.427342 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43921813-2775-4dee-b2f0-96bde692abd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:23.428834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43921813-2775-4dee-b2f0-96bde692abd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:23.430974 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43921813-2775-4dee-b2f0-96bde692abd4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:23.480639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1102/2229] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:23 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:23.481857 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aa562-2b42-410e-b7ca-fa753c143264 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:23.496303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aa562-2b42-410e-b7ca-fa753c143264 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:23.628990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910fa80-4669-40ec-8003-563b18b8d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:23.629630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910fa80-4669-40ec-8003-563b18b8d606 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:23.629905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910fa80-4669-40ec-8003-563b18b8d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:23.630180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910fa80-4669-40ec-8003-563b18b8d606 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:23.631181 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910fa80-4669-40ec-8003-563b18b8d606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:23.637626 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910fa80-4669-40ec-8003-563b18b8d606 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:23.670874 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1128/2230] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:23 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:23.675409 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43921813-2775-4dee-b2f0-96bde692abd4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:23.687762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43921813-2775-4dee-b2f0-96bde692abd4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:23.706650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca16e07-6572-4fc5-9e56-927ae234c111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:23.707831 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca16e07-6572-4fc5-9e56-927ae234c111 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:23.708318 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca16e07-6572-4fc5-9e56-927ae234c111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:23.708785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca16e07-6572-4fc5-9e56-927ae234c111 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:23.709649 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca16e07-6572-4fc5-9e56-927ae234c111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:23.711492 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca16e07-6572-4fc5-9e56-927ae234c111 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:23.725105 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1103/2231] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:23.731051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910fa80-4669-40ec-8003-563b18b8d606 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:23.746087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910fa80-4669-40ec-8003-563b18b8d606 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:23.758992 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7d8bc-0ea2-48d0-b3de-9815eb6becd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:23.760053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7d8bc-0ea2-48d0-b3de-9815eb6becd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:23.760461 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7d8bc-0ea2-48d0-b3de-9815eb6becd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:23.760832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7d8bc-0ea2-48d0-b3de-9815eb6becd7 admin admin] PATH_INFO: `/v3/projects/2c3705285d32403b815b989bba9996e6/users/e56f445a0b8641c38fc1322c1636c61d/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:23.800254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7d8bc-0ea2-48d0-b3de-9815eb6becd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3705285d32403b815b989bba9996e6, user_id=e56f445a0b8641c38fc1322c1636c61d, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:23.819572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7d8bc-0ea2-48d0-b3de-9815eb6becd7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:23.858199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1129/2232] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:23 2022] PUT /identity/v3/projects/2c3705285d32403b815b989bba9996e6/users/e56f445a0b8641c38fc1322c1636c61d/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:23.876997 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca16e07-6572-4fc5-9e56-927ae234c111 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:23.917911 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca16e07-6572-4fc5-9e56-927ae234c111 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:24.050686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:24.064929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a75ea-90f8-4641-b95a-f8510046b55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:24.066223 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a75ea-90f8-4641-b95a-f8510046b55e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:24.066223 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a75ea-90f8-4641-b95a-f8510046b55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:24.066705 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a75ea-90f8-4641-b95a-f8510046b55e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:24.067516 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a75ea-90f8-4641-b95a-f8510046b55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:24.070265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a75ea-90f8-4641-b95a-f8510046b55e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:24.094075 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1104/2233] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:24.101878 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7d8bc-0ea2-48d0-b3de-9815eb6becd7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:24.127780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7d8bc-0ea2-48d0-b3de-9815eb6becd7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:24.155131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8512df6-c9e3-41a6-a65e-1a289793a179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:24.157455 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8512df6-c9e3-41a6-a65e-1a289793a179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:24.159462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8512df6-c9e3-41a6-a65e-1a289793a179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:24.159982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8512df6-c9e3-41a6-a65e-1a289793a179 admin admin] PATH_INFO: `/v3/projects/2c3705285d32403b815b989bba9996e6/users/e56f445a0b8641c38fc1322c1636c61d/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:24.162774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8512df6-c9e3-41a6-a65e-1a289793a179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3705285d32403b815b989bba9996e6, user_id=e56f445a0b8641c38fc1322c1636c61d, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:24.165836 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8512df6-c9e3-41a6-a65e-1a289793a179 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:24.169464 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:24.184811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1130/2234] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:24 2022] PUT /identity/v3/projects/2c3705285d32403b815b989bba9996e6/users/e56f445a0b8641c38fc1322c1636c61d/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:26.815925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a75ea-90f8-4641-b95a-f8510046b55e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:26.828286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-742a75ea-90f8-4641-b95a-f8510046b55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:26.852560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a75ea-90f8-4641-b95a-f8510046b55e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:27.086669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d37a7-9e19-4888-9a12-d2fbf0588b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:27.087413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d37a7-9e19-4888-9a12-d2fbf0588b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:27.087763 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d37a7-9e19-4888-9a12-d2fbf0588b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:27.088242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d37a7-9e19-4888-9a12-d2fbf0588b99 admin admin] PATH_INFO: `/v3/users/1b38fed124764d69818f8d6a08dbbf16` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:27.096502 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d37a7-9e19-4888-9a12-d2fbf0588b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b38fed124764d69818f8d6a08dbbf16)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:27.098825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d37a7-9e19-4888-9a12-d2fbf0588b99 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:27.218774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8e4d37a7-9e19-4888-9a12-d2fbf0588b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b38fed124764d69818f8d6a08dbbf16'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:27.244567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8e4d37a7-9e19-4888-9a12-d2fbf0588b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b38fed124764d69818f8d6a08dbbf16'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:27.264885 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8e4d37a7-9e19-4888-9a12-d2fbf0588b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b38fed124764d69818f8d6a08dbbf16'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:27.270300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8e4d37a7-9e19-4888-9a12-d2fbf0588b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b38fed124764d69818f8d6a08dbbf16'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:27.272181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8e4d37a7-9e19-4888-9a12-d2fbf0588b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b38fed124764d69818f8d6a08dbbf16'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:27.311609 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1105/2235] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:26 2022] DELETE /identity/v3/users/1b38fed124764d69818f8d6a08dbbf16 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:27.313976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1efdc-1245-4b6e-be3b-f8e835dd3e56 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:27.314789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1efdc-1245-4b6e-be3b-f8e835dd3e56 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:27.315457 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1efdc-1245-4b6e-be3b-f8e835dd3e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:27.350314 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-cec1efdc-1245-4b6e-be3b-f8e835dd3e56 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:27.352456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cec1efdc-1245-4b6e-be3b-f8e835dd3e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:27.526870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1131/2236] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:27.536723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d37a7-9e19-4888-9a12-d2fbf0588b99 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:27.538601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8e4d37a7-9e19-4888-9a12-d2fbf0588b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:27.638414 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d37a7-9e19-4888-9a12-d2fbf0588b99 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:27.643158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126723c5-59bb-49b7-b37c-a9932dcf19f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:27.643777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126723c5-59bb-49b7-b37c-a9932dcf19f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:27.644126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126723c5-59bb-49b7-b37c-a9932dcf19f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:27.645537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126723c5-59bb-49b7-b37c-a9932dcf19f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:27.655352 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126723c5-59bb-49b7-b37c-a9932dcf19f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:27.659349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126723c5-59bb-49b7-b37c-a9932dcf19f9 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:27.676420 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1106/2237] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:27.944709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df8f4b-7ad3-4799-b57e-732341251945 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:27.945033 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df8f4b-7ad3-4799-b57e-732341251945 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:27.945829 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df8f4b-7ad3-4799-b57e-732341251945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:27.977917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-99df8f4b-7ad3-4799-b57e-732341251945 None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:27.979315 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-99df8f4b-7ad3-4799-b57e-732341251945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:28.078699 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1132/2238] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Aug 30 05:11:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:28.080210 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126723c5-59bb-49b7-b37c-a9932dcf19f9 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:28.083719 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-126723c5-59bb-49b7-b37c-a9932dcf19f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:28.112628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:28.203048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df8f4b-7ad3-4799-b57e-732341251945 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:28.204770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-99df8f4b-7ad3-4799-b57e-732341251945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:28.224214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126723c5-59bb-49b7-b37c-a9932dcf19f9 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:28.230507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82846a8-39f4-400b-8771-73f85f7ad042 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:28.232150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82846a8-39f4-400b-8771-73f85f7ad042 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:28.232588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82846a8-39f4-400b-8771-73f85f7ad042 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:28.233003 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82846a8-39f4-400b-8771-73f85f7ad042 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:28.237754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df8f4b-7ad3-4799-b57e-732341251945 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:28.249272 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82846a8-39f4-400b-8771-73f85f7ad042 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:28.251938 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c713c-d11d-42a7-a061-5708471216e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:28.252632 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c713c-d11d-42a7-a061-5708471216e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:28.252911 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c713c-d11d-42a7-a061-5708471216e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:28.253185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c713c-d11d-42a7-a061-5708471216e6 admin admin] PATH_INFO: `/v3/projects/0c8b2a7b974d43c3ae89752bba5bbec4` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:28.254095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82846a8-39f4-400b-8771-73f85f7ad042 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:28.260746 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c713c-d11d-42a7-a061-5708471216e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c8b2a7b974d43c3ae89752bba5bbec4)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:28.266361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c713c-d11d-42a7-a061-5708471216e6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:28.290907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1107/2239] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:11:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:11:28.407665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6c9c713c-d11d-42a7-a061-5708471216e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c8b2a7b974d43c3ae89752bba5bbec4', 'request_id': 'req-6c9c713c-d11d-42a7-a061-5708471216e6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:28.417819 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6c9c713c-d11d-42a7-a061-5708471216e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c8b2a7b974d43c3ae89752bba5bbec4', 'request_id': 'req-6c9c713c-d11d-42a7-a061-5708471216e6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:28.445429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6c9c713c-d11d-42a7-a061-5708471216e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c8b2a7b974d43c3ae89752bba5bbec4', 'request_id': 'req-6c9c713c-d11d-42a7-a061-5708471216e6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:28.463803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6c9c713c-d11d-42a7-a061-5708471216e6 admin admin] The token cache is being invalidate because project 0c8b2a7b974d43c3ae89752bba5bbec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:28.464361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6c9c713c-d11d-42a7-a061-5708471216e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:28.465389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6c9c713c-d11d-42a7-a061-5708471216e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:28.467583 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1133/2240] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:28 2022] DELETE /identity/v3/projects/0c8b2a7b974d43c3ae89752bba5bbec4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:11:30.172587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82846a8-39f4-400b-8771-73f85f7ad042 service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:30.177286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b82846a8-39f4-400b-8771-73f85f7ad042 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:30.235688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82846a8-39f4-400b-8771-73f85f7ad042 service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:30.437257 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6cb80-745f-49f9-b9b8-9a5f02e93702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:30.437916 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6cb80-745f-49f9-b9b8-9a5f02e93702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:30.438188 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6cb80-745f-49f9-b9b8-9a5f02e93702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:30.438455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6cb80-745f-49f9-b9b8-9a5f02e93702 admin admin] PATH_INFO: `/v3/users/a9fc85862a92437f85c8b144694e4998` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:30.439661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6cb80-745f-49f9-b9b8-9a5f02e93702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9fc85862a92437f85c8b144694e4998)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:30.441614 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6cb80-745f-49f9-b9b8-9a5f02e93702 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:30.546129 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-65e6cb80-745f-49f9-b9b8-9a5f02e93702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9fc85862a92437f85c8b144694e4998'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:30.594521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-65e6cb80-745f-49f9-b9b8-9a5f02e93702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9fc85862a92437f85c8b144694e4998'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:30.620282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-65e6cb80-745f-49f9-b9b8-9a5f02e93702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9fc85862a92437f85c8b144694e4998'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:30.621859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-65e6cb80-745f-49f9-b9b8-9a5f02e93702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9fc85862a92437f85c8b144694e4998'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:30.625318 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-65e6cb80-745f-49f9-b9b8-9a5f02e93702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9fc85862a92437f85c8b144694e4998'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:30.662311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1108/2241] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:30 2022] DELETE /identity/v3/users/a9fc85862a92437f85c8b144694e4998 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:30.667712 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7383c44-31e6-4097-a7f2-29f25f67e1be None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:30.668272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7383c44-31e6-4097-a7f2-29f25f67e1be None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:30.668391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7383c44-31e6-4097-a7f2-29f25f67e1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:30.706189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e7383c44-31e6-4097-a7f2-29f25f67e1be None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:30.707728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e7383c44-31e6-4097-a7f2-29f25f67e1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:30.777837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:30.917319 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1134/2242] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:30.961303 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6cb80-745f-49f9-b9b8-9a5f02e93702 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:30.965994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-65e6cb80-745f-49f9-b9b8-9a5f02e93702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:31.038067 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:31.112574 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6cb80-745f-49f9-b9b8-9a5f02e93702 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:31.117061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2f2ce-db62-4d53-8324-48b79284adb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:31.117902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2f2ce-db62-4d53-8324-48b79284adb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:31.118913 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2f2ce-db62-4d53-8324-48b79284adb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:31.119367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2f2ce-db62-4d53-8324-48b79284adb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:31.150889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2f2ce-db62-4d53-8324-48b79284adb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:31.153556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2f2ce-db62-4d53-8324-48b79284adb1 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:31.180518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1109/2243] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:32.393448 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7383c44-31e6-4097-a7f2-29f25f67e1be None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:32.394947 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e7383c44-31e6-4097-a7f2-29f25f67e1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:32.416334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7383c44-31e6-4097-a7f2-29f25f67e1be None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:32.433745 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdb609-af77-4d51-995f-7ee8ad6205a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:32.434416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdb609-af77-4d51-995f-7ee8ad6205a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:32.434700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdb609-af77-4d51-995f-7ee8ad6205a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:32.434971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdb609-af77-4d51-995f-7ee8ad6205a4 admin admin] PATH_INFO: `/v3/projects/4431ecaa251b49398617641c78fec736` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:32.440890 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdb609-af77-4d51-995f-7ee8ad6205a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4431ecaa251b49398617641c78fec736)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:32.444384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdb609-af77-4d51-995f-7ee8ad6205a4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:32.602723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8acdb609-af77-4d51-995f-7ee8ad6205a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4431ecaa251b49398617641c78fec736', 'request_id': 'req-8acdb609-af77-4d51-995f-7ee8ad6205a4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:32.610178 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e967d-87cd-4105-b64a-426f1654e5c8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:32.611060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e967d-87cd-4105-b64a-426f1654e5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:32.611504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e967d-87cd-4105-b64a-426f1654e5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:32.619066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8acdb609-af77-4d51-995f-7ee8ad6205a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4431ecaa251b49398617641c78fec736', 'request_id': 'req-8acdb609-af77-4d51-995f-7ee8ad6205a4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:32.631664 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8acdb609-af77-4d51-995f-7ee8ad6205a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4431ecaa251b49398617641c78fec736', 'request_id': 'req-8acdb609-af77-4d51-995f-7ee8ad6205a4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:32.648744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8acdb609-af77-4d51-995f-7ee8ad6205a4 admin admin] The token cache is being invalidate because project 4431ecaa251b49398617641c78fec736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:32.649034 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8acdb609-af77-4d51-995f-7ee8ad6205a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:32.649930 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8acdb609-af77-4d51-995f-7ee8ad6205a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:32.651999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1135/2244] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:32 2022] DELETE /identity/v3/projects/4431ecaa251b49398617641c78fec736 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:32.656205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdb609-af77-4d51-995f-7ee8ad6205a4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:32.660135 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8acdb609-af77-4d51-995f-7ee8ad6205a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:32.665083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b51e967d-87cd-4105-b64a-426f1654e5c8 None None] MFA Rules not processed for user `e56f445a0b8641c38fc1322c1636c61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:32.667041 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b51e967d-87cd-4105-b64a-426f1654e5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:32.805383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdb609-af77-4d51-995f-7ee8ad6205a4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:32.808087 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1110/2245] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:11:32.812280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450953a7-56bc-478f-80e9-a534d6c0d492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:32.813702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450953a7-56bc-478f-80e9-a534d6c0d492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:32.813989 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450953a7-56bc-478f-80e9-a534d6c0d492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:32.814260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450953a7-56bc-478f-80e9-a534d6c0d492 admin admin] PATH_INFO: `/v3/users/a365b082f4de4593be437fc425ba8784` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:32.816845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450953a7-56bc-478f-80e9-a534d6c0d492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a365b082f4de4593be437fc425ba8784)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:32.818826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450953a7-56bc-478f-80e9-a534d6c0d492 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:32.821606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e967d-87cd-4105-b64a-426f1654e5c8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:32.822994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b51e967d-87cd-4105-b64a-426f1654e5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:32.994606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-450953a7-56bc-478f-80e9-a534d6c0d492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a365b082f4de4593be437fc425ba8784'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:32.998779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:33.004295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e967d-87cd-4105-b64a-426f1654e5c8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:33.006984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-450953a7-56bc-478f-80e9-a534d6c0d492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a365b082f4de4593be437fc425ba8784'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:33.010419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec6543-766e-4be3-b98b-576611fb1b23 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d3889156524b388b761cedfac8ed6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:33.011087 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec6543-766e-4be3-b98b-576611fb1b23 service glance] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:33.011422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec6543-766e-4be3-b98b-576611fb1b23 service glance] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:33.011813 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec6543-766e-4be3-b98b-576611fb1b23 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:33.013640 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8fec6543-766e-4be3-b98b-576611fb1b23 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:33.021519 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-450953a7-56bc-478f-80e9-a534d6c0d492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a365b082f4de4593be437fc425ba8784'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:33.022676 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-450953a7-56bc-478f-80e9-a534d6c0d492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a365b082f4de4593be437fc425ba8784'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:33.058156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-450953a7-56bc-478f-80e9-a534d6c0d492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a365b082f4de4593be437fc425ba8784'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:33.074662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1136/2246] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:32 2022] DELETE /identity/v3/users/a365b082f4de4593be437fc425ba8784 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:33.079680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3630f-dd5c-414c-8ea1-a3bccf2c4e8e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:33.080222 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3630f-dd5c-414c-8ea1-a3bccf2c4e8e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:33.080659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3630f-dd5c-414c-8ea1-a3bccf2c4e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:33.110410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f1c3630f-dd5c-414c-8ea1-a3bccf2c4e8e None None] MFA Rules not processed for user `dd803cc555584e95baf795337a36ad6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:33.112617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f1c3630f-dd5c-414c-8ea1-a3bccf2c4e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:33.146370 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec6543-766e-4be3-b98b-576611fb1b23 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:33.148192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec6543-766e-4be3-b98b-576611fb1b23 service glance] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:33.184171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1111/2247] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:11:33.302247 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1137/2248] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:33.429082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764cbd8-da5b-420d-b0dd-3402c7bc1d94 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:33.429409 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764cbd8-da5b-420d-b0dd-3402c7bc1d94 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:33.429712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764cbd8-da5b-420d-b0dd-3402c7bc1d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:33.440782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:33.466660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1764cbd8-da5b-420d-b0dd-3402c7bc1d94 None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:33.469228 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1764cbd8-da5b-420d-b0dd-3402c7bc1d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:33.498075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3630f-dd5c-414c-8ea1-a3bccf2c4e8e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:33.500323 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f1c3630f-dd5c-414c-8ea1-a3bccf2c4e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:33.611680 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3630f-dd5c-414c-8ea1-a3bccf2c4e8e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:33.616426 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6820da-2e37-4207-9aaa-83faaa5a1179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:33.617113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6820da-2e37-4207-9aaa-83faaa5a1179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:33.617462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6820da-2e37-4207-9aaa-83faaa5a1179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:33.617760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6820da-2e37-4207-9aaa-83faaa5a1179 admin admin] PATH_INFO: `/v3/projects/923ed913b638493aac47999d8969842c` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:33.619028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6820da-2e37-4207-9aaa-83faaa5a1179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=923ed913b638493aac47999d8969842c)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:33.621373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6820da-2e37-4207-9aaa-83faaa5a1179 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:33.678911 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1112/2249] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Aug 30 05:11:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:33.712927 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-df6820da-2e37-4207-9aaa-83faaa5a1179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923ed913b638493aac47999d8969842c', 'request_id': 'req-df6820da-2e37-4207-9aaa-83faaa5a1179'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:33.720706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-df6820da-2e37-4207-9aaa-83faaa5a1179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923ed913b638493aac47999d8969842c', 'request_id': 'req-df6820da-2e37-4207-9aaa-83faaa5a1179'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:33.737355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-df6820da-2e37-4207-9aaa-83faaa5a1179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923ed913b638493aac47999d8969842c', 'request_id': 'req-df6820da-2e37-4207-9aaa-83faaa5a1179'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:33.737759 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764cbd8-da5b-420d-b0dd-3402c7bc1d94 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:33.739982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1764cbd8-da5b-420d-b0dd-3402c7bc1d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:33.763161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-df6820da-2e37-4207-9aaa-83faaa5a1179 admin admin] The token cache is being invalidate because project 923ed913b638493aac47999d8969842c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:33.764076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-df6820da-2e37-4207-9aaa-83faaa5a1179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:33.765435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-df6820da-2e37-4207-9aaa-83faaa5a1179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:33.767723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1138/2250] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:33 2022] DELETE /identity/v3/projects/923ed913b638493aac47999d8969842c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:11:33.774849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7af90-9c56-4517-af5a-1df2ac81ee8b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:33.774849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7af90-9c56-4517-af5a-1df2ac81ee8b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:33.775158 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7af90-9c56-4517-af5a-1df2ac81ee8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:33.838113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:33.868638 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-12b7af90-9c56-4517-af5a-1df2ac81ee8b None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:33.872031 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-12b7af90-9c56-4517-af5a-1df2ac81ee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:33.973357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764cbd8-da5b-420d-b0dd-3402c7bc1d94 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:33.998593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1139/2251] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:34.000621 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ef80d-70bc-4f2d-8253-36590dd257b4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:34.001086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ef80d-70bc-4f2d-8253-36590dd257b4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:34.001626 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ef80d-70bc-4f2d-8253-36590dd257b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:34.028110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-374ef80d-70bc-4f2d-8253-36590dd257b4 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:34.029974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-374ef80d-70bc-4f2d-8253-36590dd257b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:34.051204 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1140/2252] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:34.053695 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ef80d-70bc-4f2d-8253-36590dd257b4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:34.071372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ef80d-70bc-4f2d-8253-36590dd257b4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:34.083335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed71794-4fa4-4839-a935-facabd2604e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:34.084156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed71794-4fa4-4839-a935-facabd2604e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:34.084547 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed71794-4fa4-4839-a935-facabd2604e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:34.084910 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed71794-4fa4-4839-a935-facabd2604e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:34.086373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed71794-4fa4-4839-a935-facabd2604e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:11:34.087303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed71794-4fa4-4839-a935-facabd2604e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:34.090344 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed71794-4fa4-4839-a935-facabd2604e9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:34.123976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1141/2253] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:11:34.129659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed71794-4fa4-4839-a935-facabd2604e9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:34.148215 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed71794-4fa4-4839-a935-facabd2604e9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:34.154619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aa1af-c0e0-4919-bd89-723fa21835ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:34.157461 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aa1af-c0e0-4919-bd89-723fa21835ec admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:34.157847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aa1af-c0e0-4919-bd89-723fa21835ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:34.158214 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aa1af-c0e0-4919-bd89-723fa21835ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:34.158966 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aa1af-c0e0-4919-bd89-723fa21835ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:34.161015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aa1af-c0e0-4919-bd89-723fa21835ec admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:34.171942 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead52a6-8afd-4db4-8baf-f0b4162e8e95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:34.172764 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead52a6-8afd-4db4-8baf-f0b4162e8e95 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:34.173280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead52a6-8afd-4db4-8baf-f0b4162e8e95 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:34.173644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead52a6-8afd-4db4-8baf-f0b4162e8e95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:34.181445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7ead52a6-8afd-4db4-8baf-f0b4162e8e95 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:34.229828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1142/2254] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:34 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:34.232134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aa1af-c0e0-4919-bd89-723fa21835ec admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:34.323526 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:34.339870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aa1af-c0e0-4919-bd89-723fa21835ec admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:34.345859 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c42d89-cad6-48e3-96ba-f38107fb0294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:34.346939 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c42d89-cad6-48e3-96ba-f38107fb0294 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:34.347407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c42d89-cad6-48e3-96ba-f38107fb0294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:34.347874 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c42d89-cad6-48e3-96ba-f38107fb0294 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:34.349133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c42d89-cad6-48e3-96ba-f38107fb0294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:34.350233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead52a6-8afd-4db4-8baf-f0b4162e8e95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:34.352278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c42d89-cad6-48e3-96ba-f38107fb0294 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:34.353348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead52a6-8afd-4db4-8baf-f0b4162e8e95 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:34.390557 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1113/2255] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:11:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:11:34.431697 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1143/2256] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:34 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:34.435783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead52a6-8afd-4db4-8baf-f0b4162e8e95 service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:34.466080 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead52a6-8afd-4db4-8baf-f0b4162e8e95 service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:34.473582 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fd6cd-5f5d-41ff-bd8a-6e47d5813b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:34.474363 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fd6cd-5f5d-41ff-bd8a-6e47d5813b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:34.474744 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fd6cd-5f5d-41ff-bd8a-6e47d5813b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:34.475121 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fd6cd-5f5d-41ff-bd8a-6e47d5813b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:34.475879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fd6cd-5f5d-41ff-bd8a-6e47d5813b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:34.477674 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fd6cd-5f5d-41ff-bd8a-6e47d5813b22 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:34.544039 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1114/2257] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:11:34.548475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c42d89-cad6-48e3-96ba-f38107fb0294 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:34.572598 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c42d89-cad6-48e3-96ba-f38107fb0294 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:34.597917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83f134-c9ad-4ce3-acbe-7394ecdd51de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:34.598817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83f134-c9ad-4ce3-acbe-7394ecdd51de admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:34.599252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83f134-c9ad-4ce3-acbe-7394ecdd51de admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:34.599517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83f134-c9ad-4ce3-acbe-7394ecdd51de admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:34.602464 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83f134-c9ad-4ce3-acbe-7394ecdd51de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:34.605447 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83f134-c9ad-4ce3-acbe-7394ecdd51de admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:34.623976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1144/2258] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:34.625759 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fd6cd-5f5d-41ff-bd8a-6e47d5813b22 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:34.659212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fd6cd-5f5d-41ff-bd8a-6e47d5813b22 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:34.668859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d5b7e-5fbc-4d56-bb97-bfa9eabe27a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:34.670508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d5b7e-5fbc-4d56-bb97-bfa9eabe27a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:34.671780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d5b7e-5fbc-4d56-bb97-bfa9eabe27a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:34.672447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d5b7e-5fbc-4d56-bb97-bfa9eabe27a1 admin admin] PATH_INFO: `/v3/projects/6cd7a64dcbe94c2c8aa42c2dc82e9f97/users/40ddc0b4b2544d549240a301f867d7af/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:34.712851 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d5b7e-5fbc-4d56-bb97-bfa9eabe27a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd7a64dcbe94c2c8aa42c2dc82e9f97, user_id=40ddc0b4b2544d549240a301f867d7af, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:34.722364 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d5b7e-5fbc-4d56-bb97-bfa9eabe27a1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:34.783462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1115/2259] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:34 2022] PUT /identity/v3/projects/6cd7a64dcbe94c2c8aa42c2dc82e9f97/users/40ddc0b4b2544d549240a301f867d7af/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:34.783703 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea618880-de14-41f2-83de-4346c744475e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:34.783908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea618880-de14-41f2-83de-4346c744475e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:34.784209 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea618880-de14-41f2-83de-4346c744475e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:34.911017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ea618880-de14-41f2-83de-4346c744475e None None] MFA Rules not processed for user `40ddc0b4b2544d549240a301f867d7af`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:34.914311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ea618880-de14-41f2-83de-4346c744475e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:35.062120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:35.244593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1145/2260] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:35.248686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d5b7e-5fbc-4d56-bb97-bfa9eabe27a1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:35.371521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d5b7e-5fbc-4d56-bb97-bfa9eabe27a1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:35.381885 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df602d27-d0a3-4cfc-a147-d1e31691f6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:35.382523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df602d27-d0a3-4cfc-a147-d1e31691f6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:35.382804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df602d27-d0a3-4cfc-a147-d1e31691f6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:35.383129 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df602d27-d0a3-4cfc-a147-d1e31691f6b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:35.383725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df602d27-d0a3-4cfc-a147-d1e31691f6b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:35.391208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df602d27-d0a3-4cfc-a147-d1e31691f6b2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:35.460516 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1116/2261] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:35 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:11:35.462333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea618880-de14-41f2-83de-4346c744475e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:35.488369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea618880-de14-41f2-83de-4346c744475e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:35.625920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57827e1f-b498-4754-88c9-ca3afc09d094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:35.626631 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57827e1f-b498-4754-88c9-ca3afc09d094 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:35.626974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57827e1f-b498-4754-88c9-ca3afc09d094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:35.627333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57827e1f-b498-4754-88c9-ca3afc09d094 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:35.629218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57827e1f-b498-4754-88c9-ca3afc09d094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:35.631889 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57827e1f-b498-4754-88c9-ca3afc09d094 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:35.670178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1146/2262] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:35 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:11:35.674626 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df602d27-d0a3-4cfc-a147-d1e31691f6b2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:35.685433 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57827e1f-b498-4754-88c9-ca3afc09d094 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:35.697787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-57827e1f-b498-4754-88c9-ca3afc09d094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:35.698647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df602d27-d0a3-4cfc-a147-d1e31691f6b2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:35.716463 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11461809-737f-4da4-ad6b-daffb1a8ffee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:35.721188 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11461809-737f-4da4-ad6b-daffb1a8ffee admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:35.722071 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11461809-737f-4da4-ad6b-daffb1a8ffee admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:35.723940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11461809-737f-4da4-ad6b-daffb1a8ffee admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:35.724787 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11461809-737f-4da4-ad6b-daffb1a8ffee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:35.733451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11461809-737f-4da4-ad6b-daffb1a8ffee admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:35.747637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57827e1f-b498-4754-88c9-ca3afc09d094 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:35.764084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304d0b6-12ce-4985-a93b-4fcd175c301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:35.765991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304d0b6-12ce-4985-a93b-4fcd175c301a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:35.766389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304d0b6-12ce-4985-a93b-4fcd175c301a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:35.766770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304d0b6-12ce-4985-a93b-4fcd175c301a admin admin] PATH_INFO: `/v3/users/5d0ac18977b141e9aad592109e744d8a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:35.768594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304d0b6-12ce-4985-a93b-4fcd175c301a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0ac18977b141e9aad592109e744d8a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:35.772756 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1117/2263] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:35.776728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304d0b6-12ce-4985-a93b-4fcd175c301a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:35.777112 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11461809-737f-4da4-ad6b-daffb1a8ffee admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:35.821679 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11461809-737f-4da4-ad6b-daffb1a8ffee admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:35.834683 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82356a38-a579-49c4-836f-08fc04ad8570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:35.835419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82356a38-a579-49c4-836f-08fc04ad8570 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:35.835805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82356a38-a579-49c4-836f-08fc04ad8570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:35.836260 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82356a38-a579-49c4-836f-08fc04ad8570 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:35.836962 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82356a38-a579-49c4-836f-08fc04ad8570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:35.838672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82356a38-a579-49c4-836f-08fc04ad8570 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:35.855351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1118/2264] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:35.860304 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82356a38-a579-49c4-836f-08fc04ad8570 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:35.876072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82356a38-a579-49c4-836f-08fc04ad8570 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:35.883687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2e001-b7b5-45cc-8cba-adeb0515ef69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:35.884937 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2e001-b7b5-45cc-8cba-adeb0515ef69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:35.885450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2e001-b7b5-45cc-8cba-adeb0515ef69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:35.886001 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2e001-b7b5-45cc-8cba-adeb0515ef69 admin admin] PATH_INFO: `/v3/projects/55bf714ca30d4a899ac83c50f7f2876e/users/e2bcbcf4df2f44908b55271c0ca87a2a/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:35.920580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3304d0b6-12ce-4985-a93b-4fcd175c301a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0ac18977b141e9aad592109e744d8a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:35.934456 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2e001-b7b5-45cc-8cba-adeb0515ef69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55bf714ca30d4a899ac83c50f7f2876e, user_id=e2bcbcf4df2f44908b55271c0ca87a2a, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:35.942254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3304d0b6-12ce-4985-a93b-4fcd175c301a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0ac18977b141e9aad592109e744d8a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:35.949419 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2e001-b7b5-45cc-8cba-adeb0515ef69 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:35.954333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3304d0b6-12ce-4985-a93b-4fcd175c301a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0ac18977b141e9aad592109e744d8a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:35.955217 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3304d0b6-12ce-4985-a93b-4fcd175c301a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0ac18977b141e9aad592109e744d8a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:35.980780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3304d0b6-12ce-4985-a93b-4fcd175c301a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0ac18977b141e9aad592109e744d8a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:35.989535 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1119/2265] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:35 2022] PUT /identity/v3/projects/55bf714ca30d4a899ac83c50f7f2876e/users/e2bcbcf4df2f44908b55271c0ca87a2a/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:36.003152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1147/2266] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:35 2022] DELETE /identity/v3/users/5d0ac18977b141e9aad592109e744d8a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:36.006534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b1a35-6f7e-4c03-9802-d23efdf3bfad None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:36.006534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b1a35-6f7e-4c03-9802-d23efdf3bfad None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:36.006534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b1a35-6f7e-4c03-9802-d23efdf3bfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:36.009181 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fae844-a474-46f8-8b04-2bf4a01c97ed None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:36.009634 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fae844-a474-46f8-8b04-2bf4a01c97ed None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:36.010082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fae844-a474-46f8-8b04-2bf4a01c97ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:36.044667 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-87fae844-a474-46f8-8b04-2bf4a01c97ed None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:36.047111 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-87fae844-a474-46f8-8b04-2bf4a01c97ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:36.110761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ef4b1a35-6f7e-4c03-9802-d23efdf3bfad None None] MFA Rules not processed for user `e2bcbcf4df2f44908b55271c0ca87a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:36.112610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:36.114052 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ef4b1a35-6f7e-4c03-9802-d23efdf3bfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:36.225409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1148/2267] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:36.226851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fae844-a474-46f8-8b04-2bf4a01c97ed None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:36.230516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-87fae844-a474-46f8-8b04-2bf4a01c97ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:36.262742 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:36.328259 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1120/2268] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:36.332792 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b1a35-6f7e-4c03-9802-d23efdf3bfad None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:36.334928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ef4b1a35-6f7e-4c03-9802-d23efdf3bfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:36.367000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b1a35-6f7e-4c03-9802-d23efdf3bfad None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:36.372206 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fae844-a474-46f8-8b04-2bf4a01c97ed None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:36.377605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bb1c1-fcc1-44de-a309-b29e19e6dbd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:36.378589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bb1c1-fcc1-44de-a309-b29e19e6dbd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:36.379071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bb1c1-fcc1-44de-a309-b29e19e6dbd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:36.379497 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bb1c1-fcc1-44de-a309-b29e19e6dbd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:36.381535 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaef2d-a925-4719-b0bc-f7d7cda4ff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:36.387613 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaef2d-a925-4719-b0bc-f7d7cda4ff53 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:36.388469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaef2d-a925-4719-b0bc-f7d7cda4ff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:36.388928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaef2d-a925-4719-b0bc-f7d7cda4ff53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:36.390685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aaef2d-a925-4719-b0bc-f7d7cda4ff53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:36.395353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bb1c1-fcc1-44de-a309-b29e19e6dbd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:36.396146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aaef2d-a925-4719-b0bc-f7d7cda4ff53 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:36.397591 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bb1c1-fcc1-44de-a309-b29e19e6dbd6 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:36.432454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1149/2269] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:36.455772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1121/2270] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:36 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:11:36.459821 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bb1c1-fcc1-44de-a309-b29e19e6dbd6 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:36.478985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bb1c1-fcc1-44de-a309-b29e19e6dbd6 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:36.619671 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b09a0-dc32-4d5e-a046-320248cf12e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:36.620333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b09a0-dc32-4d5e-a046-320248cf12e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:36.620613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b09a0-dc32-4d5e-a046-320248cf12e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:36.620887 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b09a0-dc32-4d5e-a046-320248cf12e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:36.621847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b09a0-dc32-4d5e-a046-320248cf12e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:36.623981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b09a0-dc32-4d5e-a046-320248cf12e2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:36.679999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1150/2271] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:36 2022] POST /identity/v3/users => generated 300 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:36.682099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaef2d-a925-4719-b0bc-f7d7cda4ff53 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:36.694822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaef2d-a925-4719-b0bc-f7d7cda4ff53 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:36.703886 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41b94b-f1a6-4e1b-8e6a-f133fbe65776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:36.704580 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41b94b-f1a6-4e1b-8e6a-f133fbe65776 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:36.704933 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41b94b-f1a6-4e1b-8e6a-f133fbe65776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:36.705276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41b94b-f1a6-4e1b-8e6a-f133fbe65776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:36.706017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41b94b-f1a6-4e1b-8e6a-f133fbe65776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:36.708162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41b94b-f1a6-4e1b-8e6a-f133fbe65776 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:36.722369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1122/2272] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:36.726849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b09a0-dc32-4d5e-a046-320248cf12e2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:36.742550 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b09a0-dc32-4d5e-a046-320248cf12e2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:36.754545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcd6de-724a-4e00-80db-9e88b2ff3c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:36.757356 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcd6de-724a-4e00-80db-9e88b2ff3c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:36.757727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcd6de-724a-4e00-80db-9e88b2ff3c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:36.758260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcd6de-724a-4e00-80db-9e88b2ff3c37 admin admin] PATH_INFO: `/v3/projects/7c81dccaf4ca4cb0a28e823b1c4df7f9/users/f05fb7b4e71243f68a99e7e5c46d1a92/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:36.811300 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcd6de-724a-4e00-80db-9e88b2ff3c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c81dccaf4ca4cb0a28e823b1c4df7f9, user_id=f05fb7b4e71243f68a99e7e5c46d1a92, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:36.817653 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcd6de-724a-4e00-80db-9e88b2ff3c37 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:36.872596 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1151/2273] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:36 2022] PUT /identity/v3/projects/7c81dccaf4ca4cb0a28e823b1c4df7f9/users/f05fb7b4e71243f68a99e7e5c46d1a92/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:36.873607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41b94b-f1a6-4e1b-8e6a-f133fbe65776 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:36.889222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41b94b-f1a6-4e1b-8e6a-f133fbe65776 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:37.106243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4094029-01a3-4090-a8e4-7443f815d7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:37.106901 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4094029-01a3-4090-a8e4-7443f815d7bc admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:37.107185 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4094029-01a3-4090-a8e4-7443f815d7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:37.107452 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4094029-01a3-4090-a8e4-7443f815d7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:37.108198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4094029-01a3-4090-a8e4-7443f815d7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:37.112245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4094029-01a3-4090-a8e4-7443f815d7bc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:37.151161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1123/2274] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:37.152413 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcd6de-724a-4e00-80db-9e88b2ff3c37 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:37.168088 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcd6de-724a-4e00-80db-9e88b2ff3c37 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:37.187541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97a527-d3c2-4964-a184-11a31bf9e7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:37.188457 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97a527-d3c2-4964-a184-11a31bf9e7bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:37.188837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97a527-d3c2-4964-a184-11a31bf9e7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:37.189337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97a527-d3c2-4964-a184-11a31bf9e7bb admin admin] PATH_INFO: `/v3/projects/7c81dccaf4ca4cb0a28e823b1c4df7f9/users/f05fb7b4e71243f68a99e7e5c46d1a92/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:37.194738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97a527-d3c2-4964-a184-11a31bf9e7bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c81dccaf4ca4cb0a28e823b1c4df7f9, user_id=f05fb7b4e71243f68a99e7e5c46d1a92, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:37.214402 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97a527-d3c2-4964-a184-11a31bf9e7bb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:37.249598 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1152/2275] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:37 2022] PUT /identity/v3/projects/7c81dccaf4ca4cb0a28e823b1c4df7f9/users/f05fb7b4e71243f68a99e7e5c46d1a92/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:37.260932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2253c-bdf7-4aae-9ee2-6a14383ae59a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:37.261279 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2253c-bdf7-4aae-9ee2-6a14383ae59a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:37.261560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2253c-bdf7-4aae-9ee2-6a14383ae59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:37.352432 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-faa2253c-bdf7-4aae-9ee2-6a14383ae59a None None] MFA Rules not processed for user `f05fb7b4e71243f68a99e7e5c46d1a92`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:37.353685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-faa2253c-bdf7-4aae-9ee2-6a14383ae59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:37.471220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1124/2276] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:37.491687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97a527-d3c2-4964-a184-11a31bf9e7bb admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:37.491687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fb97a527-d3c2-4964-a184-11a31bf9e7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:37.590063 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2253c-bdf7-4aae-9ee2-6a14383ae59a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:37.592566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-faa2253c-bdf7-4aae-9ee2-6a14383ae59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:37.611762 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:37.712337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:37.767442 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97a527-d3c2-4964-a184-11a31bf9e7bb admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:37.780622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd31ac-5ada-487b-8003-38b16e321f07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:37.781411 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd31ac-5ada-487b-8003-38b16e321f07 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:37.784417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd31ac-5ada-487b-8003-38b16e321f07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:37.784884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd31ac-5ada-487b-8003-38b16e321f07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:37.849274 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd31ac-5ada-487b-8003-38b16e321f07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:37.850921 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd31ac-5ada-487b-8003-38b16e321f07 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:37.866937 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2253c-bdf7-4aae-9ee2-6a14383ae59a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:37.911765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b7465-5831-446e-b994-8c98001bd8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:37.926726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b7465-5831-446e-b994-8c98001bd8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:37.927233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b7465-5831-446e-b994-8c98001bd8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:37.928505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b7465-5831-446e-b994-8c98001bd8d1 admin admin] PATH_INFO: `/v3/projects/24ace8aa6491418f83fbd70c26cc948d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:37.934241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1153/2277] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:37.956337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b7465-5831-446e-b994-8c98001bd8d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24ace8aa6491418f83fbd70c26cc948d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:37.976049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b7465-5831-446e-b994-8c98001bd8d1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:38.134047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-991b7465-5831-446e-b994-8c98001bd8d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ace8aa6491418f83fbd70c26cc948d', 'request_id': 'req-991b7465-5831-446e-b994-8c98001bd8d1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:38.141117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-991b7465-5831-446e-b994-8c98001bd8d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ace8aa6491418f83fbd70c26cc948d', 'request_id': 'req-991b7465-5831-446e-b994-8c98001bd8d1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:38.150923 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-991b7465-5831-446e-b994-8c98001bd8d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ace8aa6491418f83fbd70c26cc948d', 'request_id': 'req-991b7465-5831-446e-b994-8c98001bd8d1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:38.184635 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-991b7465-5831-446e-b994-8c98001bd8d1 admin admin] The token cache is being invalidate because project 24ace8aa6491418f83fbd70c26cc948d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:38.184914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-991b7465-5831-446e-b994-8c98001bd8d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:38.187777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-991b7465-5831-446e-b994-8c98001bd8d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:38.192653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1125/2278] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:37 2022] DELETE /identity/v3/projects/24ace8aa6491418f83fbd70c26cc948d => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:38.197963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3461401-16c6-4175-9922-840561651593 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:38.198253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3461401-16c6-4175-9922-840561651593 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:38.198525 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3461401-16c6-4175-9922-840561651593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:38.276818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d3461401-16c6-4175-9922-840561651593 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:38.280794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d3461401-16c6-4175-9922-840561651593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:38.414500 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1154/2279] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:38.422965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c6e05-f78f-4544-bb74-d5cadfb28083 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:38.423261 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c6e05-f78f-4544-bb74-d5cadfb28083 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:38.423511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c6e05-f78f-4544-bb74-d5cadfb28083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:38.468545 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3a0c6e05-f78f-4544-bb74-d5cadfb28083 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:38.469788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3a0c6e05-f78f-4544-bb74-d5cadfb28083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:38.496620 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1126/2280] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:38.501481 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3461401-16c6-4175-9922-840561651593 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:38.514355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3461401-16c6-4175-9922-840561651593 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:38.532826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f2e21-478f-4fc6-84a4-6842908d3b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:38.532826 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f2e21-478f-4fc6-84a4-6842908d3b1e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:38.533160 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f2e21-478f-4fc6-84a4-6842908d3b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:38.533246 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f2e21-478f-4fc6-84a4-6842908d3b1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:38.533849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f2e21-478f-4fc6-84a4-6842908d3b1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:11:38.534155 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f2e21-478f-4fc6-84a4-6842908d3b1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:38.535779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f2e21-478f-4fc6-84a4-6842908d3b1e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:38.577517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1155/2281] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:11:38.581981 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c6e05-f78f-4544-bb74-d5cadfb28083 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:38.599073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c6e05-f78f-4544-bb74-d5cadfb28083 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:38.620743 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6605b4a-8f52-4492-ba3c-c6105c47ee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:38.621365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6605b4a-8f52-4492-ba3c-c6105c47ee6f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:38.621879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6605b4a-8f52-4492-ba3c-c6105c47ee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:38.622157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6605b4a-8f52-4492-ba3c-c6105c47ee6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:38.622966 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6605b4a-8f52-4492-ba3c-c6105c47ee6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:38.633024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6605b4a-8f52-4492-ba3c-c6105c47ee6f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:38.714940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1127/2282] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:38 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:38.718339 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f2e21-478f-4fc6-84a4-6842908d3b1e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:38.741208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f2e21-478f-4fc6-84a4-6842908d3b1e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:38.931148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683dd6c8-50df-4861-b4c3-78aa9322c5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:38.932150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dd6c8-50df-4861-b4c3-78aa9322c5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:38.932489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dd6c8-50df-4861-b4c3-78aa9322c5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:38.932752 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dd6c8-50df-4861-b4c3-78aa9322c5f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:38.933584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683dd6c8-50df-4861-b4c3-78aa9322c5f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:38.938351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683dd6c8-50df-4861-b4c3-78aa9322c5f8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:39.053000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1156/2283] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:38 2022] POST /identity/v3/users => generated 288 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:39.053756 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6605b4a-8f52-4492-ba3c-c6105c47ee6f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:39.072380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6605b4a-8f52-4492-ba3c-c6105c47ee6f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:39.084642 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f173bd6-e0bd-4557-be70-1cec2d3a1a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:39.085547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f173bd6-e0bd-4557-be70-1cec2d3a1a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:39.085982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f173bd6-e0bd-4557-be70-1cec2d3a1a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:39.086404 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f173bd6-e0bd-4557-be70-1cec2d3a1a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:39.096488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f173bd6-e0bd-4557-be70-1cec2d3a1a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:39.098854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f173bd6-e0bd-4557-be70-1cec2d3a1a65 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:39.123097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1128/2284] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:11:39.126565 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683dd6c8-50df-4861-b4c3-78aa9322c5f8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:39.140884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683dd6c8-50df-4861-b4c3-78aa9322c5f8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:39.164699 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783898b-d847-4f24-abf8-69beae635102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:39.165933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783898b-d847-4f24-abf8-69beae635102 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:39.167122 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783898b-d847-4f24-abf8-69beae635102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:39.169091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783898b-d847-4f24-abf8-69beae635102 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:39.171706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783898b-d847-4f24-abf8-69beae635102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:39.181370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783898b-d847-4f24-abf8-69beae635102 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:39.214092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1157/2285] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:39.219748 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f173bd6-e0bd-4557-be70-1cec2d3a1a65 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:39.241101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f173bd6-e0bd-4557-be70-1cec2d3a1a65 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:39.252144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24731cb4-3ff5-43ca-a06d-c411922afe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:39.253376 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24731cb4-3ff5-43ca-a06d-c411922afe73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:39.253898 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24731cb4-3ff5-43ca-a06d-c411922afe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:39.256773 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24731cb4-3ff5-43ca-a06d-c411922afe73 admin admin] PATH_INFO: `/v3/projects/608d237be5fa49f0baf61ee81e5b50d9/users/48d2b54ed7184b35b8d624ab3ff35008/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:39.331024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24731cb4-3ff5-43ca-a06d-c411922afe73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=608d237be5fa49f0baf61ee81e5b50d9, user_id=48d2b54ed7184b35b8d624ab3ff35008, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:39.343193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24731cb4-3ff5-43ca-a06d-c411922afe73 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:39.390777 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783898b-d847-4f24-abf8-69beae635102 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:39.393022 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0783898b-d847-4f24-abf8-69beae635102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:39.402911 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1129/2286] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:39 2022] PUT /identity/v3/projects/608d237be5fa49f0baf61ee81e5b50d9/users/48d2b54ed7184b35b8d624ab3ff35008/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:39.413817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cc1f9-26c7-49ad-90dc-31f924904c81 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:39.414247 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cc1f9-26c7-49ad-90dc-31f924904c81 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:39.414783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cc1f9-26c7-49ad-90dc-31f924904c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:39.519362 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-286cc1f9-26c7-49ad-90dc-31f924904c81 None None] MFA Rules not processed for user `48d2b54ed7184b35b8d624ab3ff35008`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:39.521547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-286cc1f9-26c7-49ad-90dc-31f924904c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:39.526347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:39.570956 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783898b-d847-4f24-abf8-69beae635102 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:39.699940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:39.749721 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1130/2287] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:39.751620 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5d9fd-b304-4e6c-90df-55ce99ac8eb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:39.754813 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cc1f9-26c7-49ad-90dc-31f924904c81 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:39.755732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d9fd-b304-4e6c-90df-55ce99ac8eb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:39.756704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d9fd-b304-4e6c-90df-55ce99ac8eb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:39.758095 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d9fd-b304-4e6c-90df-55ce99ac8eb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:39.765527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-60f5d9fd-b304-4e6c-90df-55ce99ac8eb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:39.984666 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5d9fd-b304-4e6c-90df-55ce99ac8eb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:39.986370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5d9fd-b304-4e6c-90df-55ce99ac8eb2 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:39.987714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cc1f9-26c7-49ad-90dc-31f924904c81 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:39.998148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5288b-8691-4dda-b691-1a7b4bc3239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:40.001594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5288b-8691-4dda-b691-1a7b4bc3239c admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:40.003273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5288b-8691-4dda-b691-1a7b4bc3239c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:40.003508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5288b-8691-4dda-b691-1a7b4bc3239c admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:40.004210 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5288b-8691-4dda-b691-1a7b4bc3239c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:40.009576 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5288b-8691-4dda-b691-1a7b4bc3239c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:40.013935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1158/2288] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:11:40.082959 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1131/2289] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:39 2022] POST /identity/v3/projects => generated 373 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:40.087115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5d9fd-b304-4e6c-90df-55ce99ac8eb2 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:40.104952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5d9fd-b304-4e6c-90df-55ce99ac8eb2 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:40.266032 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8960d-7384-4a72-ba82-76100f076764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:40.272076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8960d-7384-4a72-ba82-76100f076764 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:40.272076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8960d-7384-4a72-ba82-76100f076764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:40.276578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8960d-7384-4a72-ba82-76100f076764 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:40.281775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8960d-7384-4a72-ba82-76100f076764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:40.287232 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8960d-7384-4a72-ba82-76100f076764 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:40.348051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1159/2290] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:40 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:40.349654 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5288b-8691-4dda-b691-1a7b4bc3239c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:40.365559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5288b-8691-4dda-b691-1a7b4bc3239c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:40.377986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f4d2c-7330-41de-b24a-588060e30222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:40.380337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f4d2c-7330-41de-b24a-588060e30222 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:40.380698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f4d2c-7330-41de-b24a-588060e30222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:40.381635 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f4d2c-7330-41de-b24a-588060e30222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:40.384371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f4d2c-7330-41de-b24a-588060e30222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:40.388934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f4d2c-7330-41de-b24a-588060e30222 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:40.409369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1132/2291] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:40.412040 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8960d-7384-4a72-ba82-76100f076764 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:40.438082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8960d-7384-4a72-ba82-76100f076764 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:40.569973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae6cfe-2d79-44e8-9d3f-9fa31d7201ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:40.570785 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6cfe-2d79-44e8-9d3f-9fa31d7201ca admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:40.571177 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6cfe-2d79-44e8-9d3f-9fa31d7201ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:40.571513 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6cfe-2d79-44e8-9d3f-9fa31d7201ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:40.572371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae6cfe-2d79-44e8-9d3f-9fa31d7201ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:40.574107 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae6cfe-2d79-44e8-9d3f-9fa31d7201ca admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:40.595104 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1160/2292] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:40.605227 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f4d2c-7330-41de-b24a-588060e30222 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:40.625188 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f4d2c-7330-41de-b24a-588060e30222 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:40.633964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1c357-3f87-4a8b-9b3d-17c20e75f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:40.634778 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1c357-3f87-4a8b-9b3d-17c20e75f7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:40.635135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1c357-3f87-4a8b-9b3d-17c20e75f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:40.635514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1c357-3f87-4a8b-9b3d-17c20e75f7b0 admin admin] PATH_INFO: `/v3/projects/ba29555baeed436690ff66b5227323da/users/725a127a475147b79a8b93c040c7b8dd/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:40.670459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1c357-3f87-4a8b-9b3d-17c20e75f7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba29555baeed436690ff66b5227323da, user_id=725a127a475147b79a8b93c040c7b8dd, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:40.673826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1c357-3f87-4a8b-9b3d-17c20e75f7b0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:40.742065 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1133/2293] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:40 2022] PUT /identity/v3/projects/ba29555baeed436690ff66b5227323da/users/725a127a475147b79a8b93c040c7b8dd/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:40.761651 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c55c8-7807-472e-86ad-67e4c49f1c7d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:40.762412 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c55c8-7807-472e-86ad-67e4c49f1c7d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:40.763477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c55c8-7807-472e-86ad-67e4c49f1c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:40.822573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-da9c55c8-7807-472e-86ad-67e4c49f1c7d None None] MFA Rules not processed for user `725a127a475147b79a8b93c040c7b8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:40.837702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-da9c55c8-7807-472e-86ad-67e4c49f1c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:40.878693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:41.082452 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1161/2294] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:41.086543 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1c357-3f87-4a8b-9b3d-17c20e75f7b0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:41.269886 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1c357-3f87-4a8b-9b3d-17c20e75f7b0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:41.289652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8df58-8709-42d9-9b31-76ece993ff5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:41.292808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8df58-8709-42d9-9b31-76ece993ff5f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:41.294870 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8df58-8709-42d9-9b31-76ece993ff5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:41.296156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8df58-8709-42d9-9b31-76ece993ff5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:41.298448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8df58-8709-42d9-9b31-76ece993ff5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:41.307830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8df58-8709-42d9-9b31-76ece993ff5f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:41.403187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1134/2295] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:41 2022] POST /identity/v3/projects => generated 377 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:41.403780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c55c8-7807-472e-86ad-67e4c49f1c7d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:41.421537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c55c8-7807-472e-86ad-67e4c49f1c7d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:41.591032 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd982ebf-114f-4766-a3de-0db9e3121d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:41.591661 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd982ebf-114f-4766-a3de-0db9e3121d0c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:41.591967 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd982ebf-114f-4766-a3de-0db9e3121d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:41.592341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd982ebf-114f-4766-a3de-0db9e3121d0c admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:41.593168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd982ebf-114f-4766-a3de-0db9e3121d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:41.595536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd982ebf-114f-4766-a3de-0db9e3121d0c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:41.664512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1162/2296] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:41 2022] POST /identity/v3/users => generated 295 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:11:41.671110 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8df58-8709-42d9-9b31-76ece993ff5f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:41.685779 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8df58-8709-42d9-9b31-76ece993ff5f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:41.711543 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79760bee-732c-46f7-9232-eaf29598630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:41.716245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79760bee-732c-46f7-9232-eaf29598630f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:41.716647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79760bee-732c-46f7-9232-eaf29598630f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:41.717023 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79760bee-732c-46f7-9232-eaf29598630f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:41.719708 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79760bee-732c-46f7-9232-eaf29598630f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:41.725219 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79760bee-732c-46f7-9232-eaf29598630f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:41.762804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1135/2297] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:41.764853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd982ebf-114f-4766-a3de-0db9e3121d0c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:41.781774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd982ebf-114f-4766-a3de-0db9e3121d0c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:41.800363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be958034-306d-4af5-9112-4f5566edd62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:41.801303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be958034-306d-4af5-9112-4f5566edd62b admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:41.801841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be958034-306d-4af5-9112-4f5566edd62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:41.802310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be958034-306d-4af5-9112-4f5566edd62b admin admin] PATH_INFO: `/v3/projects/61293ad318094d7a9b3ffefe470e43c0/users/c1797263332745dfaaa6dec8e85ae708/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:41.847303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be958034-306d-4af5-9112-4f5566edd62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=61293ad318094d7a9b3ffefe470e43c0, user_id=c1797263332745dfaaa6dec8e85ae708, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:41.856310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be958034-306d-4af5-9112-4f5566edd62b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:41.891936 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1163/2298] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:41 2022] PUT /identity/v3/projects/61293ad318094d7a9b3ffefe470e43c0/users/c1797263332745dfaaa6dec8e85ae708/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:11:41.895803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79760bee-732c-46f7-9232-eaf29598630f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:41.910041 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79760bee-732c-46f7-9232-eaf29598630f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:41.937438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:42.101859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19189eb0-963c-4b7e-87d5-cfff22ca5f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:42.104192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19189eb0-963c-4b7e-87d5-cfff22ca5f19 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:42.105963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19189eb0-963c-4b7e-87d5-cfff22ca5f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:42.106350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19189eb0-963c-4b7e-87d5-cfff22ca5f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:42.107124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19189eb0-963c-4b7e-87d5-cfff22ca5f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:42.112745 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19189eb0-963c-4b7e-87d5-cfff22ca5f19 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:42.140032 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1136/2299] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:42.141825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be958034-306d-4af5-9112-4f5566edd62b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:42.158092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be958034-306d-4af5-9112-4f5566edd62b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:42.182866 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f4918-99a5-4de1-b8a9-367134383136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:42.188415 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f4918-99a5-4de1-b8a9-367134383136 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:42.188877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f4918-99a5-4de1-b8a9-367134383136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:42.190168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f4918-99a5-4de1-b8a9-367134383136 admin admin] PATH_INFO: `/v3/projects/61293ad318094d7a9b3ffefe470e43c0/users/c1797263332745dfaaa6dec8e85ae708/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:42.193933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f4918-99a5-4de1-b8a9-367134383136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61293ad318094d7a9b3ffefe470e43c0, user_id=c1797263332745dfaaa6dec8e85ae708, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:42.202559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f4918-99a5-4de1-b8a9-367134383136 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:42.245292 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1164/2300] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:42 2022] PUT /identity/v3/projects/61293ad318094d7a9b3ffefe470e43c0/users/c1797263332745dfaaa6dec8e85ae708/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:11:42.246601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd5cb6-1932-4f58-ae4f-898c72a78b79 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:42.247460 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd5cb6-1932-4f58-ae4f-898c72a78b79 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:42.247965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd5cb6-1932-4f58-ae4f-898c72a78b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:42.298343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6bcd5cb6-1932-4f58-ae4f-898c72a78b79 None None] MFA Rules not processed for user `c1797263332745dfaaa6dec8e85ae708`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:42.300033 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6bcd5cb6-1932-4f58-ae4f-898c72a78b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:42.480648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1137/2301] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:42.493693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f4918-99a5-4de1-b8a9-367134383136 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:42.629004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f4918-99a5-4de1-b8a9-367134383136 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:42.639047 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959cf77-7564-4953-b418-0a4c599a27ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:42.644782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959cf77-7564-4953-b418-0a4c599a27ac service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:42.645281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959cf77-7564-4953-b418-0a4c599a27ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:42.645725 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959cf77-7564-4953-b418-0a4c599a27ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:42.705862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:42.803189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959cf77-7564-4953-b418-0a4c599a27ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:42.804701 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959cf77-7564-4953-b418-0a4c599a27ac service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:42.833599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1165/2302] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:44.970338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd5cb6-1932-4f58-ae4f-898c72a78b79 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:45.017079 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd5cb6-1932-4f58-ae4f-898c72a78b79 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:45.026395 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37484c0e-0cc8-4ffd-99b3-a43040d6eb59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:45.044413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37484c0e-0cc8-4ffd-99b3-a43040d6eb59 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:45.044413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37484c0e-0cc8-4ffd-99b3-a43040d6eb59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:45.044413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37484c0e-0cc8-4ffd-99b3-a43040d6eb59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:45.229586 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37484c0e-0cc8-4ffd-99b3-a43040d6eb59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:45.232133 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37484c0e-0cc8-4ffd-99b3-a43040d6eb59 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:45.251606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1138/2303] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:45.370604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959cf77-7564-4953-b418-0a4c599a27ac service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:45.372619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c959cf77-7564-4953-b418-0a4c599a27ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:45.396827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959cf77-7564-4953-b418-0a4c599a27ac service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:45.406462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa998500-d035-4f6a-8267-c7e7ae2be90c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:45.407190 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa998500-d035-4f6a-8267-c7e7ae2be90c service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:45.409581 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa998500-d035-4f6a-8267-c7e7ae2be90c service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:45.409976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa998500-d035-4f6a-8267-c7e7ae2be90c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:45.413305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-aa998500-d035-4f6a-8267-c7e7ae2be90c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:45.516867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa998500-d035-4f6a-8267-c7e7ae2be90c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:45.518617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa998500-d035-4f6a-8267-c7e7ae2be90c service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:45.544463 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1166/2304] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:46.337210 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37484c0e-0cc8-4ffd-99b3-a43040d6eb59 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:46.351864 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37484c0e-0cc8-4ffd-99b3-a43040d6eb59 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:46.366950 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64d9f1-6909-427b-9bd6-ead14b68127f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:46.368922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64d9f1-6909-427b-9bd6-ead14b68127f service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:46.371780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64d9f1-6909-427b-9bd6-ead14b68127f service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:46.372917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64d9f1-6909-427b-9bd6-ead14b68127f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:46.409601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64d9f1-6909-427b-9bd6-ead14b68127f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:46.414097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64d9f1-6909-427b-9bd6-ead14b68127f service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:46.444759 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1139/2305] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:48.832539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa998500-d035-4f6a-8267-c7e7ae2be90c service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:48.839262 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-aa998500-d035-4f6a-8267-c7e7ae2be90c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:49.027589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa998500-d035-4f6a-8267-c7e7ae2be90c service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:49.033028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f762776-e035-4f6c-a52e-d4f043133d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:49.039305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f762776-e035-4f6c-a52e-d4f043133d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:49.039305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f762776-e035-4f6c-a52e-d4f043133d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:49.039305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f762776-e035-4f6c-a52e-d4f043133d93 admin admin] PATH_INFO: `/v3/users/40ddc0b4b2544d549240a301f867d7af` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:49.039305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f762776-e035-4f6c-a52e-d4f043133d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ddc0b4b2544d549240a301f867d7af)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:49.039305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f762776-e035-4f6c-a52e-d4f043133d93 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:49.144964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4f762776-e035-4f6c-a52e-d4f043133d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ddc0b4b2544d549240a301f867d7af'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:49.153382 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4f762776-e035-4f6c-a52e-d4f043133d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ddc0b4b2544d549240a301f867d7af'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:49.160419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:49.163433 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4f762776-e035-4f6c-a52e-d4f043133d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ddc0b4b2544d549240a301f867d7af'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:49.164477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4f762776-e035-4f6c-a52e-d4f043133d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ddc0b4b2544d549240a301f867d7af'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:49.189577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4f762776-e035-4f6c-a52e-d4f043133d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ddc0b4b2544d549240a301f867d7af'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:49.208264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1167/2306] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:48 2022] DELETE /identity/v3/users/40ddc0b4b2544d549240a301f867d7af => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:49.212346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbb08e-0811-49c6-8ee0-19f181130daa None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:49.212879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbb08e-0811-49c6-8ee0-19f181130daa None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:49.212879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbb08e-0811-49c6-8ee0-19f181130daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:49.251513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-40dbb08e-0811-49c6-8ee0-19f181130daa None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:49.253559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-40dbb08e-0811-49c6-8ee0-19f181130daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:49.304529 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:49.411882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1140/2307] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:49.422933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f762776-e035-4f6c-a52e-d4f043133d93 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:49.424650 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4f762776-e035-4f6c-a52e-d4f043133d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:49.614372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f762776-e035-4f6c-a52e-d4f043133d93 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:49.619210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500794da-c26c-4a99-acd0-1cc389f6cedf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:49.620094 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500794da-c26c-4a99-acd0-1cc389f6cedf service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:49.620434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500794da-c26c-4a99-acd0-1cc389f6cedf service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:49.620764 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500794da-c26c-4a99-acd0-1cc389f6cedf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:49.640186 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500794da-c26c-4a99-acd0-1cc389f6cedf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:49.642229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500794da-c26c-4a99-acd0-1cc389f6cedf service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:49.661006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1168/2308] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:50.374841 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbb08e-0811-49c6-8ee0-19f181130daa None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:50.377133 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-40dbb08e-0811-49c6-8ee0-19f181130daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:50.401582 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbb08e-0811-49c6-8ee0-19f181130daa None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:50.446538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903f204-8f75-401d-aa75-a4010e812c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:50.448441 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903f204-8f75-401d-aa75-a4010e812c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:50.461825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903f204-8f75-401d-aa75-a4010e812c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:50.462846 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903f204-8f75-401d-aa75-a4010e812c00 admin admin] PATH_INFO: `/v3/projects/6cd7a64dcbe94c2c8aa42c2dc82e9f97` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:50.464906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903f204-8f75-401d-aa75-a4010e812c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd7a64dcbe94c2c8aa42c2dc82e9f97)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:50.469254 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903f204-8f75-401d-aa75-a4010e812c00 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:50.578505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9903f204-8f75-401d-aa75-a4010e812c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd7a64dcbe94c2c8aa42c2dc82e9f97', 'request_id': 'req-9903f204-8f75-401d-aa75-a4010e812c00'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:50.604109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9903f204-8f75-401d-aa75-a4010e812c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd7a64dcbe94c2c8aa42c2dc82e9f97', 'request_id': 'req-9903f204-8f75-401d-aa75-a4010e812c00'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:50.624139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9903f204-8f75-401d-aa75-a4010e812c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd7a64dcbe94c2c8aa42c2dc82e9f97', 'request_id': 'req-9903f204-8f75-401d-aa75-a4010e812c00'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:50.650746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9903f204-8f75-401d-aa75-a4010e812c00 admin admin] The token cache is being invalidate because project 6cd7a64dcbe94c2c8aa42c2dc82e9f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:50.651051 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9903f204-8f75-401d-aa75-a4010e812c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:50.653051 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9903f204-8f75-401d-aa75-a4010e812c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:50.656398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1141/2309] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:50 2022] DELETE /identity/v3/projects/6cd7a64dcbe94c2c8aa42c2dc82e9f97 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:50.665138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500794da-c26c-4a99-acd0-1cc389f6cedf service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:50.683661 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500794da-c26c-4a99-acd0-1cc389f6cedf service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:50.768867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c65cfa-a55f-4939-9600-0945a0ef4042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:50.769512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c65cfa-a55f-4939-9600-0945a0ef4042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:50.769790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c65cfa-a55f-4939-9600-0945a0ef4042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:50.770062 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c65cfa-a55f-4939-9600-0945a0ef4042 admin admin] PATH_INFO: `/v3/users/e2bcbcf4df2f44908b55271c0ca87a2a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:50.771658 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c65cfa-a55f-4939-9600-0945a0ef4042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2bcbcf4df2f44908b55271c0ca87a2a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:50.774926 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c65cfa-a55f-4939-9600-0945a0ef4042 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:50.860400 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c8c65cfa-a55f-4939-9600-0945a0ef4042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2bcbcf4df2f44908b55271c0ca87a2a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:50.871451 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c8c65cfa-a55f-4939-9600-0945a0ef4042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2bcbcf4df2f44908b55271c0ca87a2a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:50.882210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c8c65cfa-a55f-4939-9600-0945a0ef4042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2bcbcf4df2f44908b55271c0ca87a2a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:50.883207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c8c65cfa-a55f-4939-9600-0945a0ef4042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2bcbcf4df2f44908b55271c0ca87a2a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:50.900591 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c8c65cfa-a55f-4939-9600-0945a0ef4042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2bcbcf4df2f44908b55271c0ca87a2a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:50.905976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:50.919182 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1169/2310] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:50 2022] DELETE /identity/v3/users/e2bcbcf4df2f44908b55271c0ca87a2a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:50.934370 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641765b-8e70-4181-82e6-3a0012ad4f86 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:50.934662 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641765b-8e70-4181-82e6-3a0012ad4f86 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:50.934924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641765b-8e70-4181-82e6-3a0012ad4f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:50.957029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6641765b-8e70-4181-82e6-3a0012ad4f86 None None] MFA Rules not processed for user `d6ba100ea236427ba6e6466bb2c358fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:50.958253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6641765b-8e70-4181-82e6-3a0012ad4f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:51.070164 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1142/2311] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:51.363673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c65cfa-a55f-4939-9600-0945a0ef4042 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:51.365258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c8c65cfa-a55f-4939-9600-0945a0ef4042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:51.487335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c65cfa-a55f-4939-9600-0945a0ef4042 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:51.493235 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c3da2-b422-40a9-9408-504fd0ad2d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:51.493900 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c3da2-b422-40a9-9408-504fd0ad2d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:51.494177 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c3da2-b422-40a9-9408-504fd0ad2d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:51.494449 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c3da2-b422-40a9-9408-504fd0ad2d8b admin admin] PATH_INFO: `/v3/users/48d2b54ed7184b35b8d624ab3ff35008` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:51.495597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c3da2-b422-40a9-9408-504fd0ad2d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d2b54ed7184b35b8d624ab3ff35008)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:51.497931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c3da2-b422-40a9-9408-504fd0ad2d8b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:51.592503 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-841c3da2-b422-40a9-9408-504fd0ad2d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d2b54ed7184b35b8d624ab3ff35008'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:51.609667 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-841c3da2-b422-40a9-9408-504fd0ad2d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d2b54ed7184b35b8d624ab3ff35008'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:51.632497 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-841c3da2-b422-40a9-9408-504fd0ad2d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d2b54ed7184b35b8d624ab3ff35008'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:51.633394 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-841c3da2-b422-40a9-9408-504fd0ad2d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d2b54ed7184b35b8d624ab3ff35008'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:51.659781 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-841c3da2-b422-40a9-9408-504fd0ad2d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d2b54ed7184b35b8d624ab3ff35008'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:51.677159 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df083-3590-4735-86e4-78b45e34e41e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:51.677624 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df083-3590-4735-86e4-78b45e34e41e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:51.677714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df083-3590-4735-86e4-78b45e34e41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:51.680981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1170/2312] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:51 2022] DELETE /identity/v3/users/48d2b54ed7184b35b8d624ab3ff35008 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:51.686722 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c3da2-b422-40a9-9408-504fd0ad2d8b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:51.691618 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-841c3da2-b422-40a9-9408-504fd0ad2d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:51.700818 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e24df083-3590-4735-86e4-78b45e34e41e None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:51.702463 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e24df083-3590-4735-86e4-78b45e34e41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:51.757859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:51.778509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c3da2-b422-40a9-9408-504fd0ad2d8b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:51.790186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1143/2313] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:51.797996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9d713-031d-4765-9927-8b95a06cf7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:51.798786 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d713-031d-4765-9927-8b95a06cf7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:51.798922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24df083-3590-4735-86e4-78b45e34e41e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:51.799256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d713-031d-4765-9927-8b95a06cf7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:51.799622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d713-031d-4765-9927-8b95a06cf7dd admin admin] PATH_INFO: `/v3/projects/55bf714ca30d4a899ac83c50f7f2876e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:51.800938 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9d713-031d-4765-9927-8b95a06cf7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=55bf714ca30d4a899ac83c50f7f2876e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:51.802305 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e24df083-3590-4735-86e4-78b45e34e41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:51.803312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9d713-031d-4765-9927-8b95a06cf7dd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:51.830473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:51.867817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-36a9d713-031d-4765-9927-8b95a06cf7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55bf714ca30d4a899ac83c50f7f2876e', 'request_id': 'req-36a9d713-031d-4765-9927-8b95a06cf7dd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:51.881258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-36a9d713-031d-4765-9927-8b95a06cf7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55bf714ca30d4a899ac83c50f7f2876e', 'request_id': 'req-36a9d713-031d-4765-9927-8b95a06cf7dd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:51.904916 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-36a9d713-031d-4765-9927-8b95a06cf7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55bf714ca30d4a899ac83c50f7f2876e', 'request_id': 'req-36a9d713-031d-4765-9927-8b95a06cf7dd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:51.923602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24df083-3590-4735-86e4-78b45e34e41e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:51.957112 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-36a9d713-031d-4765-9927-8b95a06cf7dd admin admin] The token cache is being invalidate because project 55bf714ca30d4a899ac83c50f7f2876e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:51.957506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-36a9d713-031d-4765-9927-8b95a06cf7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:51.959061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-36a9d713-031d-4765-9927-8b95a06cf7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:51.965854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1171/2314] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:51 2022] DELETE /identity/v3/projects/55bf714ca30d4a899ac83c50f7f2876e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:51.971503 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9d713-031d-4765-9927-8b95a06cf7dd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:51.975002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-36a9d713-031d-4765-9927-8b95a06cf7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:52.101283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedc749-e9be-490a-bf1e-01f9643ebdf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:52.102416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedc749-e9be-490a-bf1e-01f9643ebdf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:52.103004 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedc749-e9be-490a-bf1e-01f9643ebdf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:52.103499 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedc749-e9be-490a-bf1e-01f9643ebdf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:52.110939 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ecedc749-e9be-490a-bf1e-01f9643ebdf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:52.147920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9d713-031d-4765-9927-8b95a06cf7dd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:52.155146 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6867fd8-a78c-4ff3-858c-c77b259467e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:52.155798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6867fd8-a78c-4ff3-858c-c77b259467e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:52.156184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6867fd8-a78c-4ff3-858c-c77b259467e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:52.156459 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6867fd8-a78c-4ff3-858c-c77b259467e1 admin admin] PATH_INFO: `/v3/users/f05fb7b4e71243f68a99e7e5c46d1a92` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:52.157621 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6867fd8-a78c-4ff3-858c-c77b259467e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f05fb7b4e71243f68a99e7e5c46d1a92)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:52.159621 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6867fd8-a78c-4ff3-858c-c77b259467e1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:52.244389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c6867fd8-a78c-4ff3-858c-c77b259467e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f05fb7b4e71243f68a99e7e5c46d1a92'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:52.253728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c6867fd8-a78c-4ff3-858c-c77b259467e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f05fb7b4e71243f68a99e7e5c46d1a92'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:52.257797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedc749-e9be-490a-bf1e-01f9643ebdf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:52.261315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedc749-e9be-490a-bf1e-01f9643ebdf3 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:52.267790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c6867fd8-a78c-4ff3-858c-c77b259467e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f05fb7b4e71243f68a99e7e5c46d1a92'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:52.270084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c6867fd8-a78c-4ff3-858c-c77b259467e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f05fb7b4e71243f68a99e7e5c46d1a92'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:52.287736 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c6867fd8-a78c-4ff3-858c-c77b259467e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f05fb7b4e71243f68a99e7e5c46d1a92'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:52.291353 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1144/2315] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:52.293412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f006-dbe5-4770-a084-a4d1f543b22f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:52.293836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f006-dbe5-4770-a084-a4d1f543b22f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:52.294131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f006-dbe5-4770-a084-a4d1f543b22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:52.301914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1172/2316] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:51 2022] DELETE /identity/v3/users/f05fb7b4e71243f68a99e7e5c46d1a92 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:52.334707 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-37c6f006-dbe5-4770-a084-a4d1f543b22f None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:52.336854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-37c6f006-dbe5-4770-a084-a4d1f543b22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:52.489340 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:52.506346 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1145/2317] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Aug 30 05:11:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:52.526381 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6867fd8-a78c-4ff3-858c-c77b259467e1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:52.528436 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c6867fd8-a78c-4ff3-858c-c77b259467e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:52.620475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:52.712832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6867fd8-a78c-4ff3-858c-c77b259467e1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:52.728845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947fa4a-59a3-4fa8-8193-18bdd29406e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:52.729526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947fa4a-59a3-4fa8-8193-18bdd29406e7 service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:52.729880 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947fa4a-59a3-4fa8-8193-18bdd29406e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:52.730557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947fa4a-59a3-4fa8-8193-18bdd29406e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:52.743151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947fa4a-59a3-4fa8-8193-18bdd29406e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:52.744759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947fa4a-59a3-4fa8-8193-18bdd29406e7 service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:52.765971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1173/2318] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:11:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:11:52.860934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6f006-dbe5-4770-a084-a4d1f543b22f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:52.862799 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-37c6f006-dbe5-4770-a084-a4d1f543b22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:53.040385 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6f006-dbe5-4770-a084-a4d1f543b22f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:53.063102 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fee11-3134-43bf-b644-a5394686d5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:53.063791 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fee11-3134-43bf-b644-a5394686d5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:53.064656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fee11-3134-43bf-b644-a5394686d5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:53.064656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fee11-3134-43bf-b644-a5394686d5f7 admin admin] PATH_INFO: `/v3/projects/608d237be5fa49f0baf61ee81e5b50d9` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:53.065857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fee11-3134-43bf-b644-a5394686d5f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=608d237be5fa49f0baf61ee81e5b50d9)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:53.067831 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fee11-3134-43bf-b644-a5394686d5f7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:53.224170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-428fee11-3134-43bf-b644-a5394686d5f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608d237be5fa49f0baf61ee81e5b50d9', 'request_id': 'req-428fee11-3134-43bf-b644-a5394686d5f7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:53.234298 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-428fee11-3134-43bf-b644-a5394686d5f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608d237be5fa49f0baf61ee81e5b50d9', 'request_id': 'req-428fee11-3134-43bf-b644-a5394686d5f7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:53.252462 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-428fee11-3134-43bf-b644-a5394686d5f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608d237be5fa49f0baf61ee81e5b50d9', 'request_id': 'req-428fee11-3134-43bf-b644-a5394686d5f7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:53.286436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-428fee11-3134-43bf-b644-a5394686d5f7 admin admin] The token cache is being invalidate because project 608d237be5fa49f0baf61ee81e5b50d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:53.289924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-428fee11-3134-43bf-b644-a5394686d5f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:53.292430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-428fee11-3134-43bf-b644-a5394686d5f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:53.294509 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1146/2319] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:52 2022] DELETE /identity/v3/projects/608d237be5fa49f0baf61ee81e5b50d9 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:53.299339 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947fa4a-59a3-4fa8-8193-18bdd29406e7 service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:53.320032 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947fa4a-59a3-4fa8-8193-18bdd29406e7 service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:53.412440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fee11-3134-43bf-b644-a5394686d5f7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:53.413989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-428fee11-3134-43bf-b644-a5394686d5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:53.587429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ca961-a2d9-43ed-9b79-916ae54f4256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:53.589694 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ca961-a2d9-43ed-9b79-916ae54f4256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:53.590436 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ca961-a2d9-43ed-9b79-916ae54f4256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:53.594029 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ca961-a2d9-43ed-9b79-916ae54f4256 admin admin] PATH_INFO: `/v3/users/725a127a475147b79a8b93c040c7b8dd` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:53.596785 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ca961-a2d9-43ed-9b79-916ae54f4256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=725a127a475147b79a8b93c040c7b8dd)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:53.604122 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ca961-a2d9-43ed-9b79-916ae54f4256 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:53.694192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fee11-3134-43bf-b644-a5394686d5f7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:53.700386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c1e5e-9fe8-48c1-b695-5d7783c9b808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:53.701235 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c1e5e-9fe8-48c1-b695-5d7783c9b808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:53.701587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c1e5e-9fe8-48c1-b695-5d7783c9b808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:53.701925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c1e5e-9fe8-48c1-b695-5d7783c9b808 admin admin] PATH_INFO: `/v3/projects/7c81dccaf4ca4cb0a28e823b1c4df7f9` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:53.703499 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c1e5e-9fe8-48c1-b695-5d7783c9b808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c81dccaf4ca4cb0a28e823b1c4df7f9)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:53.706439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c1e5e-9fe8-48c1-b695-5d7783c9b808 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:53.784984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-948ca961-a2d9-43ed-9b79-916ae54f4256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725a127a475147b79a8b93c040c7b8dd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:53.811862 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-948ca961-a2d9-43ed-9b79-916ae54f4256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725a127a475147b79a8b93c040c7b8dd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:53.828710 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-948ca961-a2d9-43ed-9b79-916ae54f4256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725a127a475147b79a8b93c040c7b8dd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:53.829443 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-948ca961-a2d9-43ed-9b79-916ae54f4256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725a127a475147b79a8b93c040c7b8dd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:53.861518 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-948ca961-a2d9-43ed-9b79-916ae54f4256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725a127a475147b79a8b93c040c7b8dd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:53.877364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1174/2320] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:53 2022] DELETE /identity/v3/users/725a127a475147b79a8b93c040c7b8dd => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:53.899178 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:53.935194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0e2c1e5e-9fe8-48c1-b695-5d7783c9b808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c81dccaf4ca4cb0a28e823b1c4df7f9', 'request_id': 'req-0e2c1e5e-9fe8-48c1-b695-5d7783c9b808'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:53.946058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0e2c1e5e-9fe8-48c1-b695-5d7783c9b808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c81dccaf4ca4cb0a28e823b1c4df7f9', 'request_id': 'req-0e2c1e5e-9fe8-48c1-b695-5d7783c9b808'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:53.954577 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0e2c1e5e-9fe8-48c1-b695-5d7783c9b808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c81dccaf4ca4cb0a28e823b1c4df7f9', 'request_id': 'req-0e2c1e5e-9fe8-48c1-b695-5d7783c9b808'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:53.976299 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0e2c1e5e-9fe8-48c1-b695-5d7783c9b808 admin admin] The token cache is being invalidate because project 7c81dccaf4ca4cb0a28e823b1c4df7f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:53.976857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0e2c1e5e-9fe8-48c1-b695-5d7783c9b808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:53.977982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0e2c1e5e-9fe8-48c1-b695-5d7783c9b808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:53.986991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1147/2321] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:53 2022] DELETE /identity/v3/projects/7c81dccaf4ca4cb0a28e823b1c4df7f9 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:53.990166 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e196f80-14a8-4f85-9f2e-42900a22820f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:53.990326 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e196f80-14a8-4f85-9f2e-42900a22820f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:53.990589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e196f80-14a8-4f85-9f2e-42900a22820f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:54.050337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5e196f80-14a8-4f85-9f2e-42900a22820f None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:54.051539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5e196f80-14a8-4f85-9f2e-42900a22820f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:54.161259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:54.250422 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1175/2322] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:54.259648 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df3324-2e28-4393-ba42-ddd1488a2b81 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:54.260164 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df3324-2e28-4393-ba42-ddd1488a2b81 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:54.263017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df3324-2e28-4393-ba42-ddd1488a2b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:54.319554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-96df3324-2e28-4393-ba42-ddd1488a2b81 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:54.322489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-96df3324-2e28-4393-ba42-ddd1488a2b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:54.394996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e196f80-14a8-4f85-9f2e-42900a22820f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:54.395716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1148/2323] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:54.408950 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e196f80-14a8-4f85-9f2e-42900a22820f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:54.442304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df61eb-d557-47af-9237-d41cd69333f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:54.442304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df61eb-d557-47af-9237-d41cd69333f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:54.442304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df61eb-d557-47af-9237-d41cd69333f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:54.442304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df61eb-d557-47af-9237-d41cd69333f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:54.442829 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df61eb-d557-47af-9237-d41cd69333f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:11:54.442829 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df61eb-d557-47af-9237-d41cd69333f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:54.444754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df61eb-d557-47af-9237-d41cd69333f4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:54.479739 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1176/2324] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:11:54.487247 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df3324-2e28-4393-ba42-ddd1488a2b81 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:54.497501 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df3324-2e28-4393-ba42-ddd1488a2b81 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:54.509502 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44720b13-2808-48d9-8b58-e2d95e8e4faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:54.510316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44720b13-2808-48d9-8b58-e2d95e8e4faf admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:54.510645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44720b13-2808-48d9-8b58-e2d95e8e4faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:54.511011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44720b13-2808-48d9-8b58-e2d95e8e4faf admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:54.511875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44720b13-2808-48d9-8b58-e2d95e8e4faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:54.525701 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44720b13-2808-48d9-8b58-e2d95e8e4faf admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:54.608920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df61eb-d557-47af-9237-d41cd69333f4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:54.617603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1149/2325] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:54 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:54.626758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df61eb-d557-47af-9237-d41cd69333f4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:54.699895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44720b13-2808-48d9-8b58-e2d95e8e4faf admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:54.702117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-44720b13-2808-48d9-8b58-e2d95e8e4faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:54.852641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d85de-7e12-4f1d-8d8c-6c8e272a5ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:54.853435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d85de-7e12-4f1d-8d8c-6c8e272a5ece admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:54.853640 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d85de-7e12-4f1d-8d8c-6c8e272a5ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:54.853833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d85de-7e12-4f1d-8d8c-6c8e272a5ece admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:54.855219 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d85de-7e12-4f1d-8d8c-6c8e272a5ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:54.860887 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d85de-7e12-4f1d-8d8c-6c8e272a5ece admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:54.871782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44720b13-2808-48d9-8b58-e2d95e8e4faf admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:54.882568 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:54.883336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:54.883672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:54.884107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364 admin admin] PATH_INFO: `/v3/projects/ba29555baeed436690ff66b5227323da` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:54.885691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba29555baeed436690ff66b5227323da)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:54.887840 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:54.930026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1177/2326] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:54 2022] POST /identity/v3/users => generated 288 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:54.932723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d85de-7e12-4f1d-8d8c-6c8e272a5ece admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:54.969363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d85de-7e12-4f1d-8d8c-6c8e272a5ece admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:54.997108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba29555baeed436690ff66b5227323da', 'request_id': 'req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:55.012642 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba29555baeed436690ff66b5227323da', 'request_id': 'req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:55.032052 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba29555baeed436690ff66b5227323da', 'request_id': 'req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:55.068156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364 admin admin] The token cache is being invalidate because project ba29555baeed436690ff66b5227323da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:55.068484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:55.072733 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:55.077076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1150/2327] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:54 2022] DELETE /identity/v3/projects/ba29555baeed436690ff66b5227323da => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:11:55.081287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:55.084760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:55.095078 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d6abe-11ba-4cf7-96ae-b18c615b5d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:55.096869 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d6abe-11ba-4cf7-96ae-b18c615b5d52 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:55.097146 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d6abe-11ba-4cf7-96ae-b18c615b5d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:55.097416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d6abe-11ba-4cf7-96ae-b18c615b5d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:55.098060 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d6abe-11ba-4cf7-96ae-b18c615b5d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:55.101932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d6abe-11ba-4cf7-96ae-b18c615b5d52 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:55.117326 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcec84-ab1b-457c-84cd-7ae5f9e5e364 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:55.124165 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1178/2328] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:11:55.126242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be624b8-a0de-40f3-970c-c4a02eb4d1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:55.126887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be624b8-a0de-40f3-970c-c4a02eb4d1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:55.127158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be624b8-a0de-40f3-970c-c4a02eb4d1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:55.127446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be624b8-a0de-40f3-970c-c4a02eb4d1fb admin admin] PATH_INFO: `/v3/users/c1797263332745dfaaa6dec8e85ae708` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:55.128853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d6abe-11ba-4cf7-96ae-b18c615b5d52 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:55.129805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be624b8-a0de-40f3-970c-c4a02eb4d1fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1797263332745dfaaa6dec8e85ae708)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:55.132035 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be624b8-a0de-40f3-970c-c4a02eb4d1fb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:55.132159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-126d6abe-11ba-4cf7-96ae-b18c615b5d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:55.151408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:55.164666 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d6abe-11ba-4cf7-96ae-b18c615b5d52 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:55.171305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5c96a-6bcc-412e-857f-5f139d7c73b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:55.172240 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5c96a-6bcc-412e-857f-5f139d7c73b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:55.172832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5c96a-6bcc-412e-857f-5f139d7c73b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:55.173260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5c96a-6bcc-412e-857f-5f139d7c73b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:55.174379 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5c96a-6bcc-412e-857f-5f139d7c73b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:55.176387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5c96a-6bcc-412e-857f-5f139d7c73b8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:55.194211 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1179/2329] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:55.195298 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5c96a-6bcc-412e-857f-5f139d7c73b8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:55.208171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5c96a-6bcc-412e-857f-5f139d7c73b8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:55.214573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a15fd3-fe02-44cf-b7da-962f9c037dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:55.215604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a15fd3-fe02-44cf-b7da-962f9c037dab admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:55.216053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a15fd3-fe02-44cf-b7da-962f9c037dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:55.216400 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a15fd3-fe02-44cf-b7da-962f9c037dab admin admin] PATH_INFO: `/v3/projects/042f6c61b453404098558a55b52a10f8/users/e6a53fc5096640f394bf2e1511b70d89/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:55.226734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2be624b8-a0de-40f3-970c-c4a02eb4d1fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1797263332745dfaaa6dec8e85ae708'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:55.251325 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2be624b8-a0de-40f3-970c-c4a02eb4d1fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1797263332745dfaaa6dec8e85ae708'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:55.276847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a15fd3-fe02-44cf-b7da-962f9c037dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=042f6c61b453404098558a55b52a10f8, user_id=e6a53fc5096640f394bf2e1511b70d89, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:55.282733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a15fd3-fe02-44cf-b7da-962f9c037dab admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:55.291107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2be624b8-a0de-40f3-970c-c4a02eb4d1fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1797263332745dfaaa6dec8e85ae708'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:55.292091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2be624b8-a0de-40f3-970c-c4a02eb4d1fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1797263332745dfaaa6dec8e85ae708'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:55.293436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2be624b8-a0de-40f3-970c-c4a02eb4d1fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1797263332745dfaaa6dec8e85ae708'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:55.330100 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1151/2330] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:55 2022] DELETE /identity/v3/users/c1797263332745dfaaa6dec8e85ae708 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:11:55.330852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1180/2331] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:55 2022] PUT /identity/v3/projects/042f6c61b453404098558a55b52a10f8/users/e6a53fc5096640f394bf2e1511b70d89/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:55.356030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cf0bd-a5ba-4d2d-b63e-fadad17d0eb2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:55.356303 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cf0bd-a5ba-4d2d-b63e-fadad17d0eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:55.356574 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cf0bd-a5ba-4d2d-b63e-fadad17d0eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:55.435857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1c0cf0bd-a5ba-4d2d-b63e-fadad17d0eb2 None None] MFA Rules not processed for user `e6a53fc5096640f394bf2e1511b70d89`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:55.437170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1c0cf0bd-a5ba-4d2d-b63e-fadad17d0eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:55.743239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a15fd3-fe02-44cf-b7da-962f9c037dab admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:55.745198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-32a15fd3-fe02-44cf-b7da-962f9c037dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:55.756955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1152/2332] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:55.785135 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:55.958391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a15fd3-fe02-44cf-b7da-962f9c037dab admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:56.075313 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ba649-c713-494d-ba80-4e5cd170fb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:56.079102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ba649-c713-494d-ba80-4e5cd170fb65 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:56.079102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ba649-c713-494d-ba80-4e5cd170fb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:56.079102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ba649-c713-494d-ba80-4e5cd170fb65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:56.079102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ba649-c713-494d-ba80-4e5cd170fb65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:56.080789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ba649-c713-494d-ba80-4e5cd170fb65 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:56.118548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cf0bd-a5ba-4d2d-b63e-fadad17d0eb2 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:56.120050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1c0cf0bd-a5ba-4d2d-b63e-fadad17d0eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:56.138155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cf0bd-a5ba-4d2d-b63e-fadad17d0eb2 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:56.143060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713fb55-38d8-4ef7-aa11-df054328fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:56.143649 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1181/2333] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:55 2022] POST /identity/v3/projects => generated 381 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:56.146762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713fb55-38d8-4ef7-aa11-df054328fa76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:56.147092 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713fb55-38d8-4ef7-aa11-df054328fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:56.147382 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713fb55-38d8-4ef7-aa11-df054328fa76 admin admin] PATH_INFO: `/v3/projects/61293ad318094d7a9b3ffefe470e43c0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:56.149065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ba649-c713-494d-ba80-4e5cd170fb65 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:56.150091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713fb55-38d8-4ef7-aa11-df054328fa76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61293ad318094d7a9b3ffefe470e43c0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:56.152506 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713fb55-38d8-4ef7-aa11-df054328fa76 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:56.263196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f713fb55-38d8-4ef7-aa11-df054328fa76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61293ad318094d7a9b3ffefe470e43c0', 'request_id': 'req-f713fb55-38d8-4ef7-aa11-df054328fa76'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:56.269024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ba649-c713-494d-ba80-4e5cd170fb65 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:56.272524 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f713fb55-38d8-4ef7-aa11-df054328fa76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61293ad318094d7a9b3ffefe470e43c0', 'request_id': 'req-f713fb55-38d8-4ef7-aa11-df054328fa76'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:56.281842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f713fb55-38d8-4ef7-aa11-df054328fa76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61293ad318094d7a9b3ffefe470e43c0', 'request_id': 'req-f713fb55-38d8-4ef7-aa11-df054328fa76'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:56.302574 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f713fb55-38d8-4ef7-aa11-df054328fa76 admin admin] The token cache is being invalidate because project 61293ad318094d7a9b3ffefe470e43c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:11:56.303118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f713fb55-38d8-4ef7-aa11-df054328fa76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:56.304146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f713fb55-38d8-4ef7-aa11-df054328fa76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:56.307294 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1153/2334] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:11:56 2022] DELETE /identity/v3/projects/61293ad318094d7a9b3ffefe470e43c0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:11:56.315867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138b15f-ab44-4b00-bfbd-739ce13969d1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:56.316422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138b15f-ab44-4b00-bfbd-739ce13969d1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:56.316863 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138b15f-ab44-4b00-bfbd-739ce13969d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:56.333189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:56.340911 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e0620-7f86-4196-b2d8-1903fe4a0338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:56.344059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e0620-7f86-4196-b2d8-1903fe4a0338 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:56.344059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e0620-7f86-4196-b2d8-1903fe4a0338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:56.344059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e0620-7f86-4196-b2d8-1903fe4a0338 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:56.344441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e0620-7f86-4196-b2d8-1903fe4a0338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:56.346569 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e0620-7f86-4196-b2d8-1903fe4a0338 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:56.356790 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:56.378112 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a138b15f-ab44-4b00-bfbd-739ce13969d1 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:56.381413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a138b15f-ab44-4b00-bfbd-739ce13969d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:56.392854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1182/2335] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:56 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:56.393955 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e0620-7f86-4196-b2d8-1903fe4a0338 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:56.395984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-191e0620-7f86-4196-b2d8-1903fe4a0338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:56.412058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e0620-7f86-4196-b2d8-1903fe4a0338 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:56.415364 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1154/2336] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:56.425432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809900d0-80cb-435b-ba3e-ca120549fe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:56.426221 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809900d0-80cb-435b-ba3e-ca120549fe67 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:56.426580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809900d0-80cb-435b-ba3e-ca120549fe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:56.426824 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018f9ea-28f0-455d-b258-f7f97737d73c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:56.426943 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809900d0-80cb-435b-ba3e-ca120549fe67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:56.427660 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809900d0-80cb-435b-ba3e-ca120549fe67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:56.428322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018f9ea-28f0-455d-b258-f7f97737d73c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:56.428603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018f9ea-28f0-455d-b258-f7f97737d73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:56.429595 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809900d0-80cb-435b-ba3e-ca120549fe67 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:56.458163 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3018f9ea-28f0-455d-b258-f7f97737d73c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:56.459363 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3018f9ea-28f0-455d-b258-f7f97737d73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:56.463170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1183/2337] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:56.467542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809900d0-80cb-435b-ba3e-ca120549fe67 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:56.469386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1155/2338] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:56.473535 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018f9ea-28f0-455d-b258-f7f97737d73c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:56.487213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018f9ea-28f0-455d-b258-f7f97737d73c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:56.492596 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809900d0-80cb-435b-ba3e-ca120549fe67 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:56.493695 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8d9a1-231b-4fc3-88fe-5f9d6d928439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:56.494471 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8d9a1-231b-4fc3-88fe-5f9d6d928439 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:56.495641 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8d9a1-231b-4fc3-88fe-5f9d6d928439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:56.495966 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8d9a1-231b-4fc3-88fe-5f9d6d928439 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:56.496639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8d9a1-231b-4fc3-88fe-5f9d6d928439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:11:56.497540 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8d9a1-231b-4fc3-88fe-5f9d6d928439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:56.503324 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8d9a1-231b-4fc3-88fe-5f9d6d928439 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:56.504677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba0434-049d-4855-a698-997ede2086fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:56.505364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba0434-049d-4855-a698-997ede2086fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:56.505617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba0434-049d-4855-a698-997ede2086fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:56.506160 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba0434-049d-4855-a698-997ede2086fa admin admin] PATH_INFO: `/v3/projects/d9c363aba33142e78ef29d19fdd34d80/users/d36882a970854ccdb029c371f6d640b4/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:56.522805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1156/2339] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:11:56.523770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8d9a1-231b-4fc3-88fe-5f9d6d928439 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:56.538570 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba0434-049d-4855-a698-997ede2086fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c363aba33142e78ef29d19fdd34d80, user_id=d36882a970854ccdb029c371f6d640b4, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:56.539260 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8d9a1-231b-4fc3-88fe-5f9d6d928439 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:56.543833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba0434-049d-4855-a698-997ede2086fa admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:56.544127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e876a5-12f0-42d6-b2eb-70ed42334b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:56.544737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e876a5-12f0-42d6-b2eb-70ed42334b9a admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:56.545062 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e876a5-12f0-42d6-b2eb-70ed42334b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:56.545335 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e876a5-12f0-42d6-b2eb-70ed42334b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:56.546137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e876a5-12f0-42d6-b2eb-70ed42334b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:56.548170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e876a5-12f0-42d6-b2eb-70ed42334b9a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:56.569604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1184/2340] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:56 2022] PUT /identity/v3/projects/d9c363aba33142e78ef29d19fdd34d80/users/d36882a970854ccdb029c371f6d640b4/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:56.574262 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba0434-049d-4855-a698-997ede2086fa admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:56.603446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1157/2341] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:11:56 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:56.608207 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e876a5-12f0-42d6-b2eb-70ed42334b9a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:56.714574 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba0434-049d-4855-a698-997ede2086fa admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:56.728950 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e876a5-12f0-42d6-b2eb-70ed42334b9a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:56.729925 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d29280-cbff-4be7-aea5-cb26abcf3564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:56.730553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d29280-cbff-4be7-aea5-cb26abcf3564 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:56.730832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d29280-cbff-4be7-aea5-cb26abcf3564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:56.731104 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d29280-cbff-4be7-aea5-cb26abcf3564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:56.731753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d29280-cbff-4be7-aea5-cb26abcf3564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:56.733517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d29280-cbff-4be7-aea5-cb26abcf3564 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:56.736835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2456dc-3d0b-4864-88e8-7b32dc9ac82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:56.738253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2456dc-3d0b-4864-88e8-7b32dc9ac82b admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:56.738841 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2456dc-3d0b-4864-88e8-7b32dc9ac82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:56.740038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2456dc-3d0b-4864-88e8-7b32dc9ac82b admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:56.751161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2456dc-3d0b-4864-88e8-7b32dc9ac82b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:56.753384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2456dc-3d0b-4864-88e8-7b32dc9ac82b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:56.760771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1185/2342] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:56.761646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d29280-cbff-4be7-aea5-cb26abcf3564 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:56.776511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d29280-cbff-4be7-aea5-cb26abcf3564 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:56.783518 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5778b-514c-4b2e-bfc8-85ef7d58626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:56.784183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5778b-514c-4b2e-bfc8-85ef7d58626b admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:56.784454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5778b-514c-4b2e-bfc8-85ef7d58626b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:56.784725 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5778b-514c-4b2e-bfc8-85ef7d58626b admin admin] PATH_INFO: `/v3/projects/d9c363aba33142e78ef29d19fdd34d80/users/d36882a970854ccdb029c371f6d640b4/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:56.790274 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5778b-514c-4b2e-bfc8-85ef7d58626b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c363aba33142e78ef29d19fdd34d80, user_id=d36882a970854ccdb029c371f6d640b4, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:56.792964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5778b-514c-4b2e-bfc8-85ef7d58626b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:56.797034 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1158/2343] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:11:56 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:11:56.800369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2456dc-3d0b-4864-88e8-7b32dc9ac82b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:56.807350 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1186/2344] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:56 2022] PUT /identity/v3/projects/d9c363aba33142e78ef29d19fdd34d80/users/d36882a970854ccdb029c371f6d640b4/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:56.818768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977fe88-a5a4-4c89-9eae-37bb7d6f7618 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:56.820109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977fe88-a5a4-4c89-9eae-37bb7d6f7618 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:56.820109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977fe88-a5a4-4c89-9eae-37bb7d6f7618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:56.824630 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2456dc-3d0b-4864-88e8-7b32dc9ac82b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:56.869517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a977fe88-a5a4-4c89-9eae-37bb7d6f7618 None None] MFA Rules not processed for user `d36882a970854ccdb029c371f6d640b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:56.870737 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a977fe88-a5a4-4c89-9eae-37bb7d6f7618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:56.985546 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298ebc6-7591-4415-9cfa-14a4cf79d999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:56.990118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298ebc6-7591-4415-9cfa-14a4cf79d999 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:56.991485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298ebc6-7591-4415-9cfa-14a4cf79d999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:56.993788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298ebc6-7591-4415-9cfa-14a4cf79d999 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:56.994543 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298ebc6-7591-4415-9cfa-14a4cf79d999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:56.997867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298ebc6-7591-4415-9cfa-14a4cf79d999 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:57.022430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1187/2345] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:57.022430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b56af2-5e9c-4f62-91df-7a8b94eae3dd None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:57.022430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b56af2-5e9c-4f62-91df-7a8b94eae3dd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:57.022430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b56af2-5e9c-4f62-91df-7a8b94eae3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:57.030593 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1159/2346] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:57.030593 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298ebc6-7591-4415-9cfa-14a4cf79d999 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:57.032635 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d298ebc6-7591-4415-9cfa-14a4cf79d999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:57.080866 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-26b56af2-5e9c-4f62-91df-7a8b94eae3dd None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:57.084349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-26b56af2-5e9c-4f62-91df-7a8b94eae3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:57.110806 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:57.139926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:57.161712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298ebc6-7591-4415-9cfa-14a4cf79d999 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:57.166256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c4888-2d70-42c2-85d8-11dcc5b69f1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:57.167161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c4888-2d70-42c2-85d8-11dcc5b69f1a service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:57.167622 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c4888-2d70-42c2-85d8-11dcc5b69f1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:57.168125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c4888-2d70-42c2-85d8-11dcc5b69f1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:57.179732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c4888-2d70-42c2-85d8-11dcc5b69f1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:57.181756 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c4888-2d70-42c2-85d8-11dcc5b69f1a service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:57.194236 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1160/2347] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:57.195691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c4888-2d70-42c2-85d8-11dcc5b69f1a service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:57.211154 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c4888-2d70-42c2-85d8-11dcc5b69f1a service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:57.212727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1188/2348] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Aug 30 05:11:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:57.218184 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f7ba0-3f31-4726-b447-818e16494976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:57.219209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f7ba0-3f31-4726-b447-818e16494976 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:57.219784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f7ba0-3f31-4726-b447-818e16494976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:57.220292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f7ba0-3f31-4726-b447-818e16494976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:57.221133 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f7ba0-3f31-4726-b447-818e16494976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:57.224116 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f7ba0-3f31-4726-b447-818e16494976 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:57.226735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b56af2-5e9c-4f62-91df-7a8b94eae3dd None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:57.228456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-26b56af2-5e9c-4f62-91df-7a8b94eae3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:57.241876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1161/2349] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:11:57.243272 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f7ba0-3f31-4726-b447-818e16494976 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:57.256324 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f7ba0-3f31-4726-b447-818e16494976 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:57.279710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e507d2-ef87-43cc-90df-531901d013b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:57.280618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e507d2-ef87-43cc-90df-531901d013b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:57.281077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e507d2-ef87-43cc-90df-531901d013b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:57.281421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e507d2-ef87-43cc-90df-531901d013b4 admin admin] PATH_INFO: `/v3/projects/c4c952c4521d4515ad969cd9f6209904/users/bbd08b29c5d64ecbb7f2dbfbd328d0c1/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:57.336855 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e507d2-ef87-43cc-90df-531901d013b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c952c4521d4515ad969cd9f6209904, user_id=bbd08b29c5d64ecbb7f2dbfbd328d0c1, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:57.343360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e507d2-ef87-43cc-90df-531901d013b4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:57.376026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1162/2350] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:11:57 2022] PUT /identity/v3/projects/c4c952c4521d4515ad969cd9f6209904/users/bbd08b29c5d64ecbb7f2dbfbd328d0c1/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:57.381620 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db84bd-74ba-4a96-880b-b98161fd6000 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:57.381905 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db84bd-74ba-4a96-880b-b98161fd6000 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:57.382181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db84bd-74ba-4a96-880b-b98161fd6000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:57.419415 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-82db84bd-74ba-4a96-880b-b98161fd6000 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:57.421264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-82db84bd-74ba-4a96-880b-b98161fd6000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:57.428348 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b56af2-5e9c-4f62-91df-7a8b94eae3dd None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:57.559848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1163/2351] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:57.571866 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd32ee0-0f54-4661-b266-003ae64dfef1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:57.572466 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db84bd-74ba-4a96-880b-b98161fd6000 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:57.572987 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd32ee0-0f54-4661-b266-003ae64dfef1 service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:57.573512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd32ee0-0f54-4661-b266-003ae64dfef1 service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:57.573940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd32ee0-0f54-4661-b266-003ae64dfef1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:57.575849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-82db84bd-74ba-4a96-880b-b98161fd6000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:57.665014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd32ee0-0f54-4661-b266-003ae64dfef1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:57.667439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd32ee0-0f54-4661-b266-003ae64dfef1 service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:57.688940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1189/2352] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:11:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:11:57.725881 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db84bd-74ba-4a96-880b-b98161fd6000 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:57.733254 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fda05a-6562-4893-a176-d8dc16472fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:57.734000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fda05a-6562-4893-a176-d8dc16472fea service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:57.734509 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fda05a-6562-4893-a176-d8dc16472fea service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:57.734953 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fda05a-6562-4893-a176-d8dc16472fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:57.749448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fda05a-6562-4893-a176-d8dc16472fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:57.751088 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fda05a-6562-4893-a176-d8dc16472fea service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:57.766003 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1164/2353] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:57.838901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd32ee0-0f54-4661-b266-003ae64dfef1 service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:57.850987 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd32ee0-0f54-4661-b266-003ae64dfef1 service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:57.856024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d1e51-19e8-4ea7-92a3-ebf2b5ab5355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:57.856678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d1e51-19e8-4ea7-92a3-ebf2b5ab5355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:57.856956 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d1e51-19e8-4ea7-92a3-ebf2b5ab5355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:57.857224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d1e51-19e8-4ea7-92a3-ebf2b5ab5355 admin admin] PATH_INFO: `/v3/users/e6a53fc5096640f394bf2e1511b70d89` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:57.858955 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d1e51-19e8-4ea7-92a3-ebf2b5ab5355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a53fc5096640f394bf2e1511b70d89)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:57.862255 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d1e51-19e8-4ea7-92a3-ebf2b5ab5355 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:57.864488 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:57.978165 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e43d1e51-19e8-4ea7-92a3-ebf2b5ab5355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a53fc5096640f394bf2e1511b70d89'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:58.001293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e43d1e51-19e8-4ea7-92a3-ebf2b5ab5355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a53fc5096640f394bf2e1511b70d89'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:58.022552 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e43d1e51-19e8-4ea7-92a3-ebf2b5ab5355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a53fc5096640f394bf2e1511b70d89'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:58.024399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e43d1e51-19e8-4ea7-92a3-ebf2b5ab5355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a53fc5096640f394bf2e1511b70d89'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:58.053920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e43d1e51-19e8-4ea7-92a3-ebf2b5ab5355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a53fc5096640f394bf2e1511b70d89'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:11:58.068360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1190/2354] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:11:57 2022] DELETE /identity/v3/users/e6a53fc5096640f394bf2e1511b70d89 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:11:58.073284 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f17e5-079f-4155-a6ee-b007d39ca94a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:58.073678 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f17e5-079f-4155-a6ee-b007d39ca94a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:58.073948 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f17e5-079f-4155-a6ee-b007d39ca94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:58.128316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0f1f17e5-079f-4155-a6ee-b007d39ca94a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:11:58.129961 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0f1f17e5-079f-4155-a6ee-b007d39ca94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:58.278579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:58.309643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1165/2355] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:11:58.350385 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d1e51-19e8-4ea7-92a3-ebf2b5ab5355 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:58.351993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e43d1e51-19e8-4ea7-92a3-ebf2b5ab5355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:58.625208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d1e51-19e8-4ea7-92a3-ebf2b5ab5355 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:58.642223 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120eb2b-4f3e-4b5e-b446-ff85d94174e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:58.643432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120eb2b-4f3e-4b5e-b446-ff85d94174e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:58.644030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120eb2b-4f3e-4b5e-b446-ff85d94174e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:58.644996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120eb2b-4f3e-4b5e-b446-ff85d94174e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:58.683723 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120eb2b-4f3e-4b5e-b446-ff85d94174e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:58.690800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120eb2b-4f3e-4b5e-b446-ff85d94174e7 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:58.719567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1191/2356] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:01.583359 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f17e5-079f-4155-a6ee-b007d39ca94a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:01.584925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0f1f17e5-079f-4155-a6ee-b007d39ca94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:01.615775 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f17e5-079f-4155-a6ee-b007d39ca94a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:01.629481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fe03d-5893-48c1-9116-09304574f76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:01.630245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fe03d-5893-48c1-9116-09304574f76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:01.630587 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fe03d-5893-48c1-9116-09304574f76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:01.631058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fe03d-5893-48c1-9116-09304574f76b admin admin] PATH_INFO: `/v3/projects/042f6c61b453404098558a55b52a10f8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:01.634514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fe03d-5893-48c1-9116-09304574f76b admin admin] RBAC: Authorizing `identity:delete_project(project_id=042f6c61b453404098558a55b52a10f8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:01.641282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fe03d-5893-48c1-9116-09304574f76b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:01.783305 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-394fe03d-5893-48c1-9116-09304574f76b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '042f6c61b453404098558a55b52a10f8', 'request_id': 'req-394fe03d-5893-48c1-9116-09304574f76b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:01.818003 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-394fe03d-5893-48c1-9116-09304574f76b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '042f6c61b453404098558a55b52a10f8', 'request_id': 'req-394fe03d-5893-48c1-9116-09304574f76b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:01.837349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-394fe03d-5893-48c1-9116-09304574f76b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '042f6c61b453404098558a55b52a10f8', 'request_id': 'req-394fe03d-5893-48c1-9116-09304574f76b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:01.874693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-394fe03d-5893-48c1-9116-09304574f76b admin admin] The token cache is being invalidate because project 042f6c61b453404098558a55b52a10f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:12:01.875251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-394fe03d-5893-48c1-9116-09304574f76b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:01.876691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-394fe03d-5893-48c1-9116-09304574f76b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:01.885629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1166/2357] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:12:01 2022] DELETE /identity/v3/projects/042f6c61b453404098558a55b52a10f8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:12:01.889755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120eb2b-4f3e-4b5e-b446-ff85d94174e7 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:01.906835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120eb2b-4f3e-4b5e-b446-ff85d94174e7 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:02.078773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea003c-1e6e-4cee-8408-3e3ca598cd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:02.079700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea003c-1e6e-4cee-8408-3e3ca598cd78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:02.081439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea003c-1e6e-4cee-8408-3e3ca598cd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:02.081925 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea003c-1e6e-4cee-8408-3e3ca598cd78 admin admin] PATH_INFO: `/v3/users/d36882a970854ccdb029c371f6d640b4` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:02.086367 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea003c-1e6e-4cee-8408-3e3ca598cd78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d36882a970854ccdb029c371f6d640b4)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:02.088688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea003c-1e6e-4cee-8408-3e3ca598cd78 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:02.199291 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:02.255428 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edea003c-1e6e-4cee-8408-3e3ca598cd78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd36882a970854ccdb029c371f6d640b4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:02.277670 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edea003c-1e6e-4cee-8408-3e3ca598cd78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd36882a970854ccdb029c371f6d640b4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:02.297816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edea003c-1e6e-4cee-8408-3e3ca598cd78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd36882a970854ccdb029c371f6d640b4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:02.298974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edea003c-1e6e-4cee-8408-3e3ca598cd78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd36882a970854ccdb029c371f6d640b4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:02.324848 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edea003c-1e6e-4cee-8408-3e3ca598cd78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd36882a970854ccdb029c371f6d640b4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:02.354774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1192/2358] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:12:01 2022] DELETE /identity/v3/users/d36882a970854ccdb029c371f6d640b4 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:12:05.626592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fe03d-5893-48c1-9116-09304574f76b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:05.631650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-394fe03d-5893-48c1-9116-09304574f76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:05.665603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fe03d-5893-48c1-9116-09304574f76b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:05.922307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de78a1-af44-49dd-b978-581bef77d750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:05.923193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de78a1-af44-49dd-b978-581bef77d750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:05.924013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de78a1-af44-49dd-b978-581bef77d750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:05.924477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de78a1-af44-49dd-b978-581bef77d750 admin admin] PATH_INFO: `/v3/projects/d9c363aba33142e78ef29d19fdd34d80` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:05.931535 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de78a1-af44-49dd-b978-581bef77d750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9c363aba33142e78ef29d19fdd34d80)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:05.938289 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de78a1-af44-49dd-b978-581bef77d750 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:06.113564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-03de78a1-af44-49dd-b978-581bef77d750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9c363aba33142e78ef29d19fdd34d80', 'request_id': 'req-03de78a1-af44-49dd-b978-581bef77d750'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:06.132490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-03de78a1-af44-49dd-b978-581bef77d750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9c363aba33142e78ef29d19fdd34d80', 'request_id': 'req-03de78a1-af44-49dd-b978-581bef77d750'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:06.152820 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-03de78a1-af44-49dd-b978-581bef77d750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9c363aba33142e78ef29d19fdd34d80', 'request_id': 'req-03de78a1-af44-49dd-b978-581bef77d750'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:06.189774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-03de78a1-af44-49dd-b978-581bef77d750 admin admin] The token cache is being invalidate because project d9c363aba33142e78ef29d19fdd34d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:12:06.191278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-03de78a1-af44-49dd-b978-581bef77d750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:06.192520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-03de78a1-af44-49dd-b978-581bef77d750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:06.196621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1167/2359] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:12:05 2022] DELETE /identity/v3/projects/d9c363aba33142e78ef29d19fdd34d80 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:12:06.202115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960914f4-df43-4709-a986-7e0ef58a8786 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:06.202698 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960914f4-df43-4709-a986-7e0ef58a8786 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:06.202946 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960914f4-df43-4709-a986-7e0ef58a8786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:06.246180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-960914f4-df43-4709-a986-7e0ef58a8786 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:06.247829 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-960914f4-df43-4709-a986-7e0ef58a8786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:06.416150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1193/2360] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:12:06.425602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6787bc-d0f4-4bd5-8e8f-811f197b8d82 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:06.426152 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6787bc-d0f4-4bd5-8e8f-811f197b8d82 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:06.426589 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6787bc-d0f4-4bd5-8e8f-811f197b8d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:06.472999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2e6787bc-d0f4-4bd5-8e8f-811f197b8d82 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:06.474254 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2e6787bc-d0f4-4bd5-8e8f-811f197b8d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:06.496919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1168/2361] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:06.498475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960914f4-df43-4709-a986-7e0ef58a8786 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:06.517539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960914f4-df43-4709-a986-7e0ef58a8786 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:06.535264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1878b05-2a7d-4796-bb08-0890b7f8f544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:06.535919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1878b05-2a7d-4796-bb08-0890b7f8f544 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:06.536204 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1878b05-2a7d-4796-bb08-0890b7f8f544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:06.536477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1878b05-2a7d-4796-bb08-0890b7f8f544 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:06.537146 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1878b05-2a7d-4796-bb08-0890b7f8f544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:12:06.537445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1878b05-2a7d-4796-bb08-0890b7f8f544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:06.539075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1878b05-2a7d-4796-bb08-0890b7f8f544 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:06.562212 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1194/2362] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:12:06.565255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6787bc-d0f4-4bd5-8e8f-811f197b8d82 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:06.570121 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:06.585680 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6787bc-d0f4-4bd5-8e8f-811f197b8d82 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:06.599091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c358ff-23a3-4407-b3e5-a723d0028174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:06.600223 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c358ff-23a3-4407-b3e5-a723d0028174 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:06.600692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c358ff-23a3-4407-b3e5-a723d0028174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:06.601980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c358ff-23a3-4407-b3e5-a723d0028174 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:06.605100 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c358ff-23a3-4407-b3e5-a723d0028174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:06.611461 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c358ff-23a3-4407-b3e5-a723d0028174 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:06.728049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1878b05-2a7d-4796-bb08-0890b7f8f544 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:06.729209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1169/2363] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:12:06 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:12:06.748258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1878b05-2a7d-4796-bb08-0890b7f8f544 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:07.020674 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f648f0-63d2-4b94-a24b-e21b7698e42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:07.021465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f648f0-63d2-4b94-a24b-e21b7698e42a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:07.021740 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f648f0-63d2-4b94-a24b-e21b7698e42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:07.022140 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f648f0-63d2-4b94-a24b-e21b7698e42a admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:07.022851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f648f0-63d2-4b94-a24b-e21b7698e42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:07.027600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f648f0-63d2-4b94-a24b-e21b7698e42a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:07.092216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1195/2364] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:12:06 2022] POST /identity/v3/users => generated 292 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:12:07.093681 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c358ff-23a3-4407-b3e5-a723d0028174 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:07.141045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c358ff-23a3-4407-b3e5-a723d0028174 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:07.194560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243d6b4-fd40-4823-a3b4-ba45ea1b16d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:07.195201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243d6b4-fd40-4823-a3b4-ba45ea1b16d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:07.195480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243d6b4-fd40-4823-a3b4-ba45ea1b16d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:07.195753 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243d6b4-fd40-4823-a3b4-ba45ea1b16d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:07.196449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243d6b4-fd40-4823-a3b4-ba45ea1b16d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:07.198083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243d6b4-fd40-4823-a3b4-ba45ea1b16d7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:07.256589 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1170/2365] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:12:07.257944 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f648f0-63d2-4b94-a24b-e21b7698e42a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:07.276919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f648f0-63d2-4b94-a24b-e21b7698e42a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:07.304046 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3f3c9-4ea4-4f69-8151-1bd2f84ecc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:07.304687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3f3c9-4ea4-4f69-8151-1bd2f84ecc49 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:07.304968 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3f3c9-4ea4-4f69-8151-1bd2f84ecc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:07.305243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3f3c9-4ea4-4f69-8151-1bd2f84ecc49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:07.305901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3f3c9-4ea4-4f69-8151-1bd2f84ecc49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:07.317205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3f3c9-4ea4-4f69-8151-1bd2f84ecc49 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:07.393670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243d6b4-fd40-4823-a3b4-ba45ea1b16d7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:07.395441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1196/2366] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:12:07.414604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243d6b4-fd40-4823-a3b4-ba45ea1b16d7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:07.434375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821ea51-a26d-4401-9e90-d86c05daf576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:07.435609 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821ea51-a26d-4401-9e90-d86c05daf576 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:07.435899 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821ea51-a26d-4401-9e90-d86c05daf576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:07.436198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821ea51-a26d-4401-9e90-d86c05daf576 admin admin] PATH_INFO: `/v3/projects/944bbbe087f343278e1fb1cb3cbc1ca0/users/579e12444fba41af85666356fac5415f/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:07.487796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821ea51-a26d-4401-9e90-d86c05daf576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944bbbe087f343278e1fb1cb3cbc1ca0, user_id=579e12444fba41af85666356fac5415f, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:07.492373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821ea51-a26d-4401-9e90-d86c05daf576 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:07.527925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1171/2367] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:12:07 2022] PUT /identity/v3/projects/944bbbe087f343278e1fb1cb3cbc1ca0/users/579e12444fba41af85666356fac5415f/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:12:07.535380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb91d77-8830-4677-ace2-54c6000d9a79 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:07.535773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb91d77-8830-4677-ace2-54c6000d9a79 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:07.536310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb91d77-8830-4677-ace2-54c6000d9a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:07.570198 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:07.591158 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ebb91d77-8830-4677-ace2-54c6000d9a79 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:07.595103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ebb91d77-8830-4677-ace2-54c6000d9a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:07.801040 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1197/2368] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:08.059602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821ea51-a26d-4401-9e90-d86c05daf576 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:08.062645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b821ea51-a26d-4401-9e90-d86c05daf576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:08.344940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821ea51-a26d-4401-9e90-d86c05daf576 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:08.373323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960660b3-a062-4e78-a0b3-7f099dfafdee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:08.375855 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960660b3-a062-4e78-a0b3-7f099dfafdee service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:08.375855 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960660b3-a062-4e78-a0b3-7f099dfafdee service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:08.375855 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960660b3-a062-4e78-a0b3-7f099dfafdee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:08.410907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960660b3-a062-4e78-a0b3-7f099dfafdee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:08.422070 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960660b3-a062-4e78-a0b3-7f099dfafdee service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:08.459999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1172/2369] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:08.828208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090667c1-1fa5-45c3-a8a7-456b25d729b5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:08.828718 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090667c1-1fa5-45c3-a8a7-456b25d729b5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:08.828808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090667c1-1fa5-45c3-a8a7-456b25d729b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:08.921065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-090667c1-1fa5-45c3-a8a7-456b25d729b5 None None] MFA Rules not processed for user `bbd08b29c5d64ecbb7f2dbfbd328d0c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:08.922247 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-090667c1-1fa5-45c3-a8a7-456b25d729b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:09.143781 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1198/2370] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:09.148772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960660b3-a062-4e78-a0b3-7f099dfafdee service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:09.150235 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-960660b3-a062-4e78-a0b3-7f099dfafdee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:09.175632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960660b3-a062-4e78-a0b3-7f099dfafdee service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:09.189183 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1864454-591b-4fe0-b638-a347281552a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:09.189372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1864454-591b-4fe0-b638-a347281552a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:09.189656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1864454-591b-4fe0-b638-a347281552a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:09.190177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1864454-591b-4fe0-b638-a347281552a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:09.192043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1864454-591b-4fe0-b638-a347281552a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:09.192854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1864454-591b-4fe0-b638-a347281552a7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:09.302412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1173/2371] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:12:09 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:12:09.306040 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090667c1-1fa5-45c3-a8a7-456b25d729b5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:09.332015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090667c1-1fa5-45c3-a8a7-456b25d729b5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:09.536301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c6cd3-e9d8-4850-a9b5-839c18ad500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:09.537917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c6cd3-e9d8-4850-a9b5-839c18ad500f admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:09.540329 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c6cd3-e9d8-4850-a9b5-839c18ad500f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:09.540865 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c6cd3-e9d8-4850-a9b5-839c18ad500f admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:09.541754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c6cd3-e9d8-4850-a9b5-839c18ad500f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:09.545915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c6cd3-e9d8-4850-a9b5-839c18ad500f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:09.614838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1199/2372] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:12:09 2022] POST /identity/v3/users => generated 292 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:12:09.618579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1864454-591b-4fe0-b638-a347281552a7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:09.633011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1864454-591b-4fe0-b638-a347281552a7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:09.646453 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fd39d-9d6f-4c0f-8a19-9b1f39647796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:09.647385 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fd39d-9d6f-4c0f-8a19-9b1f39647796 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:09.647823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fd39d-9d6f-4c0f-8a19-9b1f39647796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:09.648331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fd39d-9d6f-4c0f-8a19-9b1f39647796 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:09.649853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fd39d-9d6f-4c0f-8a19-9b1f39647796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:09.651841 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fd39d-9d6f-4c0f-8a19-9b1f39647796 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:09.675738 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1174/2373] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:12:09.680035 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c6cd3-e9d8-4850-a9b5-839c18ad500f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:09.694203 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c6cd3-e9d8-4850-a9b5-839c18ad500f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:09.701509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecada5-d544-4f6e-a08f-c7ca2f8d2180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:09.702496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecada5-d544-4f6e-a08f-c7ca2f8d2180 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:09.704913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecada5-d544-4f6e-a08f-c7ca2f8d2180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:09.705423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecada5-d544-4f6e-a08f-c7ca2f8d2180 admin admin] PATH_INFO: `/v3/projects/1bfbb0ab4eab40ad992014310dc06ce1/users/0aa1501962254cc482980a7f6fc234fc/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:09.725132 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecada5-d544-4f6e-a08f-c7ca2f8d2180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfbb0ab4eab40ad992014310dc06ce1, user_id=0aa1501962254cc482980a7f6fc234fc, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:09.728925 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecada5-d544-4f6e-a08f-c7ca2f8d2180 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:09.754380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1200/2374] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:12:09 2022] PUT /identity/v3/projects/1bfbb0ab4eab40ad992014310dc06ce1/users/0aa1501962254cc482980a7f6fc234fc/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:12:09.758631 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fd39d-9d6f-4c0f-8a19-9b1f39647796 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:09.770211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fd39d-9d6f-4c0f-8a19-9b1f39647796 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:09.927834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab51b3-aa1e-4e77-8218-bb5cf73e16c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:09.928497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab51b3-aa1e-4e77-8218-bb5cf73e16c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:09.928772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab51b3-aa1e-4e77-8218-bb5cf73e16c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:09.929176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab51b3-aa1e-4e77-8218-bb5cf73e16c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:09.929828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab51b3-aa1e-4e77-8218-bb5cf73e16c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:09.931436 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab51b3-aa1e-4e77-8218-bb5cf73e16c6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:09.956004 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1175/2375] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:12:09.957335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecada5-d544-4f6e-a08f-c7ca2f8d2180 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:09.965588 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:09.974116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecada5-d544-4f6e-a08f-c7ca2f8d2180 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:09.996015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc27d3-4bac-4847-9fc0-39537b964c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:09.996708 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc27d3-4bac-4847-9fc0-39537b964c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:09.996985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc27d3-4bac-4847-9fc0-39537b964c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:09.997250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc27d3-4bac-4847-9fc0-39537b964c2b admin admin] PATH_INFO: `/v3/projects/1bfbb0ab4eab40ad992014310dc06ce1/users/0aa1501962254cc482980a7f6fc234fc/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:10.006419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc27d3-4bac-4847-9fc0-39537b964c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfbb0ab4eab40ad992014310dc06ce1, user_id=0aa1501962254cc482980a7f6fc234fc, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:10.009559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc27d3-4bac-4847-9fc0-39537b964c2b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:10.040293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1201/2376] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:12:09 2022] PUT /identity/v3/projects/1bfbb0ab4eab40ad992014310dc06ce1/users/0aa1501962254cc482980a7f6fc234fc/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:12:12.890174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885c24e-2073-434c-b6c4-5213079a38e1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:12.890174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885c24e-2073-434c-b6c4-5213079a38e1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:12.890743 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885c24e-2073-434c-b6c4-5213079a38e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:12.929694 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:12.945548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8885c24e-2073-434c-b6c4-5213079a38e1 None None] MFA Rules not processed for user `579e12444fba41af85666356fac5415f`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:12.949781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8885c24e-2073-434c-b6c4-5213079a38e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:13.072218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50b930-af23-440d-86cd-573dcd3faca8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:13.072831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50b930-af23-440d-86cd-573dcd3faca8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:13.072831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50b930-af23-440d-86cd-573dcd3faca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:13.171048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1f50b930-af23-440d-86cd-573dcd3faca8 None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:13.175731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1f50b930-af23-440d-86cd-573dcd3faca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:13.311103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1176/2377] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:13.315578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885c24e-2073-434c-b6c4-5213079a38e1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:13.325254 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8885c24e-2073-434c-b6c4-5213079a38e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:13.411125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1202/2378] 10.222.0.48 () {58 vars in 967 bytes} [Tue Aug 30 05:12:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:12:13.444829 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50b930-af23-440d-86cd-573dcd3faca8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:13.446277 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1f50b930-af23-440d-86cd-573dcd3faca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:13.599334 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885c24e-2073-434c-b6c4-5213079a38e1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:13.610845 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b365e2-15dd-4153-a37b-b86949dbd558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:13.613812 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b365e2-15dd-4153-a37b-b86949dbd558 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:13.614270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b365e2-15dd-4153-a37b-b86949dbd558 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:13.615919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b365e2-15dd-4153-a37b-b86949dbd558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:13.630420 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50b930-af23-440d-86cd-573dcd3faca8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:13.652291 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd31ff-3443-49c2-8e34-79cb81575946 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:13.653171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd31ff-3443-49c2-8e34-79cb81575946 service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:13.653376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd31ff-3443-49c2-8e34-79cb81575946 service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:13.654197 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd31ff-3443-49c2-8e34-79cb81575946 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:13.657448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b365e2-15dd-4153-a37b-b86949dbd558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:13.661107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b365e2-15dd-4153-a37b-b86949dbd558 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:13.667038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd31ff-3443-49c2-8e34-79cb81575946 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:13.668711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd31ff-3443-49c2-8e34-79cb81575946 service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:13.679115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1203/2379] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:12:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:12:13.693540 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1177/2380] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:15.479221 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d0b3a-acfb-497f-a34c-a279dc10d74d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:15.480982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d0b3a-acfb-497f-a34c-a279dc10d74d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:15.481371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d0b3a-acfb-497f-a34c-a279dc10d74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:15.535569 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9c9d0b3a-acfb-497f-a34c-a279dc10d74d None None] MFA Rules not processed for user `579e12444fba41af85666356fac5415f`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:15.540168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9c9d0b3a-acfb-497f-a34c-a279dc10d74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:15.565048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1204/2381] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:12:18.240678 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7e16c-55e9-42a6-80e7-dc65ecc38c7f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:18.241641 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7e16c-55e9-42a6-80e7-dc65ecc38c7f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:18.241641 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7e16c-55e9-42a6-80e7-dc65ecc38c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:18.281702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5fe7e16c-55e9-42a6-80e7-dc65ecc38c7f None None] MFA Rules not processed for user `b0e4c582fefb4b92b0a2e10652de62f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:18.286042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5fe7e16c-55e9-42a6-80e7-dc65ecc38c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:18.473852 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1178/2382] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:19.342399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d0b3a-acfb-497f-a34c-a279dc10d74d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:19.344757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9c9d0b3a-acfb-497f-a34c-a279dc10d74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:19.484576 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d0b3a-acfb-497f-a34c-a279dc10d74d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:19.490540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da1266-ed4e-4720-bcba-4e5ecd541cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:19.491407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da1266-ed4e-4720-bcba-4e5ecd541cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:19.491832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da1266-ed4e-4720-bcba-4e5ecd541cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:19.492311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da1266-ed4e-4720-bcba-4e5ecd541cc3 admin admin] PATH_INFO: `/v3/users/0d76ffdd74df41bd89c380798be621a0` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:19.493750 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da1266-ed4e-4720-bcba-4e5ecd541cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d76ffdd74df41bd89c380798be621a0)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:19.542627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da1266-ed4e-4720-bcba-4e5ecd541cc3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:19.599117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:19.661646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c6da1266-ed4e-4720-bcba-4e5ecd541cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d76ffdd74df41bd89c380798be621a0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:19.673965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c6da1266-ed4e-4720-bcba-4e5ecd541cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d76ffdd74df41bd89c380798be621a0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:19.690320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c6da1266-ed4e-4720-bcba-4e5ecd541cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d76ffdd74df41bd89c380798be621a0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:19.692405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c6da1266-ed4e-4720-bcba-4e5ecd541cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d76ffdd74df41bd89c380798be621a0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:19.720954 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c6da1266-ed4e-4720-bcba-4e5ecd541cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d76ffdd74df41bd89c380798be621a0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:19.733056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1205/2383] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:12:19 2022] DELETE /identity/v3/users/0d76ffdd74df41bd89c380798be621a0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:12:19.760782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91ecb-fc16-47c6-8ebc-8ab1d86c90d2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:19.761289 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91ecb-fc16-47c6-8ebc-8ab1d86c90d2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:19.761529 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91ecb-fc16-47c6-8ebc-8ab1d86c90d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:19.818209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-dbb91ecb-fc16-47c6-8ebc-8ab1d86c90d2 None None] MFA Rules not processed for user `0aa1501962254cc482980a7f6fc234fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:19.819634 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dbb91ecb-fc16-47c6-8ebc-8ab1d86c90d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:19.877303 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:19.923596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1179/2384] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:20.003064 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da1266-ed4e-4720-bcba-4e5ecd541cc3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:20.005220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c6da1266-ed4e-4720-bcba-4e5ecd541cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:20.112456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da1266-ed4e-4720-bcba-4e5ecd541cc3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:20.123504 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe4376-4a98-43ef-9cba-b00bab3608d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:20.129456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe4376-4a98-43ef-9cba-b00bab3608d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:20.131364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe4376-4a98-43ef-9cba-b00bab3608d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:20.131847 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe4376-4a98-43ef-9cba-b00bab3608d7 admin admin] PATH_INFO: `/v3/projects/d128cc5b2a55431a934341c1015b12e5` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:20.138231 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe4376-4a98-43ef-9cba-b00bab3608d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d128cc5b2a55431a934341c1015b12e5)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:20.140730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe4376-4a98-43ef-9cba-b00bab3608d7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:20.207030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1ebe4376-4a98-43ef-9cba-b00bab3608d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd128cc5b2a55431a934341c1015b12e5', 'request_id': 'req-1ebe4376-4a98-43ef-9cba-b00bab3608d7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:20.213327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1ebe4376-4a98-43ef-9cba-b00bab3608d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd128cc5b2a55431a934341c1015b12e5', 'request_id': 'req-1ebe4376-4a98-43ef-9cba-b00bab3608d7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:20.225110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1ebe4376-4a98-43ef-9cba-b00bab3608d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd128cc5b2a55431a934341c1015b12e5', 'request_id': 'req-1ebe4376-4a98-43ef-9cba-b00bab3608d7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:20.240462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1ebe4376-4a98-43ef-9cba-b00bab3608d7 admin admin] The token cache is being invalidate because project d128cc5b2a55431a934341c1015b12e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:12:20.240749 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1ebe4376-4a98-43ef-9cba-b00bab3608d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:20.241649 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1ebe4376-4a98-43ef-9cba-b00bab3608d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:20.243415 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1206/2385] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:12:20 2022] DELETE /identity/v3/projects/d128cc5b2a55431a934341c1015b12e5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:12:20.249025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6b8e8-8e78-4875-a7ee-d0e45be7ec34 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:20.249314 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6b8e8-8e78-4875-a7ee-d0e45be7ec34 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:20.249588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6b8e8-8e78-4875-a7ee-d0e45be7ec34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:20.277167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-35d6b8e8-8e78-4875-a7ee-d0e45be7ec34 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:20.279602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-35d6b8e8-8e78-4875-a7ee-d0e45be7ec34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:20.349808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1180/2386] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:12:20.358036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42f627-97f5-408f-adc3-ff1cf5bc9226 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:20.359429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42f627-97f5-408f-adc3-ff1cf5bc9226 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:20.359979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42f627-97f5-408f-adc3-ff1cf5bc9226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:20.389506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2b42f627-97f5-408f-adc3-ff1cf5bc9226 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:20.390738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2b42f627-97f5-408f-adc3-ff1cf5bc9226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:20.400019 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1207/2387] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:20.409725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6b8e8-8e78-4875-a7ee-d0e45be7ec34 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:20.410156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42f627-97f5-408f-adc3-ff1cf5bc9226 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:20.411159 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-35d6b8e8-8e78-4875-a7ee-d0e45be7ec34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:20.438675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42f627-97f5-408f-adc3-ff1cf5bc9226 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:20.443861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693578b5-bee5-434a-b739-6bf434d2c463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:20.444571 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693578b5-bee5-434a-b739-6bf434d2c463 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:20.444795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693578b5-bee5-434a-b739-6bf434d2c463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:20.445070 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693578b5-bee5-434a-b739-6bf434d2c463 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:20.446346 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693578b5-bee5-434a-b739-6bf434d2c463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:12:20.446346 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693578b5-bee5-434a-b739-6bf434d2c463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:20.447804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693578b5-bee5-434a-b739-6bf434d2c463 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:20.470900 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1208/2388] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:12:20.471989 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693578b5-bee5-434a-b739-6bf434d2c463 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:20.483202 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693578b5-bee5-434a-b739-6bf434d2c463 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:20.489448 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac610e3c-15f5-46ca-bad0-4807744107b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:20.490316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac610e3c-15f5-46ca-bad0-4807744107b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:20.490707 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac610e3c-15f5-46ca-bad0-4807744107b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:20.491104 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac610e3c-15f5-46ca-bad0-4807744107b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:20.492609 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac610e3c-15f5-46ca-bad0-4807744107b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:20.495534 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac610e3c-15f5-46ca-bad0-4807744107b0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:20.504547 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:20.540045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1209/2389] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:12:20 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:12:20.540267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6b8e8-8e78-4875-a7ee-d0e45be7ec34 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:20.541357 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac610e3c-15f5-46ca-bad0-4807744107b0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:20.642501 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac610e3c-15f5-46ca-bad0-4807744107b0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:20.648170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57164144-7e7b-4ba2-9d4d-aefe355d34e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:20.649091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57164144-7e7b-4ba2-9d4d-aefe355d34e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:20.649222 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57164144-7e7b-4ba2-9d4d-aefe355d34e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:20.649512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57164144-7e7b-4ba2-9d4d-aefe355d34e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:20.650152 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969ae58-c818-4473-a0fc-760b5667a4ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:20.650293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57164144-7e7b-4ba2-9d4d-aefe355d34e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:20.650854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969ae58-c818-4473-a0fc-760b5667a4ce service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:20.651209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969ae58-c818-4473-a0fc-760b5667a4ce service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:20.651804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969ae58-c818-4473-a0fc-760b5667a4ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:20.652623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57164144-7e7b-4ba2-9d4d-aefe355d34e6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:20.654381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3969ae58-c818-4473-a0fc-760b5667a4ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:20.668212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:20.695598 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1210/2390] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:12:20 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:12:20.698026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57164144-7e7b-4ba2-9d4d-aefe355d34e6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:20.716350 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57164144-7e7b-4ba2-9d4d-aefe355d34e6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:20.723163 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cfff1-7e5a-4fe3-a8e0-27a092abaaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:20.723843 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cfff1-7e5a-4fe3-a8e0-27a092abaaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:20.724151 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cfff1-7e5a-4fe3-a8e0-27a092abaaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:20.724417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cfff1-7e5a-4fe3-a8e0-27a092abaaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:20.739423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cfff1-7e5a-4fe3-a8e0-27a092abaaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:20.743432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cfff1-7e5a-4fe3-a8e0-27a092abaaf4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:20.770013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1211/2391] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:12:20.771414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cfff1-7e5a-4fe3-a8e0-27a092abaaf4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:20.788555 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969ae58-c818-4473-a0fc-760b5667a4ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:20.792120 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969ae58-c818-4473-a0fc-760b5667a4ce service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:20.802427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1181/2392] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:20.816211 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cfff1-7e5a-4fe3-a8e0-27a092abaaf4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:20.821941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cf3fc-eb79-45f3-977d-cb19459dcc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:20.822962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cf3fc-eb79-45f3-977d-cb19459dcc93 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:20.823416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cf3fc-eb79-45f3-977d-cb19459dcc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:20.823845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cf3fc-eb79-45f3-977d-cb19459dcc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:20.826492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cf3fc-eb79-45f3-977d-cb19459dcc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:20.827272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cf3fc-eb79-45f3-977d-cb19459dcc93 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:20.862975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1212/2393] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:12:20.864974 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969ae58-c818-4473-a0fc-760b5667a4ce service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:20.895605 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969ae58-c818-4473-a0fc-760b5667a4ce service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:20.913654 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74479507-dc6d-4d37-9eea-44638541f5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:20.914513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74479507-dc6d-4d37-9eea-44638541f5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:20.914936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74479507-dc6d-4d37-9eea-44638541f5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:20.915371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74479507-dc6d-4d37-9eea-44638541f5eb admin admin] PATH_INFO: `/v3/projects/ee2fab726ea44d66819e8988b6f55f79/users/28723a68259e493389b3a678c7df3e3d/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:20.986005 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74479507-dc6d-4d37-9eea-44638541f5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee2fab726ea44d66819e8988b6f55f79, user_id=28723a68259e493389b3a678c7df3e3d, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:20.997438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74479507-dc6d-4d37-9eea-44638541f5eb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:21.019496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1182/2394] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:12:20 2022] PUT /identity/v3/projects/ee2fab726ea44d66819e8988b6f55f79/users/28723a68259e493389b3a678c7df3e3d/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:12:21.033035 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c1447-c5e3-4135-a35c-ea90a4eeb537 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:21.033035 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c1447-c5e3-4135-a35c-ea90a4eeb537 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:21.033035 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c1447-c5e3-4135-a35c-ea90a4eeb537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:21.103789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-015c1447-c5e3-4135-a35c-ea90a4eeb537 None None] MFA Rules not processed for user `28723a68259e493389b3a678c7df3e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:21.105120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-015c1447-c5e3-4135-a35c-ea90a4eeb537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:21.231296 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1213/2395] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:21.242992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74479507-dc6d-4d37-9eea-44638541f5eb admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:21.244805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-74479507-dc6d-4d37-9eea-44638541f5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:21.401622 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74479507-dc6d-4d37-9eea-44638541f5eb admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:21.410716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4eda3-bad4-4951-ad24-a7a72b38021d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d3889156524b388b761cedfac8ed6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:21.411961 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4eda3-bad4-4951-ad24-a7a72b38021d service glance] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:21.412520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4eda3-bad4-4951-ad24-a7a72b38021d service glance] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:21.413317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4eda3-bad4-4951-ad24-a7a72b38021d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:21.423991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4eda3-bad4-4951-ad24-a7a72b38021d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:21.425848 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4eda3-bad4-4951-ad24-a7a72b38021d service glance] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:21.451002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1183/2396] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:22.909455 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0399e4d-9e77-44ab-ac66-0b7db15293a9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:22.910527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0399e4d-9e77-44ab-ac66-0b7db15293a9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:22.911277 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0399e4d-9e77-44ab-ac66-0b7db15293a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:22.945905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f0399e4d-9e77-44ab-ac66-0b7db15293a9 None None] MFA Rules not processed for user `bbd08b29c5d64ecbb7f2dbfbd328d0c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:22.947923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f0399e4d-9e77-44ab-ac66-0b7db15293a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:23.050704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:23.095834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1214/2397] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:24.381030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617c789-64fa-4fb0-a629-af6044fe9542 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:24.381638 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617c789-64fa-4fb0-a629-af6044fe9542 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:24.381638 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617c789-64fa-4fb0-a629-af6044fe9542 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:24.384008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1184/2398] 10.222.0.48 () {54 vars in 921 bytes} [Tue Aug 30 05:12:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:12:24.414687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c708341-b647-4d56-a5aa-d7314ef9027e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:24.415599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c708341-b647-4d56-a5aa-d7314ef9027e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:24.416053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c708341-b647-4d56-a5aa-d7314ef9027e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:24.457641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5c708341-b647-4d56-a5aa-d7314ef9027e None None] MFA Rules not processed for user `1aa002909502426b80c97dbf05dca008`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:24.460301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5c708341-b647-4d56-a5aa-d7314ef9027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:24.693974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1215/2399] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Aug 30 05:12:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:31.436523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=59,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:34.671150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=37 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:35.335743 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617c789-64fa-4fb0-a629-af6044fe9542 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:35.337746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7617c789-64fa-4fb0-a629-af6044fe9542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:35.422209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617c789-64fa-4fb0-a629-af6044fe9542 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:35.426218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7996e-e39a-4a95-9ea5-0ee10c3f8c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:35.426979 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7996e-e39a-4a95-9ea5-0ee10c3f8c4c service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:35.427253 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7996e-e39a-4a95-9ea5-0ee10c3f8c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:35.427782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7996e-e39a-4a95-9ea5-0ee10c3f8c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:35.430358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4dd7996e-e39a-4a95-9ea5-0ee10c3f8c4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:35.501623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7996e-e39a-4a95-9ea5-0ee10c3f8c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:35.503144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7996e-e39a-4a95-9ea5-0ee10c3f8c4c service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:35.513759 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1185/2400] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:39.311328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c708341-b647-4d56-a5aa-d7314ef9027e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:39.315927 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5c708341-b647-4d56-a5aa-d7314ef9027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:39.333371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c708341-b647-4d56-a5aa-d7314ef9027e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:39.337006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925b5c0-03a2-4dea-91e0-dd8e491726f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d3889156524b388b761cedfac8ed6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:39.346594 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925b5c0-03a2-4dea-91e0-dd8e491726f9 service glance] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:39.346877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925b5c0-03a2-4dea-91e0-dd8e491726f9 service glance] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:39.347152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925b5c0-03a2-4dea-91e0-dd8e491726f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:39.361976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925b5c0-03a2-4dea-91e0-dd8e491726f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:39.363463 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925b5c0-03a2-4dea-91e0-dd8e491726f9 service glance] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:39.377702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1216/2401] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:39.507792 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e945bb-e7c6-4505-8796-64789032e6ff None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:39.509740 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e945bb-e7c6-4505-8796-64789032e6ff None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:39.510183 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e945bb-e7c6-4505-8796-64789032e6ff None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:39.513054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1186/2402] 10.222.0.48 () {54 vars in 921 bytes} [Tue Aug 30 05:12:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:12:39.518362 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cfeab-cc63-4e36-a800-47990bd722f6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:39.518833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cfeab-cc63-4e36-a800-47990bd722f6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:39.519276 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cfeab-cc63-4e36-a800-47990bd722f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:39.546160 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-581cfeab-cc63-4e36-a800-47990bd722f6 None None] MFA Rules not processed for user `4398d5175c8c409789d62c277da35ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:39.547537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-581cfeab-cc63-4e36-a800-47990bd722f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:39.568725 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1217/2403] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Aug 30 05:12:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:39.584974 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e945bb-e7c6-4505-8796-64789032e6ff None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:39.602543 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e945bb-e7c6-4505-8796-64789032e6ff None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:39.616175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf7063-5122-4f9b-8e29-b766f5ca7868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:39.617072 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf7063-5122-4f9b-8e29-b766f5ca7868 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:39.617508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf7063-5122-4f9b-8e29-b766f5ca7868 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:39.617983 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf7063-5122-4f9b-8e29-b766f5ca7868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:39.637457 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf7063-5122-4f9b-8e29-b766f5ca7868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:39.639186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf7063-5122-4f9b-8e29-b766f5ca7868 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:39.675108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1187/2404] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:39.800251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cb3dd-8027-4aa1-81d6-3bffa6249c57 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:39.801295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cb3dd-8027-4aa1-81d6-3bffa6249c57 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:39.801842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cb3dd-8027-4aa1-81d6-3bffa6249c57 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:39.804792 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1218/2405] 10.222.0.48 () {54 vars in 921 bytes} [Tue Aug 30 05:12:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:12:39.809956 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c4c57-53c7-4f12-b7be-8313801b84e7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:39.810566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c4c57-53c7-4f12-b7be-8313801b84e7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:39.810815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c4c57-53c7-4f12-b7be-8313801b84e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:39.855101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-cd9c4c57-53c7-4f12-b7be-8313801b84e7 None None] MFA Rules not processed for user `1aa002909502426b80c97dbf05dca008`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:39.857434 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cd9c4c57-53c7-4f12-b7be-8313801b84e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:39.878341 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1188/2406] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Aug 30 05:12:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:39.905450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cb3dd-8027-4aa1-81d6-3bffa6249c57 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:39.927192 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cb3dd-8027-4aa1-81d6-3bffa6249c57 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:39.939992 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205a46-b598-437f-a84a-8b695779f377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:39.941084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205a46-b598-437f-a84a-8b695779f377 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:39.941516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205a46-b598-437f-a84a-8b695779f377 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:39.941878 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205a46-b598-437f-a84a-8b695779f377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:39.954914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205a46-b598-437f-a84a-8b695779f377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:39.956483 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205a46-b598-437f-a84a-8b695779f377 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:39.976360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1219/2407] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:41.554621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c4c57-53c7-4f12-b7be-8313801b84e7 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:41.559384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cd9c4c57-53c7-4f12-b7be-8313801b84e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:41.655327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205a46-b598-437f-a84a-8b695779f377 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:41.657620 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-82205a46-b598-437f-a84a-8b695779f377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:41.673843 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c4c57-53c7-4f12-b7be-8313801b84e7 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:41.679768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205a46-b598-437f-a84a-8b695779f377 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:41.681354 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2c57d-053f-4a40-b957-5bd7dc8a3460 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed835047051142d2bc98bb1564e3a98f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:41.682194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c57d-053f-4a40-b957-5bd7dc8a3460 service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:41.682583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c57d-053f-4a40-b957-5bd7dc8a3460 service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:41.683031 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c57d-053f-4a40-b957-5bd7dc8a3460 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:41.685765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1fd2c57d-053f-4a40-b957-5bd7dc8a3460 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:41.688726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f13537-f13b-43ac-ab22-f1961cd7eae6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed835047051142d2bc98bb1564e3a98f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:41.689610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f13537-f13b-43ac-ab22-f1961cd7eae6 service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:41.689949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f13537-f13b-43ac-ab22-f1961cd7eae6 service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:41.690433 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f13537-f13b-43ac-ab22-f1961cd7eae6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:41.692878 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-94f13537-f13b-43ac-ab22-f1961cd7eae6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:41.704155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2c57d-053f-4a40-b957-5bd7dc8a3460 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:41.705877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2c57d-053f-4a40-b957-5bd7dc8a3460 service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:41.715741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f13537-f13b-43ac-ab22-f1961cd7eae6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:41.717669 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f13537-f13b-43ac-ab22-f1961cd7eae6 service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:41.726208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1189/2408] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:41.734105 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1220/2409] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:12:45.156606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688d1d7-e22d-45ea-b491-db58a034f740 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:45.156606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688d1d7-e22d-45ea-b491-db58a034f740 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:45.157129 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688d1d7-e22d-45ea-b491-db58a034f740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:45.177039 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b688d1d7-e22d-45ea-b491-db58a034f740 None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:45.178454 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b688d1d7-e22d-45ea-b491-db58a034f740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:45.192874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:45.243093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1190/2410] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Aug 30 05:12:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:45.267725 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f13537-f13b-43ac-ab22-f1961cd7eae6 service placement] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:45.269215 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-94f13537-f13b-43ac-ab22-f1961cd7eae6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:45.350884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f13537-f13b-43ac-ab22-f1961cd7eae6 service placement] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:45.357064 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1a96a-6ea4-43c5-9129-9349f741455f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:45.357668 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1a96a-6ea4-43c5-9129-9349f741455f service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:45.357952 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1a96a-6ea4-43c5-9129-9349f741455f service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:45.358225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1a96a-6ea4-43c5-9129-9349f741455f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:45.367389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1a96a-6ea4-43c5-9129-9349f741455f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:45.369122 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1a96a-6ea4-43c5-9129-9349f741455f service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:45.380641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1221/2411] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:12:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:12:52.687377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688d1d7-e22d-45ea-b491-db58a034f740 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:52.763001 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688d1d7-e22d-45ea-b491-db58a034f740 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:52.768197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd156b-a1a4-4e95-a6f8-fcac6db2a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:52.768950 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd156b-a1a4-4e95-a6f8-fcac6db2a39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:52.769226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd156b-a1a4-4e95-a6f8-fcac6db2a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:52.770335 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd156b-a1a4-4e95-a6f8-fcac6db2a39f admin admin] PATH_INFO: `/v3/users/28723a68259e493389b3a678c7df3e3d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:52.771469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd156b-a1a4-4e95-a6f8-fcac6db2a39f admin admin] RBAC: Authorizing `identity:delete_user(user_id=28723a68259e493389b3a678c7df3e3d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:52.774537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd156b-a1a4-4e95-a6f8-fcac6db2a39f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:52.833859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-10bd156b-a1a4-4e95-a6f8-fcac6db2a39f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28723a68259e493389b3a678c7df3e3d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:52.857205 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-10bd156b-a1a4-4e95-a6f8-fcac6db2a39f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28723a68259e493389b3a678c7df3e3d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:52.865255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-10bd156b-a1a4-4e95-a6f8-fcac6db2a39f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28723a68259e493389b3a678c7df3e3d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:52.865991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-10bd156b-a1a4-4e95-a6f8-fcac6db2a39f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28723a68259e493389b3a678c7df3e3d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:52.867218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-10bd156b-a1a4-4e95-a6f8-fcac6db2a39f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28723a68259e493389b3a678c7df3e3d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:52.883493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1191/2412] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:12:52 2022] DELETE /identity/v3/users/28723a68259e493389b3a678c7df3e3d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:12:52.888699 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5d457-4a98-4426-ac8f-66593070f816 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:52.889152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5d457-4a98-4426-ac8f-66593070f816 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:52.889256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5d457-4a98-4426-ac8f-66593070f816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:52.914590 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-74f5d457-4a98-4426-ac8f-66593070f816 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:52.916036 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-74f5d457-4a98-4426-ac8f-66593070f816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:53.000253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1222/2413] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:53.011069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd156b-a1a4-4e95-a6f8-fcac6db2a39f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:53.015526 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-10bd156b-a1a4-4e95-a6f8-fcac6db2a39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:53.101251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:53.122055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd156b-a1a4-4e95-a6f8-fcac6db2a39f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:53.126631 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fc372-371b-44c2-bb88-4ca22684550e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:53.127299 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fc372-371b-44c2-bb88-4ca22684550e service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:53.127573 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fc372-371b-44c2-bb88-4ca22684550e service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:53.127842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fc372-371b-44c2-bb88-4ca22684550e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:53.140024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fc372-371b-44c2-bb88-4ca22684550e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:53.141623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fc372-371b-44c2-bb88-4ca22684550e service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:53.157082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1192/2414] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:53.503833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5d457-4a98-4426-ac8f-66593070f816 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:53.505976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-74f5d457-4a98-4426-ac8f-66593070f816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:53.519814 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5d457-4a98-4426-ac8f-66593070f816 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:53.525616 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade7d48-db1e-4cc9-9a4d-7c75354d74e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:53.526324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade7d48-db1e-4cc9-9a4d-7c75354d74e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:53.526986 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade7d48-db1e-4cc9-9a4d-7c75354d74e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:53.527747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade7d48-db1e-4cc9-9a4d-7c75354d74e4 admin admin] PATH_INFO: `/v3/projects/ee2fab726ea44d66819e8988b6f55f79` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:53.529564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade7d48-db1e-4cc9-9a4d-7c75354d74e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee2fab726ea44d66819e8988b6f55f79)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:53.533027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade7d48-db1e-4cc9-9a4d-7c75354d74e4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:53.607777 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:53.622981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-eade7d48-db1e-4cc9-9a4d-7c75354d74e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee2fab726ea44d66819e8988b6f55f79', 'request_id': 'req-eade7d48-db1e-4cc9-9a4d-7c75354d74e4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:53.630126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-eade7d48-db1e-4cc9-9a4d-7c75354d74e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee2fab726ea44d66819e8988b6f55f79', 'request_id': 'req-eade7d48-db1e-4cc9-9a4d-7c75354d74e4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:53.639334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-eade7d48-db1e-4cc9-9a4d-7c75354d74e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee2fab726ea44d66819e8988b6f55f79', 'request_id': 'req-eade7d48-db1e-4cc9-9a4d-7c75354d74e4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:53.656884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-eade7d48-db1e-4cc9-9a4d-7c75354d74e4 admin admin] The token cache is being invalidate because project ee2fab726ea44d66819e8988b6f55f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:12:53.657177 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-eade7d48-db1e-4cc9-9a4d-7c75354d74e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:53.658133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-eade7d48-db1e-4cc9-9a4d-7c75354d74e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:12:53.659769 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1223/2415] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:12:53 2022] DELETE /identity/v3/projects/ee2fab726ea44d66819e8988b6f55f79 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:12:53.665122 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610a75d-dd40-4795-93ae-bcd7c361981b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:53.665434 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610a75d-dd40-4795-93ae-bcd7c361981b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:53.665718 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610a75d-dd40-4795-93ae-bcd7c361981b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:53.690506 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7610a75d-dd40-4795-93ae-bcd7c361981b None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:53.691231 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7610a75d-dd40-4795-93ae-bcd7c361981b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:53.765351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1193/2416] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:53.774453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16172a95-a35e-4eec-91cb-b0b0c108b763 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:53.774729 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16172a95-a35e-4eec-91cb-b0b0c108b763 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:53.774999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16172a95-a35e-4eec-91cb-b0b0c108b763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:53.799256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-16172a95-a35e-4eec-91cb-b0b0c108b763 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:53.800423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-16172a95-a35e-4eec-91cb-b0b0c108b763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:53.812884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1224/2417] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:53.817726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610a75d-dd40-4795-93ae-bcd7c361981b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:53.829960 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610a75d-dd40-4795-93ae-bcd7c361981b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:53.835166 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20386e9f-c4fa-41af-857f-1e6f037205de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:53.836023 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20386e9f-c4fa-41af-857f-1e6f037205de admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:53.836305 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20386e9f-c4fa-41af-857f-1e6f037205de admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:53.836578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20386e9f-c4fa-41af-857f-1e6f037205de admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:53.837243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20386e9f-c4fa-41af-857f-1e6f037205de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:12:53.837542 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20386e9f-c4fa-41af-857f-1e6f037205de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:53.839159 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20386e9f-c4fa-41af-857f-1e6f037205de admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:53.857029 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1194/2418] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:12:53.859051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16172a95-a35e-4eec-91cb-b0b0c108b763 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:53.869248 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16172a95-a35e-4eec-91cb-b0b0c108b763 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:53.882771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be4479-af33-470a-bed9-f2347804ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:53.883407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be4479-af33-470a-bed9-f2347804ac71 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:53.883683 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be4479-af33-470a-bed9-f2347804ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:53.883974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be4479-af33-470a-bed9-f2347804ac71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:53.884658 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be4479-af33-470a-bed9-f2347804ac71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:53.886727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be4479-af33-470a-bed9-f2347804ac71 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:53.926080 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1225/2419] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:12:53 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:12:53.930835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20386e9f-c4fa-41af-857f-1e6f037205de admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:53.942679 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20386e9f-c4fa-41af-857f-1e6f037205de admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:54.029109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95eabd-ce3c-4919-8757-f37a069241b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:54.029728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95eabd-ce3c-4919-8757-f37a069241b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:54.030004 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95eabd-ce3c-4919-8757-f37a069241b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:54.030274 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95eabd-ce3c-4919-8757-f37a069241b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:54.030928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95eabd-ce3c-4919-8757-f37a069241b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:54.033252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95eabd-ce3c-4919-8757-f37a069241b2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:54.063500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1195/2420] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:12:53 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:12:54.065938 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be4479-af33-470a-bed9-f2347804ac71 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:54.081224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be4479-af33-470a-bed9-f2347804ac71 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:54.089071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044577ff-8803-4713-bee3-65326a6eca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:54.092899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044577ff-8803-4713-bee3-65326a6eca7c admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:54.092899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044577ff-8803-4713-bee3-65326a6eca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:54.092899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044577ff-8803-4713-bee3-65326a6eca7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:54.093269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044577ff-8803-4713-bee3-65326a6eca7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:54.095809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044577ff-8803-4713-bee3-65326a6eca7c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:54.116008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1226/2421] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:12:54.117515 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95eabd-ce3c-4919-8757-f37a069241b2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:54.131516 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95eabd-ce3c-4919-8757-f37a069241b2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:54.136967 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf6449-eab8-41cc-aac0-09e9c8eea274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:54.137611 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf6449-eab8-41cc-aac0-09e9c8eea274 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:54.137932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf6449-eab8-41cc-aac0-09e9c8eea274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:54.138250 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf6449-eab8-41cc-aac0-09e9c8eea274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:54.138819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf6449-eab8-41cc-aac0-09e9c8eea274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:54.140480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf6449-eab8-41cc-aac0-09e9c8eea274 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:54.153350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1196/2422] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:12:54.158015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044577ff-8803-4713-bee3-65326a6eca7c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:54.169763 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044577ff-8803-4713-bee3-65326a6eca7c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:54.174674 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e4555-6cf6-4344-80e8-d166a5e6cebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:54.175354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e4555-6cf6-4344-80e8-d166a5e6cebe admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:54.175634 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e4555-6cf6-4344-80e8-d166a5e6cebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:54.175910 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e4555-6cf6-4344-80e8-d166a5e6cebe admin admin] PATH_INFO: `/v3/projects/eb445f437b3742d2a885d94d1646e959/users/870f51868d6b408d810720be18bb9499/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:54.192771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e4555-6cf6-4344-80e8-d166a5e6cebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb445f437b3742d2a885d94d1646e959, user_id=870f51868d6b408d810720be18bb9499, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:54.195608 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e4555-6cf6-4344-80e8-d166a5e6cebe admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:54.222455 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1227/2423] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:12:54 2022] PUT /identity/v3/projects/eb445f437b3742d2a885d94d1646e959/users/870f51868d6b408d810720be18bb9499/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:12:54.224406 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c29565-96e0-4739-b46a-57e517ab7431 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:54.224689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c29565-96e0-4739-b46a-57e517ab7431 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:54.224967 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c29565-96e0-4739-b46a-57e517ab7431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:54.268236 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-01c29565-96e0-4739-b46a-57e517ab7431 None None] MFA Rules not processed for user `870f51868d6b408d810720be18bb9499`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:54.269238 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-01c29565-96e0-4739-b46a-57e517ab7431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:54.351551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:54.380970 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1197/2424] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:12:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:54.394423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e4555-6cf6-4344-80e8-d166a5e6cebe admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:54.397135 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ec5e4555-6cf6-4344-80e8-d166a5e6cebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:54.507232 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e4555-6cf6-4344-80e8-d166a5e6cebe admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:54.512024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e07234-8631-4c4a-b536-fd813fdd8f6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:54.512624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e07234-8631-4c4a-b536-fd813fdd8f6f service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:54.512942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e07234-8631-4c4a-b536-fd813fdd8f6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:54.513269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e07234-8631-4c4a-b536-fd813fdd8f6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:54.528017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e07234-8631-4c4a-b536-fd813fdd8f6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:54.530131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e07234-8631-4c4a-b536-fd813fdd8f6f service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:54.541139 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1228/2425] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:13:04.222929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18306fc7-ce89-4b17-ba50-8ec97d92f9d4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:04.223542 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18306fc7-ce89-4b17-ba50-8ec97d92f9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:04.223542 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18306fc7-ce89-4b17-ba50-8ec97d92f9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:04.246871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-18306fc7-ce89-4b17-ba50-8ec97d92f9d4 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:04.248874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-18306fc7-ce89-4b17-ba50-8ec97d92f9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:04.350343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1198/2426] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Aug 30 05:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:13:04.373991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e07234-8631-4c4a-b536-fd813fdd8f6f service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:04.380010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e9e07234-8631-4c4a-b536-fd813fdd8f6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:04.497037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:04.502814 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e07234-8631-4c4a-b536-fd813fdd8f6f service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:04.512429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eae44b-a107-42f7-9f6a-80f729746d05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:04.514193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eae44b-a107-42f7-9f6a-80f729746d05 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:04.514640 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eae44b-a107-42f7-9f6a-80f729746d05 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:04.515072 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eae44b-a107-42f7-9f6a-80f729746d05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:04.527222 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eae44b-a107-42f7-9f6a-80f729746d05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:04.529554 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eae44b-a107-42f7-9f6a-80f729746d05 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:04.542368 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1229/2427] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:13:06.199726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd96fe-0e12-4e75-b754-5c92167d781d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:06.200230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd96fe-0e12-4e75-b754-5c92167d781d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:06.200320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd96fe-0e12-4e75-b754-5c92167d781d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:06.223043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-06dd96fe-0e12-4e75-b754-5c92167d781d None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:06.224452 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-06dd96fe-0e12-4e75-b754-5c92167d781d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:06.292542 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1199/2428] 10.222.0.48 () {58 vars in 967 bytes} [Tue Aug 30 05:13:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:13:06.306835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eae44b-a107-42f7-9f6a-80f729746d05 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:06.308351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-73eae44b-a107-42f7-9f6a-80f729746d05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:06.383899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eae44b-a107-42f7-9f6a-80f729746d05 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:06.388950 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1b9dd-0cee-430b-a508-968ac83d7088 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:06.389579 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1b9dd-0cee-430b-a508-968ac83d7088 service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:06.389859 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1b9dd-0cee-430b-a508-968ac83d7088 service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:06.390127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1b9dd-0cee-430b-a508-968ac83d7088 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:06.399116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1b9dd-0cee-430b-a508-968ac83d7088 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:06.400735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1b9dd-0cee-430b-a508-968ac83d7088 service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:06.409910 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1230/2429] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:13:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:13:10.150492 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df610e-0148-4330-a666-a5606f9e84d0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:10.150979 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df610e-0148-4330-a666-a5606f9e84d0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:10.151075 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df610e-0148-4330-a666-a5606f9e84d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:10.170953 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-27df610e-0148-4330-a666-a5606f9e84d0 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:10.172160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-27df610e-0148-4330-a666-a5606f9e84d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:10.180284 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1200/2430] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Aug 30 05:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:13:10.195061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1b9dd-0cee-430b-a508-968ac83d7088 service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:10.207509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1b9dd-0cee-430b-a508-968ac83d7088 service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:10.212836 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d99e4-ed88-49e9-8b5b-ed5c0576d616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:10.213424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d99e4-ed88-49e9-8b5b-ed5c0576d616 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:10.213700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d99e4-ed88-49e9-8b5b-ed5c0576d616 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:10.213987 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d99e4-ed88-49e9-8b5b-ed5c0576d616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:10.222525 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d99e4-ed88-49e9-8b5b-ed5c0576d616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:10.224837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d99e4-ed88-49e9-8b5b-ed5c0576d616 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:10.236873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1231/2431] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:13:13.441817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd616cf-4d8a-4f73-be94-9be6c912459a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:13.442332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd616cf-4d8a-4f73-be94-9be6c912459a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:13.442332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd616cf-4d8a-4f73-be94-9be6c912459a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:13.463219 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6dd616cf-4d8a-4f73-be94-9be6c912459a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:13.464438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6dd616cf-4d8a-4f73-be94-9be6c912459a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:13.473658 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1201/2432] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Aug 30 05:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:13:13.492072 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d99e4-ed88-49e9-8b5b-ed5c0576d616 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:13.503683 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d99e4-ed88-49e9-8b5b-ed5c0576d616 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:13.509456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c40e4-8201-46f0-aa5e-c504a6c7ac78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:13.511201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c40e4-8201-46f0-aa5e-c504a6c7ac78 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:13.511201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c40e4-8201-46f0-aa5e-c504a6c7ac78 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:13.511201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c40e4-8201-46f0-aa5e-c504a6c7ac78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:13.524503 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c40e4-8201-46f0-aa5e-c504a6c7ac78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:13.526170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c40e4-8201-46f0-aa5e-c504a6c7ac78 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:13.542915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1232/2433] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:13:17.533796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e2155-0293-4806-ab7f-7ae451c7ad75 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:17.534326 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e2155-0293-4806-ab7f-7ae451c7ad75 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:17.534326 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e2155-0293-4806-ab7f-7ae451c7ad75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:17.553752 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a07e2155-0293-4806-ab7f-7ae451c7ad75 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:17.554944 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a07e2155-0293-4806-ab7f-7ae451c7ad75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:17.562620 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1202/2434] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Aug 30 05:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:13:17.582753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c40e4-8201-46f0-aa5e-c504a6c7ac78 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:17.584244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f26c40e4-8201-46f0-aa5e-c504a6c7ac78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:17.599327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c40e4-8201-46f0-aa5e-c504a6c7ac78 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:17.604736 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798342f0-b956-4d40-b805-e37bfc025922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:17.605322 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798342f0-b956-4d40-b805-e37bfc025922 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:17.605603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798342f0-b956-4d40-b805-e37bfc025922 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:17.605870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798342f0-b956-4d40-b805-e37bfc025922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:17.615562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798342f0-b956-4d40-b805-e37bfc025922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:17.617175 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798342f0-b956-4d40-b805-e37bfc025922 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:17.626611 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1233/2435] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:13:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:13:19.805668 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e2155-0293-4806-ab7f-7ae451c7ad75 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:19.807081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a07e2155-0293-4806-ab7f-7ae451c7ad75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:19.863772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e2155-0293-4806-ab7f-7ae451c7ad75 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:19.867525 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aee5d1-eb04-440f-9b96-8e282376f878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:19.868169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee5d1-eb04-440f-9b96-8e282376f878 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:19.868450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee5d1-eb04-440f-9b96-8e282376f878 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:19.868715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee5d1-eb04-440f-9b96-8e282376f878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:19.870484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-93aee5d1-eb04-440f-9b96-8e282376f878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:19.892074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:19.936217 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aee5d1-eb04-440f-9b96-8e282376f878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:19.937774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aee5d1-eb04-440f-9b96-8e282376f878 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:19.948746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1203/2436] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:13:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:13:21.739604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3b755-20d1-4ee5-b89b-2999dd9f6dab None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:21.740239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3b755-20d1-4ee5-b89b-2999dd9f6dab None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:21.740416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3b755-20d1-4ee5-b89b-2999dd9f6dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:21.763091 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-dde3b755-20d1-4ee5-b89b-2999dd9f6dab None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:21.764889 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-dde3b755-20d1-4ee5-b89b-2999dd9f6dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:21.773589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1234/2437] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Aug 30 05:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:13:21.874745 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aee5d1-eb04-440f-9b96-8e282376f878 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:21.888278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aee5d1-eb04-440f-9b96-8e282376f878 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:21.894280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c95448-23df-4d2e-9fcf-47107c68fd33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:21.895004 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c95448-23df-4d2e-9fcf-47107c68fd33 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:21.895375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c95448-23df-4d2e-9fcf-47107c68fd33 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:21.895886 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c95448-23df-4d2e-9fcf-47107c68fd33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:21.906239 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c95448-23df-4d2e-9fcf-47107c68fd33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:21.908002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c95448-23df-4d2e-9fcf-47107c68fd33 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:21.917906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1204/2438] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:13:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:13:27.020397 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb40433-e96d-47bf-b5f1-e215d2911fff None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:27.020994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb40433-e96d-47bf-b5f1-e215d2911fff None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:27.021108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb40433-e96d-47bf-b5f1-e215d2911fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:27.044836 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8bb40433-e96d-47bf-b5f1-e215d2911fff None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:27.046575 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8bb40433-e96d-47bf-b5f1-e215d2911fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:27.060985 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1235/2439] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Aug 30 05:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:13:27.087687 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c95448-23df-4d2e-9fcf-47107c68fd33 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:27.102069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c95448-23df-4d2e-9fcf-47107c68fd33 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:27.111685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed1f16-3cfd-410b-9974-3279f138f42f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:27.112611 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed1f16-3cfd-410b-9974-3279f138f42f service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:27.113061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed1f16-3cfd-410b-9974-3279f138f42f service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:27.113570 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed1f16-3cfd-410b-9974-3279f138f42f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:27.125582 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed1f16-3cfd-410b-9974-3279f138f42f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:27.127711 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed1f16-3cfd-410b-9974-3279f138f42f service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:27.139769 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1205/2440] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:13:29.428853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb40433-e96d-47bf-b5f1-e215d2911fff None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:29.438442 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb40433-e96d-47bf-b5f1-e215d2911fff None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:29.443011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937b9fa-b493-4cc7-b851-58a5a3f9a456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:29.443644 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937b9fa-b493-4cc7-b851-58a5a3f9a456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:29.443917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937b9fa-b493-4cc7-b851-58a5a3f9a456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:29.444216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937b9fa-b493-4cc7-b851-58a5a3f9a456 admin admin] PATH_INFO: `/v3/users/870f51868d6b408d810720be18bb9499` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:29.445334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937b9fa-b493-4cc7-b851-58a5a3f9a456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870f51868d6b408d810720be18bb9499)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:29.447262 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937b9fa-b493-4cc7-b851-58a5a3f9a456 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:29.497357 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a937b9fa-b493-4cc7-b851-58a5a3f9a456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870f51868d6b408d810720be18bb9499'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:29.504058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a937b9fa-b493-4cc7-b851-58a5a3f9a456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870f51868d6b408d810720be18bb9499'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:29.511643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a937b9fa-b493-4cc7-b851-58a5a3f9a456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870f51868d6b408d810720be18bb9499'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:29.512262 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a937b9fa-b493-4cc7-b851-58a5a3f9a456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870f51868d6b408d810720be18bb9499'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:29.526424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a937b9fa-b493-4cc7-b851-58a5a3f9a456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870f51868d6b408d810720be18bb9499'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:29.528783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:29.534017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1236/2441] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:13:29 2022] DELETE /identity/v3/users/870f51868d6b408d810720be18bb9499 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:13:29.538604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d5a3d-5029-411b-9402-366404045ded None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:29.539113 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d5a3d-5029-411b-9402-366404045ded None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:29.539326 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d5a3d-5029-411b-9402-366404045ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:29.559151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2e9d5a3d-5029-411b-9402-366404045ded None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:29.560376 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2e9d5a3d-5029-411b-9402-366404045ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:29.630724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1206/2442] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:13:29.640923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937b9fa-b493-4cc7-b851-58a5a3f9a456 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:29.642467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a937b9fa-b493-4cc7-b851-58a5a3f9a456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:29.722459 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937b9fa-b493-4cc7-b851-58a5a3f9a456 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:29.726297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674a804-bff5-40bd-af54-d579e5e47f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:29.726924 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674a804-bff5-40bd-af54-d579e5e47f2c service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:29.727201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674a804-bff5-40bd-af54-d579e5e47f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:29.727476 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674a804-bff5-40bd-af54-d579e5e47f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:29.738235 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674a804-bff5-40bd-af54-d579e5e47f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:29.739861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674a804-bff5-40bd-af54-d579e5e47f2c service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:29.750522 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1237/2443] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:13:30.125087 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d5a3d-5029-411b-9402-366404045ded None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:30.126645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2e9d5a3d-5029-411b-9402-366404045ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:30.142233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d5a3d-5029-411b-9402-366404045ded None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:30.148094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d623a27-f5ca-4fe3-b3d4-62d720cd09f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:30.148745 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d623a27-f5ca-4fe3-b3d4-62d720cd09f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:30.149057 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d623a27-f5ca-4fe3-b3d4-62d720cd09f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:30.149452 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d623a27-f5ca-4fe3-b3d4-62d720cd09f8 admin admin] PATH_INFO: `/v3/projects/eb445f437b3742d2a885d94d1646e959` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:30.150783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d623a27-f5ca-4fe3-b3d4-62d720cd09f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb445f437b3742d2a885d94d1646e959)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:30.153118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d623a27-f5ca-4fe3-b3d4-62d720cd09f8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:30.205050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d623a27-f5ca-4fe3-b3d4-62d720cd09f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb445f437b3742d2a885d94d1646e959', 'request_id': 'req-4d623a27-f5ca-4fe3-b3d4-62d720cd09f8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:30.211407 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d623a27-f5ca-4fe3-b3d4-62d720cd09f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb445f437b3742d2a885d94d1646e959', 'request_id': 'req-4d623a27-f5ca-4fe3-b3d4-62d720cd09f8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:30.217187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d623a27-f5ca-4fe3-b3d4-62d720cd09f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb445f437b3742d2a885d94d1646e959', 'request_id': 'req-4d623a27-f5ca-4fe3-b3d4-62d720cd09f8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:30.231702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d623a27-f5ca-4fe3-b3d4-62d720cd09f8 admin admin] The token cache is being invalidate because project eb445f437b3742d2a885d94d1646e959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:13:30.232084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d623a27-f5ca-4fe3-b3d4-62d720cd09f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:30.232905 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d623a27-f5ca-4fe3-b3d4-62d720cd09f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:30.235084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1207/2444] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:13:30 2022] DELETE /identity/v3/projects/eb445f437b3742d2a885d94d1646e959 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:13:30.239979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e39725-c36c-4984-8620-a3fcd437593a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:30.240303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e39725-c36c-4984-8620-a3fcd437593a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:30.240593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e39725-c36c-4984-8620-a3fcd437593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:30.260684 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d7e39725-c36c-4984-8620-a3fcd437593a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:30.261877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d7e39725-c36c-4984-8620-a3fcd437593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:30.333063 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1238/2445] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:13:30.342032 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899c264-eb17-4573-9168-3aa77741b395 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:30.342313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899c264-eb17-4573-9168-3aa77741b395 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:30.343090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899c264-eb17-4573-9168-3aa77741b395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:30.372736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0899c264-eb17-4573-9168-3aa77741b395 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:30.374155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0899c264-eb17-4573-9168-3aa77741b395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:30.384296 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1208/2446] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:13:30.388944 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e39725-c36c-4984-8620-a3fcd437593a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:30.401344 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e39725-c36c-4984-8620-a3fcd437593a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:30.408286 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d900b8-51ee-4cb8-ac8b-0989954e8dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:30.409132 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d900b8-51ee-4cb8-ac8b-0989954e8dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:30.409281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d900b8-51ee-4cb8-ac8b-0989954e8dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:30.409604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d900b8-51ee-4cb8-ac8b-0989954e8dd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:30.410341 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d900b8-51ee-4cb8-ac8b-0989954e8dd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:13:30.410686 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d900b8-51ee-4cb8-ac8b-0989954e8dd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:30.412573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d900b8-51ee-4cb8-ac8b-0989954e8dd5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:30.428685 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1239/2447] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:13:30.432430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899c264-eb17-4573-9168-3aa77741b395 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:30.442954 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899c264-eb17-4573-9168-3aa77741b395 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:30.448115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f762dd-0018-4228-bb4f-5d133177f45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:30.448727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f762dd-0018-4228-bb4f-5d133177f45f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:30.449046 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f762dd-0018-4228-bb4f-5d133177f45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:30.449315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f762dd-0018-4228-bb4f-5d133177f45f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:30.449971 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f762dd-0018-4228-bb4f-5d133177f45f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:30.451984 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f762dd-0018-4228-bb4f-5d133177f45f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:30.457949 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:30.488124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1209/2448] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:13:30 2022] POST /identity/v3/projects => generated 395 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:13:30.489349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d900b8-51ee-4cb8-ac8b-0989954e8dd5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:30.499417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d900b8-51ee-4cb8-ac8b-0989954e8dd5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:30.559993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e86da5-3f33-4c45-b921-53ec9c6b0d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:30.560607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e86da5-3f33-4c45-b921-53ec9c6b0d19 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:30.560882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e86da5-3f33-4c45-b921-53ec9c6b0d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:30.561201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e86da5-3f33-4c45-b921-53ec9c6b0d19 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:30.561871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e86da5-3f33-4c45-b921-53ec9c6b0d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:30.563776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e86da5-3f33-4c45-b921-53ec9c6b0d19 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:30.588535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1240/2449] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:13:30 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:13:30.593551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f762dd-0018-4228-bb4f-5d133177f45f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:30.606637 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f762dd-0018-4228-bb4f-5d133177f45f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:30.612950 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8612b6-2538-447b-8de4-e8c34548937a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:30.613557 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8612b6-2538-447b-8de4-e8c34548937a admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:30.613834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8612b6-2538-447b-8de4-e8c34548937a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:30.614107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8612b6-2538-447b-8de4-e8c34548937a admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:30.614758 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8612b6-2538-447b-8de4-e8c34548937a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:30.616617 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8612b6-2538-447b-8de4-e8c34548937a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:30.628192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1210/2450] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:13:30.632519 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e86da5-3f33-4c45-b921-53ec9c6b0d19 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:30.643161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e86da5-3f33-4c45-b921-53ec9c6b0d19 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:30.648047 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d617d-5651-4a39-9283-1ac66ed94ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:30.648655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d617d-5651-4a39-9283-1ac66ed94ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:30.648916 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d617d-5651-4a39-9283-1ac66ed94ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:30.649184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d617d-5651-4a39-9283-1ac66ed94ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:30.649822 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d617d-5651-4a39-9283-1ac66ed94ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:30.651536 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d617d-5651-4a39-9283-1ac66ed94ff3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:30.670782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1241/2451] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:13:30.672020 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8612b6-2538-447b-8de4-e8c34548937a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:30.682730 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8612b6-2538-447b-8de4-e8c34548937a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:30.687448 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddce6a-6412-4a00-ba6b-7fd05904ace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:30.688142 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddce6a-6412-4a00-ba6b-7fd05904ace9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:30.688423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddce6a-6412-4a00-ba6b-7fd05904ace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:30.688697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddce6a-6412-4a00-ba6b-7fd05904ace9 admin admin] PATH_INFO: `/v3/projects/dd5392add4e34648aa3c4608a490f910/users/f948befc6cec439cbc25cefd537b5340/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:30.708847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddce6a-6412-4a00-ba6b-7fd05904ace9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5392add4e34648aa3c4608a490f910, user_id=f948befc6cec439cbc25cefd537b5340, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:30.711710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddce6a-6412-4a00-ba6b-7fd05904ace9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:30.727543 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1211/2452] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:13:30 2022] PUT /identity/v3/projects/dd5392add4e34648aa3c4608a490f910/users/f948befc6cec439cbc25cefd537b5340/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:13:30.738077 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08957b16-278d-46c5-8dbe-2c5a3b5cfe02 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:30.738387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08957b16-278d-46c5-8dbe-2c5a3b5cfe02 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:30.738629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08957b16-278d-46c5-8dbe-2c5a3b5cfe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:30.759603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:30.772207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-08957b16-278d-46c5-8dbe-2c5a3b5cfe02 None None] MFA Rules not processed for user `f948befc6cec439cbc25cefd537b5340`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:30.773439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-08957b16-278d-46c5-8dbe-2c5a3b5cfe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:30.861106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1242/2453] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:13:30 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:13:30.872554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddce6a-6412-4a00-ba6b-7fd05904ace9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:30.874774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4eddce6a-6412-4a00-ba6b-7fd05904ace9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:30.938214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddce6a-6412-4a00-ba6b-7fd05904ace9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:30.941961 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340b700-b8b3-4cc7-8ea3-9c96bdce66d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:30.942562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340b700-b8b3-4cc7-8ea3-9c96bdce66d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:30.942840 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340b700-b8b3-4cc7-8ea3-9c96bdce66d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:30.943110 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340b700-b8b3-4cc7-8ea3-9c96bdce66d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:30.951568 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340b700-b8b3-4cc7-8ea3-9c96bdce66d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:30.953829 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340b700-b8b3-4cc7-8ea3-9c96bdce66d7 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:30.962735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1212/2454] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:13:30 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:13:36.058901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08957b16-278d-46c5-8dbe-2c5a3b5cfe02 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:36.121910 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08957b16-278d-46c5-8dbe-2c5a3b5cfe02 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:36.126417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3533f-b162-4242-b063-0021949c55a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:36.127043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3533f-b162-4242-b063-0021949c55a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:36.127323 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3533f-b162-4242-b063-0021949c55a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:36.127593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3533f-b162-4242-b063-0021949c55a6 admin admin] PATH_INFO: `/v3/users/f948befc6cec439cbc25cefd537b5340` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:36.128746 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3533f-b162-4242-b063-0021949c55a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f948befc6cec439cbc25cefd537b5340)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:36.130885 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3533f-b162-4242-b063-0021949c55a6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:36.178662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9bb3533f-b162-4242-b063-0021949c55a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f948befc6cec439cbc25cefd537b5340'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:36.185909 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9bb3533f-b162-4242-b063-0021949c55a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f948befc6cec439cbc25cefd537b5340'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:36.193659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9bb3533f-b162-4242-b063-0021949c55a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f948befc6cec439cbc25cefd537b5340'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:36.194340 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9bb3533f-b162-4242-b063-0021949c55a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f948befc6cec439cbc25cefd537b5340'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:36.206470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9bb3533f-b162-4242-b063-0021949c55a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f948befc6cec439cbc25cefd537b5340'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:36.212359 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1243/2455] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:13:36 2022] DELETE /identity/v3/users/f948befc6cec439cbc25cefd537b5340 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:13:36.216794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7f4c4-11d8-43b4-a652-8aacd0c27a62 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:36.217760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7f4c4-11d8-43b4-a652-8aacd0c27a62 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:36.218024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7f4c4-11d8-43b4-a652-8aacd0c27a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:36.238073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e7c7f4c4-11d8-43b4-a652-8aacd0c27a62 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:36.239544 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e7c7f4c4-11d8-43b4-a652-8aacd0c27a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:36.304689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1213/2456] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:13:36.315548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3533f-b162-4242-b063-0021949c55a6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:36.317170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9bb3533f-b162-4242-b063-0021949c55a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:36.343370 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:36.385713 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3533f-b162-4242-b063-0021949c55a6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:36.389373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a088b73-30e1-4b29-bc0c-d16c7edfa800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:36.390004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a088b73-30e1-4b29-bc0c-d16c7edfa800 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:36.390280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a088b73-30e1-4b29-bc0c-d16c7edfa800 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:36.390548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a088b73-30e1-4b29-bc0c-d16c7edfa800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:36.399485 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a088b73-30e1-4b29-bc0c-d16c7edfa800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:36.400929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a088b73-30e1-4b29-bc0c-d16c7edfa800 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:36.410853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1244/2457] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:13:36.676785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7f4c4-11d8-43b4-a652-8aacd0c27a62 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:36.678234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e7c7f4c4-11d8-43b4-a652-8aacd0c27a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:36.691738 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7f4c4-11d8-43b4-a652-8aacd0c27a62 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:36.696472 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2038b7-3a2b-435b-b784-a4e3932136ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:36.697124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2038b7-3a2b-435b-b784-a4e3932136ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:36.697398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2038b7-3a2b-435b-b784-a4e3932136ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:36.697674 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2038b7-3a2b-435b-b784-a4e3932136ff admin admin] PATH_INFO: `/v3/projects/dd5392add4e34648aa3c4608a490f910` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:36.699523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2038b7-3a2b-435b-b784-a4e3932136ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5392add4e34648aa3c4608a490f910)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:36.702333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2038b7-3a2b-435b-b784-a4e3932136ff admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:36.755728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ce2038b7-3a2b-435b-b784-a4e3932136ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5392add4e34648aa3c4608a490f910', 'request_id': 'req-ce2038b7-3a2b-435b-b784-a4e3932136ff'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:36.756881 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:36.764723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ce2038b7-3a2b-435b-b784-a4e3932136ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5392add4e34648aa3c4608a490f910', 'request_id': 'req-ce2038b7-3a2b-435b-b784-a4e3932136ff'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:36.771043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ce2038b7-3a2b-435b-b784-a4e3932136ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5392add4e34648aa3c4608a490f910', 'request_id': 'req-ce2038b7-3a2b-435b-b784-a4e3932136ff'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:36.785279 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ce2038b7-3a2b-435b-b784-a4e3932136ff admin admin] The token cache is being invalidate because project dd5392add4e34648aa3c4608a490f910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:13:36.785564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ce2038b7-3a2b-435b-b784-a4e3932136ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:36.786282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ce2038b7-3a2b-435b-b784-a4e3932136ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:13:36.788136 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1214/2458] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:13:36 2022] DELETE /identity/v3/projects/dd5392add4e34648aa3c4608a490f910 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:13:46.406786 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=18 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:46.495891 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5a8ed-5734-4bdc-a59e-dfe83507846c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:46.496223 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5a8ed-5734-4bdc-a59e-dfe83507846c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:46.496502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5a8ed-5734-4bdc-a59e-dfe83507846c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:46.516266 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f9a5a8ed-5734-4bdc-a59e-dfe83507846c None None] MFA Rules not processed for user `dd803cc555584e95baf795337a36ad6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:46.517480 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f9a5a8ed-5734-4bdc-a59e-dfe83507846c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:46.579869 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1245/2459] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:13:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:13:46.781976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=6,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:47.504557 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751abc2-f305-4312-b09e-046893f2c345 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:47.505119 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751abc2-f305-4312-b09e-046893f2c345 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:47.505345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751abc2-f305-4312-b09e-046893f2c345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:47.525141 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c751abc2-f305-4312-b09e-046893f2c345 None None] MFA Rules not processed for user `579e12444fba41af85666356fac5415f`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:47.526338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c751abc2-f305-4312-b09e-046893f2c345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:47.583008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1215/2460] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:13:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:13:56.571531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=25 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:57.574949 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=25 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:09.043279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9906205-5a31-4b4a-9a9f-4d834d112217 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:09.043839 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9906205-5a31-4b4a-9a9f-4d834d112217 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:09.044624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9906205-5a31-4b4a-9a9f-4d834d112217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:09.065580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b9906205-5a31-4b4a-9a9f-4d834d112217 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:09.066744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b9906205-5a31-4b4a-9a9f-4d834d112217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:09.135324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1246/2461] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Aug 30 05:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:09.150069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751abc2-f305-4312-b09e-046893f2c345 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:09.151640 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c751abc2-f305-4312-b09e-046893f2c345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:09.239285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751abc2-f305-4312-b09e-046893f2c345 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:09.245222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cd157-739b-4e06-b6ee-10afc391c05f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:09.245818 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cd157-739b-4e06-b6ee-10afc391c05f service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:09.246096 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cd157-739b-4e06-b6ee-10afc391c05f service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:09.246371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cd157-739b-4e06-b6ee-10afc391c05f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:09.256579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cd157-739b-4e06-b6ee-10afc391c05f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:09.258187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cd157-739b-4e06-b6ee-10afc391c05f service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:09.268295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1216/2462] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:14:10.227459 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18ce39-9bb7-4a24-b70a-338a6d665fcf None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:10.228043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18ce39-9bb7-4a24-b70a-338a6d665fcf None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:10.228232 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18ce39-9bb7-4a24-b70a-338a6d665fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:10.251831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6d18ce39-9bb7-4a24-b70a-338a6d665fcf None None] MFA Rules not processed for user `b0e4c582fefb4b92b0a2e10652de62f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:10.253109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6d18ce39-9bb7-4a24-b70a-338a6d665fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:10.314424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1247/2463] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:14:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:10.776444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9180-530a-42fd-9da5-1266c702d86e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:10.777091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9180-530a-42fd-9da5-1266c702d86e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:10.777222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9180-530a-42fd-9da5-1266c702d86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:10.802721 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5b9a9180-530a-42fd-9da5-1266c702d86e None None] MFA Rules not processed for user `8c48a0f56a484813af66d8b691c79113`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:10.804042 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5b9a9180-530a-42fd-9da5-1266c702d86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:10.862969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1217/2464] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:14:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:14.369185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286fad-f880-46e3-b24a-dbf36bfbbd00 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:14.369756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286fad-f880-46e3-b24a-dbf36bfbbd00 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:14.369756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286fad-f880-46e3-b24a-dbf36bfbbd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:14.390371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-73286fad-f880-46e3-b24a-dbf36bfbbd00 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:14.391582 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-73286fad-f880-46e3-b24a-dbf36bfbbd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:14.400975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1248/2465] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Aug 30 05:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:14.416175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a9180-530a-42fd-9da5-1266c702d86e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:14.431510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a9180-530a-42fd-9da5-1266c702d86e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:14.437916 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2323ce5-dfe5-49dc-934a-247e85f23059 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:14.438527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2323ce5-dfe5-49dc-934a-247e85f23059 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:14.439009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2323ce5-dfe5-49dc-934a-247e85f23059 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:14.439287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2323ce5-dfe5-49dc-934a-247e85f23059 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:14.448204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2323ce5-dfe5-49dc-934a-247e85f23059 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:14.449992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2323ce5-dfe5-49dc-934a-247e85f23059 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:14.462170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1218/2466] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:14:19.493303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07e91c-d7ff-4804-9449-d0b76711d697 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:19.493824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07e91c-d7ff-4804-9449-d0b76711d697 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:19.493995 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07e91c-d7ff-4804-9449-d0b76711d697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:19.514445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-dd07e91c-d7ff-4804-9449-d0b76711d697 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:19.515667 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-dd07e91c-d7ff-4804-9449-d0b76711d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:19.523573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1249/2467] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Aug 30 05:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:19.538905 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2323ce5-dfe5-49dc-934a-247e85f23059 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:19.550397 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2323ce5-dfe5-49dc-934a-247e85f23059 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:19.556146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e844fa-e4ef-44a6-a916-aa3ef04b57f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:19.556748 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e844fa-e4ef-44a6-a916-aa3ef04b57f8 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:19.557024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e844fa-e4ef-44a6-a916-aa3ef04b57f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:19.557289 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e844fa-e4ef-44a6-a916-aa3ef04b57f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:19.567124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e844fa-e4ef-44a6-a916-aa3ef04b57f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:19.568725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e844fa-e4ef-44a6-a916-aa3ef04b57f8 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:19.578988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1219/2468] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:14:23.688901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeccce4-4711-4fb9-a301-38214416ed8c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:23.689373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeccce4-4711-4fb9-a301-38214416ed8c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:23.689646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeccce4-4711-4fb9-a301-38214416ed8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:23.709266 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-eaeccce4-4711-4fb9-a301-38214416ed8c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:23.710477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-eaeccce4-4711-4fb9-a301-38214416ed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:23.718458 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1250/2469] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Aug 30 05:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:23.743136 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e844fa-e4ef-44a6-a916-aa3ef04b57f8 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:23.744652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-96e844fa-e4ef-44a6-a916-aa3ef04b57f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:23.759865 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e844fa-e4ef-44a6-a916-aa3ef04b57f8 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:23.765607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3989308-0cac-439e-93ff-744acadddb83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:23.766203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3989308-0cac-439e-93ff-744acadddb83 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:23.766480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3989308-0cac-439e-93ff-744acadddb83 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:23.766753 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3989308-0cac-439e-93ff-744acadddb83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:23.775035 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3989308-0cac-439e-93ff-744acadddb83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:23.776708 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3989308-0cac-439e-93ff-744acadddb83 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:23.786117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1220/2470] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:14:26.872069 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf7c57-6f1f-4c94-88eb-3e4204d674ce None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:26.872613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf7c57-6f1f-4c94-88eb-3e4204d674ce None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:26.873628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf7c57-6f1f-4c94-88eb-3e4204d674ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:26.893884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2cbf7c57-6f1f-4c94-88eb-3e4204d674ce None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:26.895106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2cbf7c57-6f1f-4c94-88eb-3e4204d674ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:26.903206 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1251/2471] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Aug 30 05:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:26.919314 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3989308-0cac-439e-93ff-744acadddb83 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:26.933292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3989308-0cac-439e-93ff-744acadddb83 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:26.941389 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234d07e-1cdf-4f40-ab7c-41996971caa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:26.942090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234d07e-1cdf-4f40-ab7c-41996971caa6 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:26.942526 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234d07e-1cdf-4f40-ab7c-41996971caa6 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:26.943074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234d07e-1cdf-4f40-ab7c-41996971caa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:26.952534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234d07e-1cdf-4f40-ab7c-41996971caa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:26.954221 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234d07e-1cdf-4f40-ab7c-41996971caa6 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:26.963766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1221/2472] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:14:34.869149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf7c57-6f1f-4c94-88eb-3e4204d674ce None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:34.870671 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2cbf7c57-6f1f-4c94-88eb-3e4204d674ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:34.926797 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf7c57-6f1f-4c94-88eb-3e4204d674ce None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:34.930320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccd0f3-cc70-4758-a296-ff8d4054798c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:34.930916 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccd0f3-cc70-4758-a296-ff8d4054798c service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:34.931189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccd0f3-cc70-4758-a296-ff8d4054798c service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:34.931455 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccd0f3-cc70-4758-a296-ff8d4054798c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:34.933155 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a4ccd0f3-cc70-4758-a296-ff8d4054798c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:34.946618 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccd0f3-cc70-4758-a296-ff8d4054798c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:34.948134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccd0f3-cc70-4758-a296-ff8d4054798c service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:34.959785 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1252/2473] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:14:36.134411 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234d07e-1cdf-4f40-ab7c-41996971caa6 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:36.143706 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234d07e-1cdf-4f40-ab7c-41996971caa6 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:36.147209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ab3b0-d10a-4996-8cab-50cabccba1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:36.147791 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ab3b0-d10a-4996-8cab-50cabccba1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:36.148109 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ab3b0-d10a-4996-8cab-50cabccba1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:36.148378 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ab3b0-d10a-4996-8cab-50cabccba1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:36.150046 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-553ab3b0-d10a-4996-8cab-50cabccba1f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:36.163741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ab3b0-d10a-4996-8cab-50cabccba1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:36.165197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ab3b0-d10a-4996-8cab-50cabccba1f5 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:36.177457 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1222/2474] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:14:44.954771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:46.171510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:55.879479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccd0f3-cc70-4758-a296-ff8d4054798c service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:55.892412 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccd0f3-cc70-4758-a296-ff8d4054798c service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:55.899334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240a141-d7ad-4a71-91ca-e343fbd48a8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:55.902099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240a141-d7ad-4a71-91ca-e343fbd48a8d service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:55.902099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240a141-d7ad-4a71-91ca-e343fbd48a8d service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:55.902099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240a141-d7ad-4a71-91ca-e343fbd48a8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:55.903751 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9240a141-d7ad-4a71-91ca-e343fbd48a8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:55.923135 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240a141-d7ad-4a71-91ca-e343fbd48a8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:55.925934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240a141-d7ad-4a71-91ca-e343fbd48a8d service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:55.941828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1253/2475] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:14:57.375328 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ab3b0-d10a-4996-8cab-50cabccba1f5 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:57.376945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-553ab3b0-d10a-4996-8cab-50cabccba1f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:57.405693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ab3b0-d10a-4996-8cab-50cabccba1f5 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:57.413127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98553e3-1074-49d8-a37e-e794863410d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:57.414415 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98553e3-1074-49d8-a37e-e794863410d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:57.415065 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98553e3-1074-49d8-a37e-e794863410d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:57.415486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98553e3-1074-49d8-a37e-e794863410d2 admin admin] PATH_INFO: `/v3/users/579e12444fba41af85666356fac5415f` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:57.417271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98553e3-1074-49d8-a37e-e794863410d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=579e12444fba41af85666356fac5415f)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:57.419579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98553e3-1074-49d8-a37e-e794863410d2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:57.489825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b98553e3-1074-49d8-a37e-e794863410d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579e12444fba41af85666356fac5415f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.513689 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b98553e3-1074-49d8-a37e-e794863410d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579e12444fba41af85666356fac5415f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.525236 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b98553e3-1074-49d8-a37e-e794863410d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579e12444fba41af85666356fac5415f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.525995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b98553e3-1074-49d8-a37e-e794863410d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579e12444fba41af85666356fac5415f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.526725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b98553e3-1074-49d8-a37e-e794863410d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579e12444fba41af85666356fac5415f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.548282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1223/2476] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:14:57 2022] DELETE /identity/v3/users/579e12444fba41af85666356fac5415f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:14:57.735888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240a141-d7ad-4a71-91ca-e343fbd48a8d service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:57.751383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240a141-d7ad-4a71-91ca-e343fbd48a8d service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:57.816712 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a09d8-cb27-4692-911b-f0c65101e29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:57.817543 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a09d8-cb27-4692-911b-f0c65101e29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:57.817820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a09d8-cb27-4692-911b-f0c65101e29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:57.818093 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a09d8-cb27-4692-911b-f0c65101e29c admin admin] PATH_INFO: `/v3/projects/944bbbe087f343278e1fb1cb3cbc1ca0` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:57.819262 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a09d8-cb27-4692-911b-f0c65101e29c admin admin] RBAC: Authorizing `identity:delete_project(project_id=944bbbe087f343278e1fb1cb3cbc1ca0)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:57.821243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a09d8-cb27-4692-911b-f0c65101e29c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:57.871703 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-215a09d8-cb27-4692-911b-f0c65101e29c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944bbbe087f343278e1fb1cb3cbc1ca0', 'request_id': 'req-215a09d8-cb27-4692-911b-f0c65101e29c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.877920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-215a09d8-cb27-4692-911b-f0c65101e29c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944bbbe087f343278e1fb1cb3cbc1ca0', 'request_id': 'req-215a09d8-cb27-4692-911b-f0c65101e29c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.886428 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-215a09d8-cb27-4692-911b-f0c65101e29c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944bbbe087f343278e1fb1cb3cbc1ca0', 'request_id': 'req-215a09d8-cb27-4692-911b-f0c65101e29c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.898501 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-215a09d8-cb27-4692-911b-f0c65101e29c admin admin] The token cache is being invalidate because project 944bbbe087f343278e1fb1cb3cbc1ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:14:57.898791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-215a09d8-cb27-4692-911b-f0c65101e29c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.899517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-215a09d8-cb27-4692-911b-f0c65101e29c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.901026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1254/2477] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:14:57 2022] DELETE /identity/v3/projects/944bbbe087f343278e1fb1cb3cbc1ca0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:15:00.228378 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28238272-a6da-4bd7-9dec-9786d1a3d3cb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:00.228904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28238272-a6da-4bd7-9dec-9786d1a3d3cb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:00.228904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28238272-a6da-4bd7-9dec-9786d1a3d3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:00.249297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-28238272-a6da-4bd7-9dec-9786d1a3d3cb None None] MFA Rules not processed for user `dd803cc555584e95baf795337a36ad6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:00.250500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-28238272-a6da-4bd7-9dec-9786d1a3d3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:00.305320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1224/2478] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:15:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:00.608872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a09d8-cb27-4692-911b-f0c65101e29c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:00.610374 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28238272-a6da-4bd7-9dec-9786d1a3d3cb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:00.610554 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-215a09d8-cb27-4692-911b-f0c65101e29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:00.611843 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-28238272-a6da-4bd7-9dec-9786d1a3d3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:00.670604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a09d8-cb27-4692-911b-f0c65101e29c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:00.670987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28238272-a6da-4bd7-9dec-9786d1a3d3cb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:00.674328 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca0f3d-1bb6-49f0-938f-3ab2fcdabd4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:00.674482 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce4568-eeb9-441b-a9de-67eaf915bc63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:00.674935 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0f3d-1bb6-49f0-938f-3ab2fcdabd4e service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:00.675076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce4568-eeb9-441b-a9de-67eaf915bc63 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:00.675220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0f3d-1bb6-49f0-938f-3ab2fcdabd4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:00.675354 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce4568-eeb9-441b-a9de-67eaf915bc63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:00.675460 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0f3d-1bb6-49f0-938f-3ab2fcdabd4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:00.675625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce4568-eeb9-441b-a9de-67eaf915bc63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:00.677192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c3ca0f3d-1bb6-49f0-938f-3ab2fcdabd4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:00.677331 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7cce4568-eeb9-441b-a9de-67eaf915bc63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:00.687551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca0f3d-1bb6-49f0-938f-3ab2fcdabd4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:00.689011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca0f3d-1bb6-49f0-938f-3ab2fcdabd4e service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:00.697017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1225/2479] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:15:00.709609 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:00.740464 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce4568-eeb9-441b-a9de-67eaf915bc63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:00.741932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce4568-eeb9-441b-a9de-67eaf915bc63 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:00.751134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1255/2480] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:00 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:01.050315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca0f3d-1bb6-49f0-938f-3ab2fcdabd4e service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:01.055467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c3ca0f3d-1bb6-49f0-938f-3ab2fcdabd4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:01.082590 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:01.136507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca0f3d-1bb6-49f0-938f-3ab2fcdabd4e service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:01.141481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bd4e2-12a9-42fc-97b3-658baa714934 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed835047051142d2bc98bb1564e3a98f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:01.142084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bd4e2-12a9-42fc-97b3-658baa714934 service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:01.142358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bd4e2-12a9-42fc-97b3-658baa714934 service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:01.142621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bd4e2-12a9-42fc-97b3-658baa714934 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:01.144412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ac3bd4e2-12a9-42fc-97b3-658baa714934 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:01.155693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bd4e2-12a9-42fc-97b3-658baa714934 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:01.157285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bd4e2-12a9-42fc-97b3-658baa714934 service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:01.167210 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1226/2481] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:07.009347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce4568-eeb9-441b-a9de-67eaf915bc63 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:07.018607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce4568-eeb9-441b-a9de-67eaf915bc63 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:07.022511 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bdc6d-40a2-4c6c-b5f7-f6e2864bf025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:07.023190 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bdc6d-40a2-4c6c-b5f7-f6e2864bf025 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:07.023652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bdc6d-40a2-4c6c-b5f7-f6e2864bf025 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:07.023918 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bdc6d-40a2-4c6c-b5f7-f6e2864bf025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:07.025797 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3e6bdc6d-40a2-4c6c-b5f7-f6e2864bf025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:07.035665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bdc6d-40a2-4c6c-b5f7-f6e2864bf025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:07.037253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bdc6d-40a2-4c6c-b5f7-f6e2864bf025 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:07.049160 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1256/2482] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:11.162712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=23 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:13.967287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bd4e2-12a9-42fc-97b3-658baa714934 service placement] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:13.968765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ac3bd4e2-12a9-42fc-97b3-658baa714934 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:14.061408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bd4e2-12a9-42fc-97b3-658baa714934 service placement] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:14.067297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49347989-81fe-4b0a-b68d-3ba32b5a4e2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:14.067912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49347989-81fe-4b0a-b68d-3ba32b5a4e2b service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:14.068216 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49347989-81fe-4b0a-b68d-3ba32b5a4e2b service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:14.068484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49347989-81fe-4b0a-b68d-3ba32b5a4e2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:14.070269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-49347989-81fe-4b0a-b68d-3ba32b5a4e2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:14.130442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49347989-81fe-4b0a-b68d-3ba32b5a4e2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:14.132229 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49347989-81fe-4b0a-b68d-3ba32b5a4e2b service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:14.142696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1227/2483] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:17.044588 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=19 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:17.881909 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bdc6d-40a2-4c6c-b5f7-f6e2864bf025 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:17.905293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bdc6d-40a2-4c6c-b5f7-f6e2864bf025 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:17.911756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a9dfa-9803-4897-80d3-6b6d86e96c4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:17.912429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9dfa-9803-4897-80d3-6b6d86e96c4d service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:17.912881 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9dfa-9803-4897-80d3-6b6d86e96c4d service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:17.913811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9dfa-9803-4897-80d3-6b6d86e96c4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:17.916524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b66a9dfa-9803-4897-80d3-6b6d86e96c4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:17.934059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a9dfa-9803-4897-80d3-6b6d86e96c4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:17.935845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a9dfa-9803-4897-80d3-6b6d86e96c4d service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:17.948411 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1257/2484] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:19.777701 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211015c-33a4-46c9-9151-6d99d0f69789 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:19.778177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211015c-33a4-46c9-9151-6d99d0f69789 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:19.778446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211015c-33a4-46c9-9151-6d99d0f69789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:19.799011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6211015c-33a4-46c9-9151-6d99d0f69789 None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:19.800398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6211015c-33a4-46c9-9151-6d99d0f69789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:19.865799 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1228/2485] 10.222.0.48 () {58 vars in 967 bytes} [Tue Aug 30 05:15:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:19.914099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a9dfa-9803-4897-80d3-6b6d86e96c4d service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:19.915539 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b66a9dfa-9803-4897-80d3-6b6d86e96c4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:19.995229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a9dfa-9803-4897-80d3-6b6d86e96c4d service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:20.001049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029b507-f28b-4eaa-b8ee-599131438fb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:20.001676 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029b507-f28b-4eaa-b8ee-599131438fb4 service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:20.001962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029b507-f28b-4eaa-b8ee-599131438fb4 service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:20.002231 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029b507-f28b-4eaa-b8ee-599131438fb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:20.011439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029b507-f28b-4eaa-b8ee-599131438fb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:20.013067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029b507-f28b-4eaa-b8ee-599131438fb4 service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:20.023167 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1258/2486] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:15:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:15:24.565464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211015c-33a4-46c9-9151-6d99d0f69789 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:24.578824 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211015c-33a4-46c9-9151-6d99d0f69789 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:24.585513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb307c4-0676-4d9f-9b46-e61eaf2692b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:24.586425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb307c4-0676-4d9f-9b46-e61eaf2692b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:24.586714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb307c4-0676-4d9f-9b46-e61eaf2692b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:24.587256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb307c4-0676-4d9f-9b46-e61eaf2692b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:24.589912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4eb307c4-0676-4d9f-9b46-e61eaf2692b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:24.643429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:24.689068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb307c4-0676-4d9f-9b46-e61eaf2692b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:24.690452 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb307c4-0676-4d9f-9b46-e61eaf2692b1 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:24.701994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1229/2487] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:15:29.352082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029b507-f28b-4eaa-b8ee-599131438fb4 service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:29.353540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0029b507-f28b-4eaa-b8ee-599131438fb4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:29.381463 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029b507-f28b-4eaa-b8ee-599131438fb4 service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:29.390897 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd1732-4c6c-4957-8563-4d3dedb56458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:29.391633 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd1732-4c6c-4957-8563-4d3dedb56458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:29.392098 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd1732-4c6c-4957-8563-4d3dedb56458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:29.392649 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd1732-4c6c-4957-8563-4d3dedb56458 admin admin] PATH_INFO: `/v3/users/d6ba100ea236427ba6e6466bb2c358fa` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:29.394245 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd1732-4c6c-4957-8563-4d3dedb56458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ba100ea236427ba6e6466bb2c358fa)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:29.396643 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd1732-4c6c-4957-8563-4d3dedb56458 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:29.475765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4fcd1732-4c6c-4957-8563-4d3dedb56458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ba100ea236427ba6e6466bb2c358fa'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:29.483380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4fcd1732-4c6c-4957-8563-4d3dedb56458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ba100ea236427ba6e6466bb2c358fa'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:29.496898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4fcd1732-4c6c-4957-8563-4d3dedb56458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ba100ea236427ba6e6466bb2c358fa'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:29.497839 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4fcd1732-4c6c-4957-8563-4d3dedb56458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ba100ea236427ba6e6466bb2c358fa'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:29.515227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4fcd1732-4c6c-4957-8563-4d3dedb56458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ba100ea236427ba6e6466bb2c358fa'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:29.525137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1259/2488] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:15:29 2022] DELETE /identity/v3/users/d6ba100ea236427ba6e6466bb2c358fa => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:15:29.805564 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb307c4-0676-4d9f-9b46-e61eaf2692b1 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:29.816490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb307c4-0676-4d9f-9b46-e61eaf2692b1 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:29.885340 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de85109-3d23-48f7-9838-3ccaf6514483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:29.886008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de85109-3d23-48f7-9838-3ccaf6514483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:29.886287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de85109-3d23-48f7-9838-3ccaf6514483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:29.886560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de85109-3d23-48f7-9838-3ccaf6514483 admin admin] PATH_INFO: `/v3/projects/5dbb6e071e0849ad9f34fb67207d2fe7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:29.887716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de85109-3d23-48f7-9838-3ccaf6514483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dbb6e071e0849ad9f34fb67207d2fe7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:29.889777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de85109-3d23-48f7-9838-3ccaf6514483 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:29.962975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9de85109-3d23-48f7-9838-3ccaf6514483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dbb6e071e0849ad9f34fb67207d2fe7', 'request_id': 'req-9de85109-3d23-48f7-9838-3ccaf6514483'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:29.966391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd1732-4c6c-4957-8563-4d3dedb56458 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:29.967974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4fcd1732-4c6c-4957-8563-4d3dedb56458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:29.971084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9de85109-3d23-48f7-9838-3ccaf6514483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dbb6e071e0849ad9f34fb67207d2fe7', 'request_id': 'req-9de85109-3d23-48f7-9838-3ccaf6514483'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:29.979012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9de85109-3d23-48f7-9838-3ccaf6514483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dbb6e071e0849ad9f34fb67207d2fe7', 'request_id': 'req-9de85109-3d23-48f7-9838-3ccaf6514483'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:29.989391 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd1732-4c6c-4957-8563-4d3dedb56458 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:29.995679 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9de85109-3d23-48f7-9838-3ccaf6514483 admin admin] The token cache is being invalidate because project 5dbb6e071e0849ad9f34fb67207d2fe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:15:29.996282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9de85109-3d23-48f7-9838-3ccaf6514483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:29.996731 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9de85109-3d23-48f7-9838-3ccaf6514483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:29.998286 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1230/2489] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:15:29 2022] DELETE /identity/v3/projects/5dbb6e071e0849ad9f34fb67207d2fe7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:15:30.002442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de85109-3d23-48f7-9838-3ccaf6514483 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:30.004108 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9de85109-3d23-48f7-9838-3ccaf6514483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:30.046499 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:30.060656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefbd8b-083a-4a30-851e-cb523e889b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:30.061582 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefbd8b-083a-4a30-851e-cb523e889b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:30.061965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefbd8b-083a-4a30-851e-cb523e889b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:30.062338 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefbd8b-083a-4a30-851e-cb523e889b71 admin admin] PATH_INFO: `/v3/users/b0e4c582fefb4b92b0a2e10652de62f7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:30.063776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefbd8b-083a-4a30-851e-cb523e889b71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e4c582fefb4b92b0a2e10652de62f7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:30.065944 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefbd8b-083a-4a30-851e-cb523e889b71 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:30.076422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de85109-3d23-48f7-9838-3ccaf6514483 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:30.081145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d17ac-c51b-452e-829d-a30aa7d57960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:30.081994 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d17ac-c51b-452e-829d-a30aa7d57960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:30.082199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d17ac-c51b-452e-829d-a30aa7d57960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:30.082468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d17ac-c51b-452e-829d-a30aa7d57960 admin admin] PATH_INFO: `/v3/users/e56f445a0b8641c38fc1322c1636c61d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:30.083590 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d17ac-c51b-452e-829d-a30aa7d57960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56f445a0b8641c38fc1322c1636c61d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:30.085540 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d17ac-c51b-452e-829d-a30aa7d57960 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:30.093040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:30.123202 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ecefbd8b-083a-4a30-851e-cb523e889b71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e4c582fefb4b92b0a2e10652de62f7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.131989 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ecefbd8b-083a-4a30-851e-cb523e889b71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e4c582fefb4b92b0a2e10652de62f7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.141283 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ecefbd8b-083a-4a30-851e-cb523e889b71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e4c582fefb4b92b0a2e10652de62f7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.141896 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ecefbd8b-083a-4a30-851e-cb523e889b71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e4c582fefb4b92b0a2e10652de62f7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.159019 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ecefbd8b-083a-4a30-851e-cb523e889b71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e4c582fefb4b92b0a2e10652de62f7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.165726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1260/2490] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:15:29 2022] DELETE /identity/v3/users/b0e4c582fefb4b92b0a2e10652de62f7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:15:30.165892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-352d17ac-c51b-452e-829d-a30aa7d57960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56f445a0b8641c38fc1322c1636c61d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.180190 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-352d17ac-c51b-452e-829d-a30aa7d57960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56f445a0b8641c38fc1322c1636c61d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.187215 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-352d17ac-c51b-452e-829d-a30aa7d57960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56f445a0b8641c38fc1322c1636c61d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.187968 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-352d17ac-c51b-452e-829d-a30aa7d57960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56f445a0b8641c38fc1322c1636c61d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.188650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-352d17ac-c51b-452e-829d-a30aa7d57960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56f445a0b8641c38fc1322c1636c61d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.203101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1231/2491] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:15:30 2022] DELETE /identity/v3/users/e56f445a0b8641c38fc1322c1636c61d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:15:30.349866 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefbd8b-083a-4a30-851e-cb523e889b71 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:30.351845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ecefbd8b-083a-4a30-851e-cb523e889b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:30.400490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d17ac-c51b-452e-829d-a30aa7d57960 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:30.402315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-352d17ac-c51b-452e-829d-a30aa7d57960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:30.425524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefbd8b-083a-4a30-851e-cb523e889b71 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:30.495179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d17ac-c51b-452e-829d-a30aa7d57960 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:30.501432 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfcd91-d5c9-40da-9625-b322a611a6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:30.502458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfcd91-d5c9-40da-9625-b322a611a6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:30.503083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfcd91-d5c9-40da-9625-b322a611a6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:30.503810 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfcd91-d5c9-40da-9625-b322a611a6c7 admin admin] PATH_INFO: `/v3/projects/2c3705285d32403b815b989bba9996e6` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:30.506660 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5629c35-99b8-4163-87a8-48340e9d0120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:30.507369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfcd91-d5c9-40da-9625-b322a611a6c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c3705285d32403b815b989bba9996e6)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:30.507734 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5629c35-99b8-4163-87a8-48340e9d0120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:30.508207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5629c35-99b8-4163-87a8-48340e9d0120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:30.508653 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5629c35-99b8-4163-87a8-48340e9d0120 admin admin] PATH_INFO: `/v3/projects/4071c0d10b154953a613ca3faf8db28d` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:30.509484 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfcd91-d5c9-40da-9625-b322a611a6c7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:30.510157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5629c35-99b8-4163-87a8-48340e9d0120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4071c0d10b154953a613ca3faf8db28d)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:30.513800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5629c35-99b8-4163-87a8-48340e9d0120 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:30.537915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:30.567750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d4cfcd91-d5c9-40da-9625-b322a611a6c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c3705285d32403b815b989bba9996e6', 'request_id': 'req-d4cfcd91-d5c9-40da-9625-b322a611a6c7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.574498 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d4cfcd91-d5c9-40da-9625-b322a611a6c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c3705285d32403b815b989bba9996e6', 'request_id': 'req-d4cfcd91-d5c9-40da-9625-b322a611a6c7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.578572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d5629c35-99b8-4163-87a8-48340e9d0120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4071c0d10b154953a613ca3faf8db28d', 'request_id': 'req-d5629c35-99b8-4163-87a8-48340e9d0120'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.581123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d4cfcd91-d5c9-40da-9625-b322a611a6c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c3705285d32403b815b989bba9996e6', 'request_id': 'req-d4cfcd91-d5c9-40da-9625-b322a611a6c7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.585582 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d5629c35-99b8-4163-87a8-48340e9d0120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4071c0d10b154953a613ca3faf8db28d', 'request_id': 'req-d5629c35-99b8-4163-87a8-48340e9d0120'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.595380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d5629c35-99b8-4163-87a8-48340e9d0120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4071c0d10b154953a613ca3faf8db28d', 'request_id': 'req-d5629c35-99b8-4163-87a8-48340e9d0120'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.596096 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d4cfcd91-d5c9-40da-9625-b322a611a6c7 admin admin] The token cache is being invalidate because project 2c3705285d32403b815b989bba9996e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:15:30.596611 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d4cfcd91-d5c9-40da-9625-b322a611a6c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.597415 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d4cfcd91-d5c9-40da-9625-b322a611a6c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.612510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1232/2492] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:15:30 2022] DELETE /identity/v3/projects/2c3705285d32403b815b989bba9996e6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:15:30.612622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d5629c35-99b8-4163-87a8-48340e9d0120 admin admin] The token cache is being invalidate because project 4071c0d10b154953a613ca3faf8db28d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:15:30.612622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d5629c35-99b8-4163-87a8-48340e9d0120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.613273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d5629c35-99b8-4163-87a8-48340e9d0120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:30.615517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1261/2493] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:15:30 2022] DELETE /identity/v3/projects/4071c0d10b154953a613ca3faf8db28d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:15:30.621463 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440898aa-d7f6-4bb0-b2be-3ec0327a2aea None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:30.622470 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440898aa-d7f6-4bb0-b2be-3ec0327a2aea None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:30.622984 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440898aa-d7f6-4bb0-b2be-3ec0327a2aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:30.646331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-440898aa-d7f6-4bb0-b2be-3ec0327a2aea None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:30.647585 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-440898aa-d7f6-4bb0-b2be-3ec0327a2aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:30.659145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:30.731989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1233/2494] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:30.739063 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75a163-02b8-4447-80e6-6bd3a9bc42e6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:30.739359 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75a163-02b8-4447-80e6-6bd3a9bc42e6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:30.739607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75a163-02b8-4447-80e6-6bd3a9bc42e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:30.762381 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3d75a163-02b8-4447-80e6-6bd3a9bc42e6 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:30.763689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3d75a163-02b8-4447-80e6-6bd3a9bc42e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:30.773210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1262/2495] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:30.777544 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440898aa-d7f6-4bb0-b2be-3ec0327a2aea None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:30.790136 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440898aa-d7f6-4bb0-b2be-3ec0327a2aea None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:30.797138 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6dca1-6a0c-4a14-b816-5aff37556be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:30.797762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6dca1-6a0c-4a14-b816-5aff37556be2 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:30.798063 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6dca1-6a0c-4a14-b816-5aff37556be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:30.798333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6dca1-6a0c-4a14-b816-5aff37556be2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:30.798965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6dca1-6a0c-4a14-b816-5aff37556be2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:15:30.799266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6dca1-6a0c-4a14-b816-5aff37556be2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:30.801040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6dca1-6a0c-4a14-b816-5aff37556be2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:30.827673 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1234/2496] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:15:30.844962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75a163-02b8-4447-80e6-6bd3a9bc42e6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:30.858061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75a163-02b8-4447-80e6-6bd3a9bc42e6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:30.871574 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acee13-011b-40a4-8410-6764ff0112bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:30.872425 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acee13-011b-40a4-8410-6764ff0112bf admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:30.872805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acee13-011b-40a4-8410-6764ff0112bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:30.873170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acee13-011b-40a4-8410-6764ff0112bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:30.873957 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acee13-011b-40a4-8410-6764ff0112bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:30.876593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acee13-011b-40a4-8410-6764ff0112bf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:30.913030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1263/2497] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:15:30 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:15:30.917388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6dca1-6a0c-4a14-b816-5aff37556be2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:30.939809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6dca1-6a0c-4a14-b816-5aff37556be2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:31.012841 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac49ad-de6b-4a4c-90ff-f3e2563fcdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:31.013386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac49ad-de6b-4a4c-90ff-f3e2563fcdad admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:31.013669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac49ad-de6b-4a4c-90ff-f3e2563fcdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:31.013934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac49ad-de6b-4a4c-90ff-f3e2563fcdad admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:31.014567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac49ad-de6b-4a4c-90ff-f3e2563fcdad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:31.016657 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac49ad-de6b-4a4c-90ff-f3e2563fcdad admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:31.046915 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1235/2498] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:15:30 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:15:31.051081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acee13-011b-40a4-8410-6764ff0112bf admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:31.062631 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acee13-011b-40a4-8410-6764ff0112bf admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:31.068551 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2579941-c6dc-42b7-a43f-6e72fa4da7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:31.069563 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2579941-c6dc-42b7-a43f-6e72fa4da7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:31.069942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2579941-c6dc-42b7-a43f-6e72fa4da7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:31.070422 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2579941-c6dc-42b7-a43f-6e72fa4da7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:31.071223 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2579941-c6dc-42b7-a43f-6e72fa4da7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:31.073127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2579941-c6dc-42b7-a43f-6e72fa4da7b4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:31.084396 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1264/2499] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:15:31.088418 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac49ad-de6b-4a4c-90ff-f3e2563fcdad admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:31.102696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac49ad-de6b-4a4c-90ff-f3e2563fcdad admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:31.109350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084ebc2-9131-44d6-9206-cfe0de4c4cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:31.110434 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084ebc2-9131-44d6-9206-cfe0de4c4cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:31.110932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084ebc2-9131-44d6-9206-cfe0de4c4cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:31.111458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084ebc2-9131-44d6-9206-cfe0de4c4cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:31.112712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084ebc2-9131-44d6-9206-cfe0de4c4cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:31.114435 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084ebc2-9131-44d6-9206-cfe0de4c4cc6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:31.128931 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1236/2500] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:15:31.133111 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2579941-c6dc-42b7-a43f-6e72fa4da7b4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:31.144474 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2579941-c6dc-42b7-a43f-6e72fa4da7b4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:31.149434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12593bac-c978-4a8f-a706-fed7e441c75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:31.150075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12593bac-c978-4a8f-a706-fed7e441c75b admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:31.150350 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12593bac-c978-4a8f-a706-fed7e441c75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:31.150633 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12593bac-c978-4a8f-a706-fed7e441c75b admin admin] PATH_INFO: `/v3/projects/359a50074dbb4502902d024e9990278d/users/9754e3aad3674c789276ca823dd03411/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:31.166137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12593bac-c978-4a8f-a706-fed7e441c75b admin admin] RBAC: Authorizing `identity:create_grant(project_id=359a50074dbb4502902d024e9990278d, user_id=9754e3aad3674c789276ca823dd03411, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:31.169365 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12593bac-c978-4a8f-a706-fed7e441c75b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:31.183445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1265/2501] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:15:31 2022] PUT /identity/v3/projects/359a50074dbb4502902d024e9990278d/users/9754e3aad3674c789276ca823dd03411/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:15:31.189305 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141d9f5-c6f7-41c7-998b-bb363e3c08a4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:31.189592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141d9f5-c6f7-41c7-998b-bb363e3c08a4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:31.189866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141d9f5-c6f7-41c7-998b-bb363e3c08a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:31.221715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0141d9f5-c6f7-41c7-998b-bb363e3c08a4 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:31.222935 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0141d9f5-c6f7-41c7-998b-bb363e3c08a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:31.281186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1237/2502] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:31.291516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12593bac-c978-4a8f-a706-fed7e441c75b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:31.293249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-12593bac-c978-4a8f-a706-fed7e441c75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:31.351390 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12593bac-c978-4a8f-a706-fed7e441c75b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:31.355095 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48a5d3-2cce-4d35-82e6-877112b267cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:31.355730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48a5d3-2cce-4d35-82e6-877112b267cc service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:31.356619 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48a5d3-2cce-4d35-82e6-877112b267cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:31.356899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48a5d3-2cce-4d35-82e6-877112b267cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:31.365715 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48a5d3-2cce-4d35-82e6-877112b267cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:31.367117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48a5d3-2cce-4d35-82e6-877112b267cc service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:31.376637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1266/2503] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:34.585950 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720af5d-feca-4a56-a54d-a42c3101e4f8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:34.587750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720af5d-feca-4a56-a54d-a42c3101e4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:34.588725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720af5d-feca-4a56-a54d-a42c3101e4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:34.614710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8720af5d-feca-4a56-a54d-a42c3101e4f8 None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:34.622899 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8720af5d-feca-4a56-a54d-a42c3101e4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:34.643705 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:34.695262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1238/2504] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Aug 30 05:15:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:34.703526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48a5d3-2cce-4d35-82e6-877112b267cc service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:34.705852 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1b48a5d3-2cce-4d35-82e6-877112b267cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:34.762517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:34.786961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48a5d3-2cce-4d35-82e6-877112b267cc service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:34.800949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab50e26-0430-4916-886c-110ac8f33e65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:34.801965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab50e26-0430-4916-886c-110ac8f33e65 service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:34.804146 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab50e26-0430-4916-886c-110ac8f33e65 service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:34.804735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab50e26-0430-4916-886c-110ac8f33e65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:34.815657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab50e26-0430-4916-886c-110ac8f33e65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:34.817665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab50e26-0430-4916-886c-110ac8f33e65 service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:34.835346 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1267/2505] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:15:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:15:36.480497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e9c45-4497-4d48-9bb7-5524398f7f30 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:36.482124 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e9c45-4497-4d48-9bb7-5524398f7f30 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:36.482396 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e9c45-4497-4d48-9bb7-5524398f7f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:36.522657 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7d5e9c45-4497-4d48-9bb7-5524398f7f30 None None] MFA Rules not processed for user `9754e3aad3674c789276ca823dd03411`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:36.524205 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7d5e9c45-4497-4d48-9bb7-5524398f7f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:36.645666 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1239/2506] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:15:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:36.664256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab50e26-0430-4916-886c-110ac8f33e65 service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:36.666330 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fab50e26-0430-4916-886c-110ac8f33e65 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:36.808227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab50e26-0430-4916-886c-110ac8f33e65 service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:36.810030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24483a-db33-4ef3-945e-06db58e130c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:36.811005 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24483a-db33-4ef3-945e-06db58e130c9 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:36.811376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24483a-db33-4ef3-945e-06db58e130c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:36.811737 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24483a-db33-4ef3-945e-06db58e130c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:36.826009 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24483a-db33-4ef3-945e-06db58e130c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:36.827803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24483a-db33-4ef3-945e-06db58e130c9 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:36.845586 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1268/2507] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:38.306645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e9c45-4497-4d48-9bb7-5524398f7f30 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:38.327358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e9c45-4497-4d48-9bb7-5524398f7f30 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:38.333628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd98b2a-d466-4c06-ba9b-bc73db561ae1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:38.334748 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd98b2a-d466-4c06-ba9b-bc73db561ae1 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:38.335371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd98b2a-d466-4c06-ba9b-bc73db561ae1 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:38.336021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd98b2a-d466-4c06-ba9b-bc73db561ae1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:38.339161 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5cd98b2a-d466-4c06-ba9b-bc73db561ae1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:38.357115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd98b2a-d466-4c06-ba9b-bc73db561ae1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:38.359204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd98b2a-d466-4c06-ba9b-bc73db561ae1 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:38.387646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1240/2508] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:39.041087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e304ff-7ead-49cd-9f9e-d293ba0351e1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:39.042239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e304ff-7ead-49cd-9f9e-d293ba0351e1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:39.043038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e304ff-7ead-49cd-9f9e-d293ba0351e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:39.067379 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-26e304ff-7ead-49cd-9f9e-d293ba0351e1 None None] MFA Rules not processed for user `9754e3aad3674c789276ca823dd03411`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:39.068618 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-26e304ff-7ead-49cd-9f9e-d293ba0351e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:39.078194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1269/2509] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:15:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:39.569981 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd98b2a-d466-4c06-ba9b-bc73db561ae1 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:39.587663 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd98b2a-d466-4c06-ba9b-bc73db561ae1 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:39.591685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d19f5e-9af1-4718-b283-b2091394edb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:39.592482 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d19f5e-9af1-4718-b283-b2091394edb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:39.593009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d19f5e-9af1-4718-b283-b2091394edb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:39.593492 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d19f5e-9af1-4718-b283-b2091394edb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:39.598212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c7d19f5e-9af1-4718-b283-b2091394edb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:39.610723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d19f5e-9af1-4718-b283-b2091394edb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:39.612260 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d19f5e-9af1-4718-b283-b2091394edb7 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:39.632386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1241/2510] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:49.061082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=49 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:49.625816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=59 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:50.223858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5c753-a7e1-47d2-80db-dd3b889d31cc None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:50.224761 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5c753-a7e1-47d2-80db-dd3b889d31cc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:50.225207 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5c753-a7e1-47d2-80db-dd3b889d31cc None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:50.226911 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1270/2511] 10.222.0.48 () {54 vars in 921 bytes} [Tue Aug 30 05:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:15:50.234380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c28f8-2a35-40b3-83a7-1646dd6a2d46 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:50.234773 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c28f8-2a35-40b3-83a7-1646dd6a2d46 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:50.235163 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c28f8-2a35-40b3-83a7-1646dd6a2d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:50.257655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b91c28f8-2a35-40b3-83a7-1646dd6a2d46 None None] MFA Rules not processed for user `4398d5175c8c409789d62c277da35ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:50.259002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b91c28f8-2a35-40b3-83a7-1646dd6a2d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:50.266035 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1242/2512] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Aug 30 05:15:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:50.279283 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5c753-a7e1-47d2-80db-dd3b889d31cc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:50.281967 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-eeb5c753-a7e1-47d2-80db-dd3b889d31cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:50.300357 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5c753-a7e1-47d2-80db-dd3b889d31cc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:50.304290 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b394bc-1001-4edc-8068-5ac475566d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:50.305008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b394bc-1001-4edc-8068-5ac475566d12 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:50.305562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b394bc-1001-4edc-8068-5ac475566d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:50.305906 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b394bc-1001-4edc-8068-5ac475566d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:50.314830 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b394bc-1001-4edc-8068-5ac475566d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:50.316335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b394bc-1001-4edc-8068-5ac475566d12 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:50.334109 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1271/2513] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:50.432967 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90539df7-886b-4dfc-91d1-6d872d090086 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:50.433250 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90539df7-886b-4dfc-91d1-6d872d090086 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:50.433541 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90539df7-886b-4dfc-91d1-6d872d090086 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:50.434896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1243/2514] 10.222.0.48 () {54 vars in 921 bytes} [Tue Aug 30 05:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:15:50.440394 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19acc1-11c4-44dd-9d26-9ea6e50fecf5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:50.440842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19acc1-11c4-44dd-9d26-9ea6e50fecf5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:50.441190 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19acc1-11c4-44dd-9d26-9ea6e50fecf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:50.460876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-be19acc1-11c4-44dd-9d26-9ea6e50fecf5 None None] MFA Rules not processed for user `1aa002909502426b80c97dbf05dca008`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:50.462229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-be19acc1-11c4-44dd-9d26-9ea6e50fecf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:50.472636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1272/2515] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Aug 30 05:15:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:50.484421 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90539df7-886b-4dfc-91d1-6d872d090086 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:50.499736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90539df7-886b-4dfc-91d1-6d872d090086 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:50.501512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01435e4a-6f18-4ed9-a719-c044c95290c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:50.502140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01435e4a-6f18-4ed9-a719-c044c95290c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:50.502550 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01435e4a-6f18-4ed9-a719-c044c95290c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:50.502834 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01435e4a-6f18-4ed9-a719-c044c95290c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:50.514352 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01435e4a-6f18-4ed9-a719-c044c95290c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:50.515778 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01435e4a-6f18-4ed9-a719-c044c95290c2 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:50.526614 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1244/2516] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:56.935402 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8ee7-1a2e-4c96-bb6a-f8515317de65 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:56.935911 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8ee7-1a2e-4c96-bb6a-f8515317de65 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:56.936081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8ee7-1a2e-4c96-bb6a-f8515317de65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:56.955687 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b3dc8ee7-1a2e-4c96-bb6a-f8515317de65 None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:56.957047 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b3dc8ee7-1a2e-4c96-bb6a-f8515317de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:56.964944 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1273/2517] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Aug 30 05:15:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:56.982925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01435e4a-6f18-4ed9-a719-c044c95290c2 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:56.994919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01435e4a-6f18-4ed9-a719-c044c95290c2 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:57.001141 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7908c92-f439-413d-b599-9f0603783a92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:57.001732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7908c92-f439-413d-b599-9f0603783a92 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:57.002001 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7908c92-f439-413d-b599-9f0603783a92 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:57.002264 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7908c92-f439-413d-b599-9f0603783a92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:57.010710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7908c92-f439-413d-b599-9f0603783a92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:57.012435 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7908c92-f439-413d-b599-9f0603783a92 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:57.024876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1245/2518] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:15:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:16:06.950129 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=12 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:07.021265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=15 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:13.606811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a71a5-6836-4174-9402-0a5be29b114e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:13.607281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a71a5-6836-4174-9402-0a5be29b114e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:13.607402 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a71a5-6836-4174-9402-0a5be29b114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:13.626132 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-af1a71a5-6836-4174-9402-0a5be29b114e None None] MFA Rules not processed for user `487fc3d8ac924be0a1d66ae8ca49f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:13.627357 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-af1a71a5-6836-4174-9402-0a5be29b114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:13.635532 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1274/2519] 10.222.0.48 () {58 vars in 967 bytes} [Tue Aug 30 05:16:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:13.648818 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7908c92-f439-413d-b599-9f0603783a92 service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:13.661596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7908c92-f439-413d-b599-9f0603783a92 service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:13.666746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cb3f2-2f60-4e6d-be52-d266518946a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96ac878c106422ebf438a64ca618747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:13.667297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cb3f2-2f60-4e6d-be52-d266518946a0 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:13.667604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cb3f2-2f60-4e6d-be52-d266518946a0 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:13.667879 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cb3f2-2f60-4e6d-be52-d266518946a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:13.678086 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cb3f2-2f60-4e6d-be52-d266518946a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:13.679896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cb3f2-2f60-4e6d-be52-d266518946a0 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:13.701810 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1246/2520] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Aug 30 05:16:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:16:20.081595 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a71a5-6836-4174-9402-0a5be29b114e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:20.094205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a71a5-6836-4174-9402-0a5be29b114e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:20.094456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa21e4-9112-4422-97fa-0c9d345d0b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:20.095052 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa21e4-9112-4422-97fa-0c9d345d0b74 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:20.095327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa21e4-9112-4422-97fa-0c9d345d0b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:20.095592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa21e4-9112-4422-97fa-0c9d345d0b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:20.097585 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9baa21e4-9112-4422-97fa-0c9d345d0b74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:20.112019 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa21e4-9112-4422-97fa-0c9d345d0b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:20.113573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa21e4-9112-4422-97fa-0c9d345d0b74 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:20.123991 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1275/2521] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:22.908529 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cb3f2-2f60-4e6d-be52-d266518946a0 service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:22.910239 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-819cb3f2-2f60-4e6d-be52-d266518946a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:23.011390 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cb3f2-2f60-4e6d-be52-d266518946a0 service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:23.017343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315a4e6-0aa3-483c-aaff-0595c8e4e094 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed835047051142d2bc98bb1564e3a98f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:23.018055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315a4e6-0aa3-483c-aaff-0595c8e4e094 service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:23.018408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315a4e6-0aa3-483c-aaff-0595c8e4e094 service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:23.018833 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315a4e6-0aa3-483c-aaff-0595c8e4e094 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:23.020773 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d315a4e6-0aa3-483c-aaff-0595c8e4e094 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:23.036935 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315a4e6-0aa3-483c-aaff-0595c8e4e094 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:23.038566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315a4e6-0aa3-483c-aaff-0595c8e4e094 service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:23.054138 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1247/2522] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:23.181957 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa21e4-9112-4422-97fa-0c9d345d0b74 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:23.184006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9baa21e4-9112-4422-97fa-0c9d345d0b74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:23.197558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa21e4-9112-4422-97fa-0c9d345d0b74 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:23.202777 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaae5c6-11ce-4950-a4d7-da3da4abe6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:23.203399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaae5c6-11ce-4950-a4d7-da3da4abe6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:23.203671 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaae5c6-11ce-4950-a4d7-da3da4abe6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:23.203937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaae5c6-11ce-4950-a4d7-da3da4abe6de admin admin] PATH_INFO: `/v3/users/dd803cc555584e95baf795337a36ad6c` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:23.205045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaae5c6-11ce-4950-a4d7-da3da4abe6de admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd803cc555584e95baf795337a36ad6c)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:23.206934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaae5c6-11ce-4950-a4d7-da3da4abe6de admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:23.251439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bbaae5c6-11ce-4950-a4d7-da3da4abe6de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd803cc555584e95baf795337a36ad6c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:23.258414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bbaae5c6-11ce-4950-a4d7-da3da4abe6de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd803cc555584e95baf795337a36ad6c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:23.266096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bbaae5c6-11ce-4950-a4d7-da3da4abe6de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd803cc555584e95baf795337a36ad6c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:23.266779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bbaae5c6-11ce-4950-a4d7-da3da4abe6de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd803cc555584e95baf795337a36ad6c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:23.278756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bbaae5c6-11ce-4950-a4d7-da3da4abe6de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd803cc555584e95baf795337a36ad6c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:23.284759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1276/2523] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:16:23 2022] DELETE /identity/v3/users/dd803cc555584e95baf795337a36ad6c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:23.468084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315a4e6-0aa3-483c-aaff-0595c8e4e094 service placement] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:23.478641 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315a4e6-0aa3-483c-aaff-0595c8e4e094 service placement] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:23.536285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a4b30-3593-4119-9707-6f6ab5e07ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:23.536920 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a4b30-3593-4119-9707-6f6ab5e07ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:23.537244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a4b30-3593-4119-9707-6f6ab5e07ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:23.537463 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a4b30-3593-4119-9707-6f6ab5e07ba5 admin admin] PATH_INFO: `/v3/projects/851ad9d4f2ad4df9b3c8d16a383a08e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:23.538575 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a4b30-3593-4119-9707-6f6ab5e07ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=851ad9d4f2ad4df9b3c8d16a383a08e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:23.540558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a4b30-3593-4119-9707-6f6ab5e07ba5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:23.587686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4c8a4b30-3593-4119-9707-6f6ab5e07ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '851ad9d4f2ad4df9b3c8d16a383a08e1', 'request_id': 'req-4c8a4b30-3593-4119-9707-6f6ab5e07ba5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:23.593943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4c8a4b30-3593-4119-9707-6f6ab5e07ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '851ad9d4f2ad4df9b3c8d16a383a08e1', 'request_id': 'req-4c8a4b30-3593-4119-9707-6f6ab5e07ba5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:23.599447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4c8a4b30-3593-4119-9707-6f6ab5e07ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '851ad9d4f2ad4df9b3c8d16a383a08e1', 'request_id': 'req-4c8a4b30-3593-4119-9707-6f6ab5e07ba5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:23.612858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4c8a4b30-3593-4119-9707-6f6ab5e07ba5 admin admin] The token cache is being invalidate because project 851ad9d4f2ad4df9b3c8d16a383a08e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:16:23.613169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4c8a4b30-3593-4119-9707-6f6ab5e07ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:23.613789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4c8a4b30-3593-4119-9707-6f6ab5e07ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:23.615265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1248/2524] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:16:23 2022] DELETE /identity/v3/projects/851ad9d4f2ad4df9b3c8d16a383a08e1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:23.620824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7805b-8d16-4233-94eb-f1a8c6b32a77 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:23.621096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7805b-8d16-4233-94eb-f1a8c6b32a77 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:23.621369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7805b-8d16-4233-94eb-f1a8c6b32a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:23.641029 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-03e7805b-8d16-4233-94eb-f1a8c6b32a77 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:23.642289 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-03e7805b-8d16-4233-94eb-f1a8c6b32a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:23.702489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1277/2525] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:16:23.711052 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a68caa-c783-4539-a8cc-7bab7ac9834c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:23.711277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a68caa-c783-4539-a8cc-7bab7ac9834c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:23.711552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a68caa-c783-4539-a8cc-7bab7ac9834c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:23.725929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:23.732887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-53a68caa-c783-4539-a8cc-7bab7ac9834c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:23.734672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-53a68caa-c783-4539-a8cc-7bab7ac9834c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:23.742712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1249/2526] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:23.747356 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7805b-8d16-4233-94eb-f1a8c6b32a77 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:23.757209 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7805b-8d16-4233-94eb-f1a8c6b32a77 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:23.762635 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39f426-b3cc-42de-a601-d045a3f88127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:23.763224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39f426-b3cc-42de-a601-d045a3f88127 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:23.763498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39f426-b3cc-42de-a601-d045a3f88127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:23.763797 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39f426-b3cc-42de-a601-d045a3f88127 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:23.764465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39f426-b3cc-42de-a601-d045a3f88127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:16:23.764760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39f426-b3cc-42de-a601-d045a3f88127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:23.766351 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39f426-b3cc-42de-a601-d045a3f88127 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:23.777710 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1278/2527] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:16:23.781889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a68caa-c783-4539-a8cc-7bab7ac9834c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:23.791050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a68caa-c783-4539-a8cc-7bab7ac9834c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:23.796054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211e1cf-cd60-4aa1-a84c-760c777566d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:23.796645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211e1cf-cd60-4aa1-a84c-760c777566d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:23.796923 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211e1cf-cd60-4aa1-a84c-760c777566d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:23.797194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211e1cf-cd60-4aa1-a84c-760c777566d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:23.797825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211e1cf-cd60-4aa1-a84c-760c777566d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:23.799713 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211e1cf-cd60-4aa1-a84c-760c777566d9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:23.827501 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1250/2528] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:16:23 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:23.831485 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39f426-b3cc-42de-a601-d045a3f88127 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:23.841547 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39f426-b3cc-42de-a601-d045a3f88127 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:23.879087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:23.901885 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fe12d-fe2f-4033-8bf4-036751f63cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:23.902497 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fe12d-fe2f-4033-8bf4-036751f63cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:23.902774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fe12d-fe2f-4033-8bf4-036751f63cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:23.903045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fe12d-fe2f-4033-8bf4-036751f63cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:23.903681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fe12d-fe2f-4033-8bf4-036751f63cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:23.905624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fe12d-fe2f-4033-8bf4-036751f63cc4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:23.926490 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1279/2529] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:16:23 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:16:23.930681 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211e1cf-cd60-4aa1-a84c-760c777566d9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:23.941678 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211e1cf-cd60-4aa1-a84c-760c777566d9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:23.946280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad77fe7-0cd8-4784-93e9-1982cdba4b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:23.946873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad77fe7-0cd8-4784-93e9-1982cdba4b6d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:23.947149 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad77fe7-0cd8-4784-93e9-1982cdba4b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:23.947422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad77fe7-0cd8-4784-93e9-1982cdba4b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:23.948123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad77fe7-0cd8-4784-93e9-1982cdba4b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:23.950333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad77fe7-0cd8-4784-93e9-1982cdba4b6d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:23.960131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1251/2530] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:23.964578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fe12d-fe2f-4033-8bf4-036751f63cc4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:23.974467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fe12d-fe2f-4033-8bf4-036751f63cc4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:23.979106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4f320-6613-4a99-855b-0fb0d3c65c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:23.979722 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4f320-6613-4a99-855b-0fb0d3c65c15 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:23.980026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4f320-6613-4a99-855b-0fb0d3c65c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:23.980301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4f320-6613-4a99-855b-0fb0d3c65c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:23.980940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4f320-6613-4a99-855b-0fb0d3c65c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:23.982531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4f320-6613-4a99-855b-0fb0d3c65c15 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:23.993194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1280/2531] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:23.997801 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad77fe7-0cd8-4784-93e9-1982cdba4b6d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:24.008194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad77fe7-0cd8-4784-93e9-1982cdba4b6d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:24.013668 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455918c0-698a-4717-98b3-60dbc8b61f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:24.014327 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455918c0-698a-4717-98b3-60dbc8b61f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:24.014603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455918c0-698a-4717-98b3-60dbc8b61f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:24.014872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455918c0-698a-4717-98b3-60dbc8b61f6d admin admin] PATH_INFO: `/v3/projects/c0319ad2924d4622b7a8a743df6d87e8/users/d94cbf58cd784bbaac9d942bfdc326d2/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:24.029266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455918c0-698a-4717-98b3-60dbc8b61f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0319ad2924d4622b7a8a743df6d87e8, user_id=d94cbf58cd784bbaac9d942bfdc326d2, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:24.031936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455918c0-698a-4717-98b3-60dbc8b61f6d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:24.046596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1252/2532] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:23 2022] PUT /identity/v3/projects/c0319ad2924d4622b7a8a743df6d87e8/users/d94cbf58cd784bbaac9d942bfdc326d2/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:24.056880 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b0a93-f3c6-4715-9432-588e83a42b98 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:24.057161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b0a93-f3c6-4715-9432-588e83a42b98 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:24.057431 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b0a93-f3c6-4715-9432-588e83a42b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:24.086552 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c27b0a93-f3c6-4715-9432-588e83a42b98 None None] MFA Rules not processed for user `d94cbf58cd784bbaac9d942bfdc326d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:24.087795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c27b0a93-f3c6-4715-9432-588e83a42b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:24.151065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1281/2533] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:24.162619 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455918c0-698a-4717-98b3-60dbc8b61f6d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:24.164391 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-455918c0-698a-4717-98b3-60dbc8b61f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:24.238572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455918c0-698a-4717-98b3-60dbc8b61f6d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:24.244021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b17884-a1db-4adf-b984-ed88069556c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:24.244619 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b17884-a1db-4adf-b984-ed88069556c8 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:24.244892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b17884-a1db-4adf-b984-ed88069556c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:24.245747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b17884-a1db-4adf-b984-ed88069556c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:24.253486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b17884-a1db-4adf-b984-ed88069556c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:24.255047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b17884-a1db-4adf-b984-ed88069556c8 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:24.263801 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1253/2534] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:24.473442 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b0a93-f3c6-4715-9432-588e83a42b98 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:24.536842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b0a93-f3c6-4715-9432-588e83a42b98 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:24.541401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2085b8f-1e74-411c-8961-253be75e70cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:24.542660 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2085b8f-1e74-411c-8961-253be75e70cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:24.542941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2085b8f-1e74-411c-8961-253be75e70cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:24.543218 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2085b8f-1e74-411c-8961-253be75e70cf admin admin] PATH_INFO: `/v3/users/d94cbf58cd784bbaac9d942bfdc326d2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:24.544374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2085b8f-1e74-411c-8961-253be75e70cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94cbf58cd784bbaac9d942bfdc326d2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:24.546314 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2085b8f-1e74-411c-8961-253be75e70cf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:24.592456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a2085b8f-1e74-411c-8961-253be75e70cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94cbf58cd784bbaac9d942bfdc326d2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:24.594559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:24.601021 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a2085b8f-1e74-411c-8961-253be75e70cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94cbf58cd784bbaac9d942bfdc326d2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:24.609794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a2085b8f-1e74-411c-8961-253be75e70cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94cbf58cd784bbaac9d942bfdc326d2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:24.610549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a2085b8f-1e74-411c-8961-253be75e70cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94cbf58cd784bbaac9d942bfdc326d2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:24.622446 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a2085b8f-1e74-411c-8961-253be75e70cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94cbf58cd784bbaac9d942bfdc326d2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:24.628468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1282/2535] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:16:24 2022] DELETE /identity/v3/users/d94cbf58cd784bbaac9d942bfdc326d2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:24.633148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936b67a-3e9d-4faa-9b51-2eb3cfb14fab None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:24.633477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936b67a-3e9d-4faa-9b51-2eb3cfb14fab None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:24.633780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936b67a-3e9d-4faa-9b51-2eb3cfb14fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:24.653076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e936b67a-3e9d-4faa-9b51-2eb3cfb14fab None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:24.654309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e936b67a-3e9d-4faa-9b51-2eb3cfb14fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:24.712929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1254/2536] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:24.723044 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2085b8f-1e74-411c-8961-253be75e70cf admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:24.724486 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a2085b8f-1e74-411c-8961-253be75e70cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:24.791075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2085b8f-1e74-411c-8961-253be75e70cf admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:24.795210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4475720-8960-4861-9111-d2b79ddc6515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:24.795814 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4475720-8960-4861-9111-d2b79ddc6515 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:24.796120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4475720-8960-4861-9111-d2b79ddc6515 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:24.796393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4475720-8960-4861-9111-d2b79ddc6515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:24.805518 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4475720-8960-4861-9111-d2b79ddc6515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:24.807350 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4475720-8960-4861-9111-d2b79ddc6515 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:24.817257 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1283/2537] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:25.083146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936b67a-3e9d-4faa-9b51-2eb3cfb14fab None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:25.084873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e936b67a-3e9d-4faa-9b51-2eb3cfb14fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:25.099168 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936b67a-3e9d-4faa-9b51-2eb3cfb14fab None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:25.104968 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda733f-7d09-4009-a6f8-64396277c383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:25.105892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda733f-7d09-4009-a6f8-64396277c383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:25.106273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda733f-7d09-4009-a6f8-64396277c383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:25.106747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda733f-7d09-4009-a6f8-64396277c383 admin admin] PATH_INFO: `/v3/projects/c0319ad2924d4622b7a8a743df6d87e8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:25.109190 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda733f-7d09-4009-a6f8-64396277c383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0319ad2924d4622b7a8a743df6d87e8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:25.113836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda733f-7d09-4009-a6f8-64396277c383 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:25.139877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:25.162297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5eda733f-7d09-4009-a6f8-64396277c383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0319ad2924d4622b7a8a743df6d87e8', 'request_id': 'req-5eda733f-7d09-4009-a6f8-64396277c383'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:25.169222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5eda733f-7d09-4009-a6f8-64396277c383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0319ad2924d4622b7a8a743df6d87e8', 'request_id': 'req-5eda733f-7d09-4009-a6f8-64396277c383'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:25.174767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5eda733f-7d09-4009-a6f8-64396277c383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0319ad2924d4622b7a8a743df6d87e8', 'request_id': 'req-5eda733f-7d09-4009-a6f8-64396277c383'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:25.187314 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5eda733f-7d09-4009-a6f8-64396277c383 admin admin] The token cache is being invalidate because project c0319ad2924d4622b7a8a743df6d87e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:16:25.187600 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5eda733f-7d09-4009-a6f8-64396277c383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:25.188237 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5eda733f-7d09-4009-a6f8-64396277c383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:25.189707 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1255/2538] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:16:25 2022] DELETE /identity/v3/projects/c0319ad2924d4622b7a8a743df6d87e8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:25.194686 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961caa5b-f1bc-4015-b572-cf25b2d59082 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:25.194972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961caa5b-f1bc-4015-b572-cf25b2d59082 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:25.195247 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961caa5b-f1bc-4015-b572-cf25b2d59082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:25.215094 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-961caa5b-f1bc-4015-b572-cf25b2d59082 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:25.216347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-961caa5b-f1bc-4015-b572-cf25b2d59082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:25.274427 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1284/2539] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:25.282723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8313-22e3-43ac-bd41-f2366dfa2e58 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:25.283010 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8313-22e3-43ac-bd41-f2366dfa2e58 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:25.283283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8313-22e3-43ac-bd41-f2366dfa2e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:25.303559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5dac8313-22e3-43ac-bd41-f2366dfa2e58 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:25.304796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5dac8313-22e3-43ac-bd41-f2366dfa2e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:25.312598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1256/2540] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:25.316858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961caa5b-f1bc-4015-b572-cf25b2d59082 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:25.326884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961caa5b-f1bc-4015-b572-cf25b2d59082 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:25.331432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89963e8-3826-4a8f-9109-a4e4bce0c0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:25.332097 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89963e8-3826-4a8f-9109-a4e4bce0c0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:25.332376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89963e8-3826-4a8f-9109-a4e4bce0c0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:25.332646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89963e8-3826-4a8f-9109-a4e4bce0c0d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:25.333284 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89963e8-3826-4a8f-9109-a4e4bce0c0d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:16:25.333613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89963e8-3826-4a8f-9109-a4e4bce0c0d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:25.335229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89963e8-3826-4a8f-9109-a4e4bce0c0d4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:25.347442 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1285/2541] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:16:25.351804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac8313-22e3-43ac-bd41-f2366dfa2e58 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:25.361500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac8313-22e3-43ac-bd41-f2366dfa2e58 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:25.366103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e77117-ed52-447f-8dc1-8ad40e62e3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:25.366719 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e77117-ed52-447f-8dc1-8ad40e62e3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:25.366996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e77117-ed52-447f-8dc1-8ad40e62e3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:25.367266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e77117-ed52-447f-8dc1-8ad40e62e3f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:25.367901 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e77117-ed52-447f-8dc1-8ad40e62e3f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:25.369852 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e77117-ed52-447f-8dc1-8ad40e62e3f9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:25.397561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1257/2542] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:16:25 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:25.402392 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89963e8-3826-4a8f-9109-a4e4bce0c0d4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:25.413084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89963e8-3826-4a8f-9109-a4e4bce0c0d4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:25.465274 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:25.472709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58a34a-3e1e-4e36-8e31-da422c28c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:25.473491 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58a34a-3e1e-4e36-8e31-da422c28c509 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:25.474037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58a34a-3e1e-4e36-8e31-da422c28c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:25.474394 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58a34a-3e1e-4e36-8e31-da422c28c509 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:25.475299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58a34a-3e1e-4e36-8e31-da422c28c509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:25.477267 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58a34a-3e1e-4e36-8e31-da422c28c509 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:25.500234 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1286/2543] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:16:25 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:16:25.504780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e77117-ed52-447f-8dc1-8ad40e62e3f9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:25.515197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e77117-ed52-447f-8dc1-8ad40e62e3f9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:25.519896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b383d-8d05-4fcd-ae03-46978cdeb4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:25.520518 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b383d-8d05-4fcd-ae03-46978cdeb4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:25.520792 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b383d-8d05-4fcd-ae03-46978cdeb4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:25.521064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b383d-8d05-4fcd-ae03-46978cdeb4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:25.521701 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b383d-8d05-4fcd-ae03-46978cdeb4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:25.523319 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b383d-8d05-4fcd-ae03-46978cdeb4c9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:25.533735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1258/2544] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:25.537678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58a34a-3e1e-4e36-8e31-da422c28c509 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:25.548622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58a34a-3e1e-4e36-8e31-da422c28c509 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:25.553140 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1073e9-bef9-4b85-ba84-bb05c1f7ec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:25.553718 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1073e9-bef9-4b85-ba84-bb05c1f7ec96 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:25.553989 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1073e9-bef9-4b85-ba84-bb05c1f7ec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:25.554256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1073e9-bef9-4b85-ba84-bb05c1f7ec96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:25.554878 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1073e9-bef9-4b85-ba84-bb05c1f7ec96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:25.556484 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1073e9-bef9-4b85-ba84-bb05c1f7ec96 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:25.567012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1287/2545] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:16:25.571057 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b383d-8d05-4fcd-ae03-46978cdeb4c9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:25.581623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b383d-8d05-4fcd-ae03-46978cdeb4c9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:25.586081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12b7cd-9ecf-41a4-a7dd-844e2019d361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:25.586750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12b7cd-9ecf-41a4-a7dd-844e2019d361 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:25.587023 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12b7cd-9ecf-41a4-a7dd-844e2019d361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:25.587290 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12b7cd-9ecf-41a4-a7dd-844e2019d361 admin admin] PATH_INFO: `/v3/projects/7bd781ea564c484b9b5e863afad545dd/users/40b18b5b138b41a884dd4e23ae96f612/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:25.602194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12b7cd-9ecf-41a4-a7dd-844e2019d361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd781ea564c484b9b5e863afad545dd, user_id=40b18b5b138b41a884dd4e23ae96f612, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:25.604998 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12b7cd-9ecf-41a4-a7dd-844e2019d361 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:25.617853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1259/2546] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:25 2022] PUT /identity/v3/projects/7bd781ea564c484b9b5e863afad545dd/users/40b18b5b138b41a884dd4e23ae96f612/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:25.622838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d075f4-6d1c-4529-a8fc-2f3628b63262 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:25.623117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d075f4-6d1c-4529-a8fc-2f3628b63262 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:25.623397 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d075f4-6d1c-4529-a8fc-2f3628b63262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:25.643382 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f4d075f4-6d1c-4529-a8fc-2f3628b63262 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:25.644600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f4d075f4-6d1c-4529-a8fc-2f3628b63262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:25.703149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1288/2547] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:25.712732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12b7cd-9ecf-41a4-a7dd-844e2019d361 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:25.715068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ed12b7cd-9ecf-41a4-a7dd-844e2019d361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:25.770396 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12b7cd-9ecf-41a4-a7dd-844e2019d361 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:25.774032 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0da6b-ae3e-4a8a-b3be-ce452b6a03fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:25.774629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0da6b-ae3e-4a8a-b3be-ce452b6a03fb service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:25.774903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0da6b-ae3e-4a8a-b3be-ce452b6a03fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:25.775193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0da6b-ae3e-4a8a-b3be-ce452b6a03fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:25.784513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0da6b-ae3e-4a8a-b3be-ce452b6a03fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:25.785930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0da6b-ae3e-4a8a-b3be-ce452b6a03fb service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:25.795141 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1260/2548] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:26.699838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efbebc-cdab-4be3-8970-8deccb0117dd None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:26.700407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efbebc-cdab-4be3-8970-8deccb0117dd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:26.700527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efbebc-cdab-4be3-8970-8deccb0117dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:26.730092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-36efbebc-cdab-4be3-8970-8deccb0117dd None None] MFA Rules not processed for user `40b18b5b138b41a884dd4e23ae96f612`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:26.731653 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-36efbebc-cdab-4be3-8970-8deccb0117dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:26.800584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1289/2549] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:26 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:26.805093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0da6b-ae3e-4a8a-b3be-ce452b6a03fb service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:26.815158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0da6b-ae3e-4a8a-b3be-ce452b6a03fb service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:26.819625 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbfa38-7628-435a-8819-dbee5bf7f5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:26.820255 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbfa38-7628-435a-8819-dbee5bf7f5fe admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:26.820531 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbfa38-7628-435a-8819-dbee5bf7f5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:26.820797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbfa38-7628-435a-8819-dbee5bf7f5fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:26.821418 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbfa38-7628-435a-8819-dbee5bf7f5fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:26.823337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbfa38-7628-435a-8819-dbee5bf7f5fe admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:26.853257 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1261/2550] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:16:26 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:26.855134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efbebc-cdab-4be3-8970-8deccb0117dd None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:26.865908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efbebc-cdab-4be3-8970-8deccb0117dd None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:26.923371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bce40-f74d-4b15-bed1-9e599b3ef622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:26.924017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bce40-f74d-4b15-bed1-9e599b3ef622 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:26.924301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bce40-f74d-4b15-bed1-9e599b3ef622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:26.924572 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bce40-f74d-4b15-bed1-9e599b3ef622 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:26.925194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bce40-f74d-4b15-bed1-9e599b3ef622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:26.927116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bce40-f74d-4b15-bed1-9e599b3ef622 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:26.938586 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:26.948758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1290/2551] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:16:26 2022] POST /identity/v3/users => generated 309 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:26.952843 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbfa38-7628-435a-8819-dbee5bf7f5fe admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:26.963372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbfa38-7628-435a-8819-dbee5bf7f5fe admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:26.968828 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd64260-f515-4dec-aade-d17c317a917c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:26.969429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd64260-f515-4dec-aade-d17c317a917c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:26.969704 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd64260-f515-4dec-aade-d17c317a917c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:26.969973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd64260-f515-4dec-aade-d17c317a917c admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:26.970606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd64260-f515-4dec-aade-d17c317a917c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:26.972244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd64260-f515-4dec-aade-d17c317a917c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:26.984438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1262/2552] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:26.988782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bce40-f74d-4b15-bed1-9e599b3ef622 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:26.999024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bce40-f74d-4b15-bed1-9e599b3ef622 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:27.003922 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518596c-ccc7-4c53-8e1c-8066fcc6c41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:27.004623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518596c-ccc7-4c53-8e1c-8066fcc6c41b admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:27.004899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518596c-ccc7-4c53-8e1c-8066fcc6c41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:27.005173 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518596c-ccc7-4c53-8e1c-8066fcc6c41b admin admin] PATH_INFO: `/v3/projects/76534d0f5bb14edaa91e52b169b470f0/users/eed5d8be806b4ff0813fbae5c9088d17/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:27.021454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518596c-ccc7-4c53-8e1c-8066fcc6c41b admin admin] RBAC: Authorizing `identity:create_grant(project_id=76534d0f5bb14edaa91e52b169b470f0, user_id=eed5d8be806b4ff0813fbae5c9088d17, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:27.024195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518596c-ccc7-4c53-8e1c-8066fcc6c41b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:27.038462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1291/2553] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:26 2022] PUT /identity/v3/projects/76534d0f5bb14edaa91e52b169b470f0/users/eed5d8be806b4ff0813fbae5c9088d17/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:27.048154 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd64260-f515-4dec-aade-d17c317a917c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:27.058175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd64260-f515-4dec-aade-d17c317a917c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:27.070023 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:27.115555 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b024db4-7b7c-46f1-9e6d-c80bc7e117d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:27.116125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b024db4-7b7c-46f1-9e6d-c80bc7e117d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:27.116404 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b024db4-7b7c-46f1-9e6d-c80bc7e117d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:27.116676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b024db4-7b7c-46f1-9e6d-c80bc7e117d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:27.117311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b024db4-7b7c-46f1-9e6d-c80bc7e117d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:27.118904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b024db4-7b7c-46f1-9e6d-c80bc7e117d0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:27.130807 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1263/2554] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:16:27.135190 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518596c-ccc7-4c53-8e1c-8066fcc6c41b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:27.145728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518596c-ccc7-4c53-8e1c-8066fcc6c41b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:27.150524 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bbfc1-67f1-46b3-8807-beb33c931715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:27.150918 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bbfc1-67f1-46b3-8807-beb33c931715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:27.151811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bbfc1-67f1-46b3-8807-beb33c931715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:27.152122 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bbfc1-67f1-46b3-8807-beb33c931715 admin admin] PATH_INFO: `/v3/projects/76534d0f5bb14edaa91e52b169b470f0/users/eed5d8be806b4ff0813fbae5c9088d17/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:27.154002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bbfc1-67f1-46b3-8807-beb33c931715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76534d0f5bb14edaa91e52b169b470f0, user_id=eed5d8be806b4ff0813fbae5c9088d17, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:27.156645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bbfc1-67f1-46b3-8807-beb33c931715 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:27.166568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1292/2555] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:27 2022] PUT /identity/v3/projects/76534d0f5bb14edaa91e52b169b470f0/users/eed5d8be806b4ff0813fbae5c9088d17/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:27.787017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c411d-3caf-43e8-826d-bcad0560cdf5 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:27.787300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c411d-3caf-43e8-826d-bcad0560cdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:27.787611 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c411d-3caf-43e8-826d-bcad0560cdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:27.815395 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9d2c411d-3caf-43e8-826d-bcad0560cdf5 None None] MFA Rules not processed for user `eed5d8be806b4ff0813fbae5c9088d17`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:27.816639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9d2c411d-3caf-43e8-826d-bcad0560cdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:27.889139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1264/2556] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:27 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:28.945154 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bbfc1-67f1-46b3-8807-beb33c931715 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:29.008007 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bbfc1-67f1-46b3-8807-beb33c931715 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:29.013235 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9b496-46ff-4f9e-ad58-cec3923f33bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:29.013855 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9b496-46ff-4f9e-ad58-cec3923f33bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:29.014128 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9b496-46ff-4f9e-ad58-cec3923f33bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:29.014394 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9b496-46ff-4f9e-ad58-cec3923f33bc admin admin] PATH_INFO: `/v3/users/40b18b5b138b41a884dd4e23ae96f612` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:29.015922 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9b496-46ff-4f9e-ad58-cec3923f33bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b18b5b138b41a884dd4e23ae96f612)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:29.017428 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9b496-46ff-4f9e-ad58-cec3923f33bc admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:29.063445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-29c9b496-46ff-4f9e-ad58-cec3923f33bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b18b5b138b41a884dd4e23ae96f612'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.070120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-29c9b496-46ff-4f9e-ad58-cec3923f33bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b18b5b138b41a884dd4e23ae96f612'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.077348 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-29c9b496-46ff-4f9e-ad58-cec3923f33bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b18b5b138b41a884dd4e23ae96f612'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.078131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-29c9b496-46ff-4f9e-ad58-cec3923f33bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b18b5b138b41a884dd4e23ae96f612'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.089554 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-29c9b496-46ff-4f9e-ad58-cec3923f33bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b18b5b138b41a884dd4e23ae96f612'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.095272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1293/2557] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:16:28 2022] DELETE /identity/v3/users/40b18b5b138b41a884dd4e23ae96f612 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:29.267798 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c411d-3caf-43e8-826d-bcad0560cdf5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:29.279120 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c411d-3caf-43e8-826d-bcad0560cdf5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:29.336967 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcda49-7d37-49ff-999d-63972606674f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:29.337604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcda49-7d37-49ff-999d-63972606674f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:29.337882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcda49-7d37-49ff-999d-63972606674f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:29.338202 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcda49-7d37-49ff-999d-63972606674f admin admin] PATH_INFO: `/v3/projects/7bd781ea564c484b9b5e863afad545dd` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:29.340032 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcda49-7d37-49ff-999d-63972606674f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd781ea564c484b9b5e863afad545dd)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:29.341996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcda49-7d37-49ff-999d-63972606674f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:29.380724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:29.388382 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c1dcda49-7d37-49ff-999d-63972606674f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd781ea564c484b9b5e863afad545dd', 'request_id': 'req-c1dcda49-7d37-49ff-999d-63972606674f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.394514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c1dcda49-7d37-49ff-999d-63972606674f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd781ea564c484b9b5e863afad545dd', 'request_id': 'req-c1dcda49-7d37-49ff-999d-63972606674f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.400055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c1dcda49-7d37-49ff-999d-63972606674f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd781ea564c484b9b5e863afad545dd', 'request_id': 'req-c1dcda49-7d37-49ff-999d-63972606674f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.413601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c1dcda49-7d37-49ff-999d-63972606674f admin admin] The token cache is being invalidate because project 7bd781ea564c484b9b5e863afad545dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:16:29.413888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c1dcda49-7d37-49ff-999d-63972606674f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.414509 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c1dcda49-7d37-49ff-999d-63972606674f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.416035 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1265/2558] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:16:29 2022] DELETE /identity/v3/projects/7bd781ea564c484b9b5e863afad545dd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:29.419963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9b496-46ff-4f9e-ad58-cec3923f33bc admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:29.421371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-29c9b496-46ff-4f9e-ad58-cec3923f33bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:29.434187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9b496-46ff-4f9e-ad58-cec3923f33bc admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:29.469217 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:29.493938 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c307662-fb5c-4256-a80f-24af7ddd86ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:29.494581 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c307662-fb5c-4256-a80f-24af7ddd86ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:29.494884 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c307662-fb5c-4256-a80f-24af7ddd86ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:29.495160 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c307662-fb5c-4256-a80f-24af7ddd86ff admin admin] PATH_INFO: `/v3/users/eed5d8be806b4ff0813fbae5c9088d17` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:29.496360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c307662-fb5c-4256-a80f-24af7ddd86ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed5d8be806b4ff0813fbae5c9088d17)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:29.498274 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c307662-fb5c-4256-a80f-24af7ddd86ff admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:29.544377 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0c307662-fb5c-4256-a80f-24af7ddd86ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed5d8be806b4ff0813fbae5c9088d17'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.551041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0c307662-fb5c-4256-a80f-24af7ddd86ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed5d8be806b4ff0813fbae5c9088d17'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.558408 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0c307662-fb5c-4256-a80f-24af7ddd86ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed5d8be806b4ff0813fbae5c9088d17'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.559026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0c307662-fb5c-4256-a80f-24af7ddd86ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed5d8be806b4ff0813fbae5c9088d17'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.570582 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0c307662-fb5c-4256-a80f-24af7ddd86ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed5d8be806b4ff0813fbae5c9088d17'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.576938 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1294/2559] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:16:29 2022] DELETE /identity/v3/users/eed5d8be806b4ff0813fbae5c9088d17 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:29.764447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcda49-7d37-49ff-999d-63972606674f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:29.765981 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c1dcda49-7d37-49ff-999d-63972606674f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:29.779175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcda49-7d37-49ff-999d-63972606674f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:29.836872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d204df-6e50-4df3-aadc-21395aadd7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:29.837415 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d204df-6e50-4df3-aadc-21395aadd7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:29.837789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d204df-6e50-4df3-aadc-21395aadd7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:29.838058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d204df-6e50-4df3-aadc-21395aadd7d9 admin admin] PATH_INFO: `/v3/projects/76534d0f5bb14edaa91e52b169b470f0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:29.839187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d204df-6e50-4df3-aadc-21395aadd7d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76534d0f5bb14edaa91e52b169b470f0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:29.841110 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d204df-6e50-4df3-aadc-21395aadd7d9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:29.886489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e6d204df-6e50-4df3-aadc-21395aadd7d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76534d0f5bb14edaa91e52b169b470f0', 'request_id': 'req-e6d204df-6e50-4df3-aadc-21395aadd7d9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.892606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e6d204df-6e50-4df3-aadc-21395aadd7d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76534d0f5bb14edaa91e52b169b470f0', 'request_id': 'req-e6d204df-6e50-4df3-aadc-21395aadd7d9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.898063 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e6d204df-6e50-4df3-aadc-21395aadd7d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76534d0f5bb14edaa91e52b169b470f0', 'request_id': 'req-e6d204df-6e50-4df3-aadc-21395aadd7d9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.910703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e6d204df-6e50-4df3-aadc-21395aadd7d9 admin admin] The token cache is being invalidate because project 76534d0f5bb14edaa91e52b169b470f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:16:29.910990 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e6d204df-6e50-4df3-aadc-21395aadd7d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.911624 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e6d204df-6e50-4df3-aadc-21395aadd7d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:29.913205 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1266/2560] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:16:29 2022] DELETE /identity/v3/projects/76534d0f5bb14edaa91e52b169b470f0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:29.918210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd29ac-0e0f-4218-bf61-7bc9107486ee None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:29.918493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd29ac-0e0f-4218-bf61-7bc9107486ee None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:29.918767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd29ac-0e0f-4218-bf61-7bc9107486ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:29.938662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-29cd29ac-0e0f-4218-bf61-7bc9107486ee None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:29.939867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-29cd29ac-0e0f-4218-bf61-7bc9107486ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:29.998935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1295/2561] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:30.006905 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ac799-a570-4d1b-ad6d-5643329c348e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:30.007186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ac799-a570-4d1b-ad6d-5643329c348e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:30.007455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ac799-a570-4d1b-ad6d-5643329c348e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:30.027515 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ad8ac799-a570-4d1b-ad6d-5643329c348e None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:30.028745 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ad8ac799-a570-4d1b-ad6d-5643329c348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:30.036616 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1267/2562] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:30.040863 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd29ac-0e0f-4218-bf61-7bc9107486ee None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:30.050756 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd29ac-0e0f-4218-bf61-7bc9107486ee None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:30.055294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37bee-add5-402d-b5d9-0c432ff7c08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:30.055892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37bee-add5-402d-b5d9-0c432ff7c08d admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:30.056236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37bee-add5-402d-b5d9-0c432ff7c08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:30.056542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37bee-add5-402d-b5d9-0c432ff7c08d admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:30.057758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb37bee-add5-402d-b5d9-0c432ff7c08d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:16:30.058065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb37bee-add5-402d-b5d9-0c432ff7c08d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:30.059653 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb37bee-add5-402d-b5d9-0c432ff7c08d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:30.071102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1296/2563] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:16:30.075957 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ac799-a570-4d1b-ad6d-5643329c348e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:30.085095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ac799-a570-4d1b-ad6d-5643329c348e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:30.089784 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15ce9f-f9b3-40bb-aca0-3582ead7b6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:30.090311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15ce9f-f9b3-40bb-aca0-3582ead7b6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:30.090588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15ce9f-f9b3-40bb-aca0-3582ead7b6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:30.090865 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15ce9f-f9b3-40bb-aca0-3582ead7b6b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:30.091481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15ce9f-f9b3-40bb-aca0-3582ead7b6b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:30.093398 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15ce9f-f9b3-40bb-aca0-3582ead7b6b9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:30.120601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1268/2564] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:16:30 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:30.124766 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37bee-add5-402d-b5d9-0c432ff7c08d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:30.134853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37bee-add5-402d-b5d9-0c432ff7c08d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:30.175652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:30.193112 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330783f9-2d5c-4f2b-80f0-c95b9869beb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:30.193724 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330783f9-2d5c-4f2b-80f0-c95b9869beb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:30.194019 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330783f9-2d5c-4f2b-80f0-c95b9869beb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:30.194273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330783f9-2d5c-4f2b-80f0-c95b9869beb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:30.194899 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330783f9-2d5c-4f2b-80f0-c95b9869beb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:30.196932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330783f9-2d5c-4f2b-80f0-c95b9869beb6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:30.217717 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1297/2565] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:16:30 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:30.221760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15ce9f-f9b3-40bb-aca0-3582ead7b6b9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:30.232520 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15ce9f-f9b3-40bb-aca0-3582ead7b6b9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:30.237015 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148e9f6-d528-4bc8-a67d-5a81f5586d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:30.237599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148e9f6-d528-4bc8-a67d-5a81f5586d61 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:30.237871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148e9f6-d528-4bc8-a67d-5a81f5586d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:30.238135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148e9f6-d528-4bc8-a67d-5a81f5586d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:30.238769 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148e9f6-d528-4bc8-a67d-5a81f5586d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:30.240568 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148e9f6-d528-4bc8-a67d-5a81f5586d61 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:30.251525 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1269/2566] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:30.255729 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330783f9-2d5c-4f2b-80f0-c95b9869beb6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:30.265605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330783f9-2d5c-4f2b-80f0-c95b9869beb6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:30.270189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b828c-97c7-4e4b-8351-7303676c5536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:30.270774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b828c-97c7-4e4b-8351-7303676c5536 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:30.271050 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b828c-97c7-4e4b-8351-7303676c5536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:30.271319 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b828c-97c7-4e4b-8351-7303676c5536 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:30.271976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b828c-97c7-4e4b-8351-7303676c5536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:30.273591 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b828c-97c7-4e4b-8351-7303676c5536 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:30.284141 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1298/2567] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:30.288157 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148e9f6-d528-4bc8-a67d-5a81f5586d61 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:30.299731 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148e9f6-d528-4bc8-a67d-5a81f5586d61 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:30.304356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd813d-fcc3-4a0f-b4b2-54dbdf6f2175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:30.304997 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd813d-fcc3-4a0f-b4b2-54dbdf6f2175 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:30.305267 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd813d-fcc3-4a0f-b4b2-54dbdf6f2175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:30.305532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd813d-fcc3-4a0f-b4b2-54dbdf6f2175 admin admin] PATH_INFO: `/v3/projects/f96884f5894d4113b779f0bd2e34136e/users/e365b682ba38498c9955e2733b949d1a/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:30.320149 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd813d-fcc3-4a0f-b4b2-54dbdf6f2175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f96884f5894d4113b779f0bd2e34136e, user_id=e365b682ba38498c9955e2733b949d1a, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:30.322786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd813d-fcc3-4a0f-b4b2-54dbdf6f2175 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:30.325788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:30.338511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1270/2568] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:30 2022] PUT /identity/v3/projects/f96884f5894d4113b779f0bd2e34136e/users/e365b682ba38498c9955e2733b949d1a/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:30.349922 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4fcb7-b3e3-48c1-9b44-c94e03ec68f1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:30.350235 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4fcb7-b3e3-48c1-9b44-c94e03ec68f1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:30.350508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4fcb7-b3e3-48c1-9b44-c94e03ec68f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:30.378962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e7a4fcb7-b3e3-48c1-9b44-c94e03ec68f1 None None] MFA Rules not processed for user `e365b682ba38498c9955e2733b949d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:30.380245 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e7a4fcb7-b3e3-48c1-9b44-c94e03ec68f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:30.445726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1299/2569] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:30.450156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd813d-fcc3-4a0f-b4b2-54dbdf6f2175 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:30.511199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd813d-fcc3-4a0f-b4b2-54dbdf6f2175 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:30.515886 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63794186-eb7f-4f6b-975d-1341a38823de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:30.516514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63794186-eb7f-4f6b-975d-1341a38823de admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:30.516794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63794186-eb7f-4f6b-975d-1341a38823de admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:30.517068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63794186-eb7f-4f6b-975d-1341a38823de admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:30.517707 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63794186-eb7f-4f6b-975d-1341a38823de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:30.519608 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63794186-eb7f-4f6b-975d-1341a38823de admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:30.548386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1271/2570] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:16:30 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:30.553055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4fcb7-b3e3-48c1-9b44-c94e03ec68f1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:30.563690 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4fcb7-b3e3-48c1-9b44-c94e03ec68f1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:30.620269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0853d5b-d0b6-45b7-8e48-6f7e50b83b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:30.620791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0853d5b-d0b6-45b7-8e48-6f7e50b83b7a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:30.621067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0853d5b-d0b6-45b7-8e48-6f7e50b83b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:30.621337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0853d5b-d0b6-45b7-8e48-6f7e50b83b7a admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:30.622028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0853d5b-d0b6-45b7-8e48-6f7e50b83b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:30.623929 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0853d5b-d0b6-45b7-8e48-6f7e50b83b7a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:30.645541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1300/2571] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:16:30 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:30.649568 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63794186-eb7f-4f6b-975d-1341a38823de admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:30.660504 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63794186-eb7f-4f6b-975d-1341a38823de admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:30.665111 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa977ec9-ed92-44d2-ac92-27009e633fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:30.665739 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa977ec9-ed92-44d2-ac92-27009e633fad admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:30.666017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa977ec9-ed92-44d2-ac92-27009e633fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:30.666292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa977ec9-ed92-44d2-ac92-27009e633fad admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:30.667554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa977ec9-ed92-44d2-ac92-27009e633fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:30.669177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa977ec9-ed92-44d2-ac92-27009e633fad admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:30.681069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1272/2572] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:30.685148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0853d5b-d0b6-45b7-8e48-6f7e50b83b7a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:30.695184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0853d5b-d0b6-45b7-8e48-6f7e50b83b7a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:30.700423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317d1bc-f5d6-4d04-8bf3-851d4622b122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:30.701065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317d1bc-f5d6-4d04-8bf3-851d4622b122 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:30.701339 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317d1bc-f5d6-4d04-8bf3-851d4622b122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:30.701607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317d1bc-f5d6-4d04-8bf3-851d4622b122 admin admin] PATH_INFO: `/v3/projects/9661a6497e1c45a480635136a42daaab/users/2fecc69d79944f939aeaf35bb58516a9/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:30.716947 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317d1bc-f5d6-4d04-8bf3-851d4622b122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9661a6497e1c45a480635136a42daaab, user_id=2fecc69d79944f939aeaf35bb58516a9, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:30.719568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317d1bc-f5d6-4d04-8bf3-851d4622b122 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:30.732693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1301/2573] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:30 2022] PUT /identity/v3/projects/9661a6497e1c45a480635136a42daaab/users/2fecc69d79944f939aeaf35bb58516a9/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:30.736656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa977ec9-ed92-44d2-ac92-27009e633fad admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:30.746639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa977ec9-ed92-44d2-ac92-27009e633fad admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:30.803076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7737a24-a269-4973-958d-0fe98c3f900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:30.803671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7737a24-a269-4973-958d-0fe98c3f900d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:30.803970 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7737a24-a269-4973-958d-0fe98c3f900d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:30.804239 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7737a24-a269-4973-958d-0fe98c3f900d admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:30.804867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7737a24-a269-4973-958d-0fe98c3f900d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:30.806561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7737a24-a269-4973-958d-0fe98c3f900d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:30.817438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1273/2574] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:30.821695 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317d1bc-f5d6-4d04-8bf3-851d4622b122 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:30.832286 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317d1bc-f5d6-4d04-8bf3-851d4622b122 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:30.836798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c0623-3df1-491e-920d-903b6cfb8a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:30.837444 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c0623-3df1-491e-920d-903b6cfb8a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:30.837715 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c0623-3df1-491e-920d-903b6cfb8a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:30.837982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c0623-3df1-491e-920d-903b6cfb8a01 admin admin] PATH_INFO: `/v3/projects/9661a6497e1c45a480635136a42daaab/users/2fecc69d79944f939aeaf35bb58516a9/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:30.841317 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c0623-3df1-491e-920d-903b6cfb8a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9661a6497e1c45a480635136a42daaab, user_id=2fecc69d79944f939aeaf35bb58516a9, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:30.843930 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c0623-3df1-491e-920d-903b6cfb8a01 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:30.855212 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1302/2575] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:30 2022] PUT /identity/v3/projects/9661a6497e1c45a480635136a42daaab/users/2fecc69d79944f939aeaf35bb58516a9/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:30.865528 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018f113-5c97-4e0b-b550-470eb78fc800 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:30.865815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018f113-5c97-4e0b-b550-470eb78fc800 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:30.866091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018f113-5c97-4e0b-b550-470eb78fc800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:30.894650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8018f113-5c97-4e0b-b550-470eb78fc800 None None] MFA Rules not processed for user `2fecc69d79944f939aeaf35bb58516a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:30.895882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8018f113-5c97-4e0b-b550-470eb78fc800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:30.945900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:30.965231 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1274/2576] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:16:30.976681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c0623-3df1-491e-920d-903b6cfb8a01 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:30.978385 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ea3c0623-3df1-491e-920d-903b6cfb8a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:30.985020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:31.037065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c0623-3df1-491e-920d-903b6cfb8a01 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:31.040851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8cbee-deb8-4cf2-b73d-0b89ce65a094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:31.041465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8cbee-deb8-4cf2-b73d-0b89ce65a094 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:31.041743 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8cbee-deb8-4cf2-b73d-0b89ce65a094 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:31.042013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8cbee-deb8-4cf2-b73d-0b89ce65a094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:31.051205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8cbee-deb8-4cf2-b73d-0b89ce65a094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:31.052656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8cbee-deb8-4cf2-b73d-0b89ce65a094 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:31.062126 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1303/2577] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:16:31.477250 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018f113-5c97-4e0b-b550-470eb78fc800 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:31.539496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018f113-5c97-4e0b-b550-470eb78fc800 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:31.544783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbecc2e-bfbd-45b2-8cf3-ec31e6d5d623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:31.545409 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbecc2e-bfbd-45b2-8cf3-ec31e6d5d623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:31.545684 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbecc2e-bfbd-45b2-8cf3-ec31e6d5d623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:31.545954 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbecc2e-bfbd-45b2-8cf3-ec31e6d5d623 admin admin] PATH_INFO: `/v3/users/e365b682ba38498c9955e2733b949d1a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:31.547093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbecc2e-bfbd-45b2-8cf3-ec31e6d5d623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e365b682ba38498c9955e2733b949d1a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:31.549028 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbecc2e-bfbd-45b2-8cf3-ec31e6d5d623 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:31.597153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2bbecc2e-bfbd-45b2-8cf3-ec31e6d5d623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e365b682ba38498c9955e2733b949d1a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:31.609192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2bbecc2e-bfbd-45b2-8cf3-ec31e6d5d623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e365b682ba38498c9955e2733b949d1a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:31.615964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2bbecc2e-bfbd-45b2-8cf3-ec31e6d5d623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e365b682ba38498c9955e2733b949d1a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:31.616656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2bbecc2e-bfbd-45b2-8cf3-ec31e6d5d623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e365b682ba38498c9955e2733b949d1a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:31.617260 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2bbecc2e-bfbd-45b2-8cf3-ec31e6d5d623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e365b682ba38498c9955e2733b949d1a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:31.630399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1275/2578] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:16:31 2022] DELETE /identity/v3/users/e365b682ba38498c9955e2733b949d1a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:31.634961 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd277c0-2d50-4e37-aa81-78da03d18e90 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:31.635249 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd277c0-2d50-4e37-aa81-78da03d18e90 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:31.636089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd277c0-2d50-4e37-aa81-78da03d18e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:31.655554 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bdd277c0-2d50-4e37-aa81-78da03d18e90 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:31.656734 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bdd277c0-2d50-4e37-aa81-78da03d18e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:31.715142 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1304/2579] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:31.724817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbecc2e-bfbd-45b2-8cf3-ec31e6d5d623 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:31.730885 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2bbecc2e-bfbd-45b2-8cf3-ec31e6d5d623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:31.794978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbecc2e-bfbd-45b2-8cf3-ec31e6d5d623 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:31.798590 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64680c20-dcc2-4676-90b8-8dc46614ae92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:31.799191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64680c20-dcc2-4676-90b8-8dc46614ae92 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:31.799467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64680c20-dcc2-4676-90b8-8dc46614ae92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:31.799741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64680c20-dcc2-4676-90b8-8dc46614ae92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:31.809313 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64680c20-dcc2-4676-90b8-8dc46614ae92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:31.810732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64680c20-dcc2-4676-90b8-8dc46614ae92 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:31.820045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1276/2580] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:32.092285 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd277c0-2d50-4e37-aa81-78da03d18e90 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:32.094015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bdd277c0-2d50-4e37-aa81-78da03d18e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:32.107492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd277c0-2d50-4e37-aa81-78da03d18e90 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:32.112446 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3b461-d12f-44fe-9581-8239a0f3a54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:32.113084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3b461-d12f-44fe-9581-8239a0f3a54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:32.113358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3b461-d12f-44fe-9581-8239a0f3a54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:32.113655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3b461-d12f-44fe-9581-8239a0f3a54a admin admin] PATH_INFO: `/v3/projects/f96884f5894d4113b779f0bd2e34136e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:32.114805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3b461-d12f-44fe-9581-8239a0f3a54a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f96884f5894d4113b779f0bd2e34136e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:32.116733 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3b461-d12f-44fe-9581-8239a0f3a54a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:32.169117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9ea3b461-d12f-44fe-9581-8239a0f3a54a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f96884f5894d4113b779f0bd2e34136e', 'request_id': 'req-9ea3b461-d12f-44fe-9581-8239a0f3a54a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:32.176948 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9ea3b461-d12f-44fe-9581-8239a0f3a54a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f96884f5894d4113b779f0bd2e34136e', 'request_id': 'req-9ea3b461-d12f-44fe-9581-8239a0f3a54a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:32.185710 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9ea3b461-d12f-44fe-9581-8239a0f3a54a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f96884f5894d4113b779f0bd2e34136e', 'request_id': 'req-9ea3b461-d12f-44fe-9581-8239a0f3a54a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:32.197199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9ea3b461-d12f-44fe-9581-8239a0f3a54a admin admin] The token cache is being invalidate because project f96884f5894d4113b779f0bd2e34136e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:16:32.197518 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9ea3b461-d12f-44fe-9581-8239a0f3a54a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:32.198749 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9ea3b461-d12f-44fe-9581-8239a0f3a54a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:32.200263 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1305/2581] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:16:32 2022] DELETE /identity/v3/projects/f96884f5894d4113b779f0bd2e34136e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:32.204416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64680c20-dcc2-4676-90b8-8dc46614ae92 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:32.214224 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64680c20-dcc2-4676-90b8-8dc46614ae92 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:32.222798 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:32.272925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22037e92-11b6-4734-9458-28a18fe8e41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:32.273542 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22037e92-11b6-4734-9458-28a18fe8e41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:32.273815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22037e92-11b6-4734-9458-28a18fe8e41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:32.274079 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22037e92-11b6-4734-9458-28a18fe8e41c admin admin] PATH_INFO: `/v3/users/2fecc69d79944f939aeaf35bb58516a9` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:32.275170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22037e92-11b6-4734-9458-28a18fe8e41c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fecc69d79944f939aeaf35bb58516a9)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:32.277141 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22037e92-11b6-4734-9458-28a18fe8e41c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:32.321381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-22037e92-11b6-4734-9458-28a18fe8e41c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fecc69d79944f939aeaf35bb58516a9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:32.334056 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-22037e92-11b6-4734-9458-28a18fe8e41c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fecc69d79944f939aeaf35bb58516a9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:32.340898 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-22037e92-11b6-4734-9458-28a18fe8e41c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fecc69d79944f939aeaf35bb58516a9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:32.341563 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-22037e92-11b6-4734-9458-28a18fe8e41c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fecc69d79944f939aeaf35bb58516a9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:32.342173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-22037e92-11b6-4734-9458-28a18fe8e41c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fecc69d79944f939aeaf35bb58516a9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:32.354949 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1277/2582] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:16:32 2022] DELETE /identity/v3/users/2fecc69d79944f939aeaf35bb58516a9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:32.628654 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3b461-d12f-44fe-9581-8239a0f3a54a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:32.630117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9ea3b461-d12f-44fe-9581-8239a0f3a54a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:32.647146 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3b461-d12f-44fe-9581-8239a0f3a54a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:32.678274 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:32.708033 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875f571-4603-4d2e-8476-96debe4b9f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:32.708694 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875f571-4603-4d2e-8476-96debe4b9f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:32.708969 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875f571-4603-4d2e-8476-96debe4b9f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:32.709235 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875f571-4603-4d2e-8476-96debe4b9f78 admin admin] PATH_INFO: `/v3/projects/9661a6497e1c45a480635136a42daaab` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:32.710336 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875f571-4603-4d2e-8476-96debe4b9f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9661a6497e1c45a480635136a42daaab)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:32.712257 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875f571-4603-4d2e-8476-96debe4b9f78 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:32.758584 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a875f571-4603-4d2e-8476-96debe4b9f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9661a6497e1c45a480635136a42daaab', 'request_id': 'req-a875f571-4603-4d2e-8476-96debe4b9f78'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:32.764445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a875f571-4603-4d2e-8476-96debe4b9f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9661a6497e1c45a480635136a42daaab', 'request_id': 'req-a875f571-4603-4d2e-8476-96debe4b9f78'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:32.771722 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a875f571-4603-4d2e-8476-96debe4b9f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9661a6497e1c45a480635136a42daaab', 'request_id': 'req-a875f571-4603-4d2e-8476-96debe4b9f78'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:32.783617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a875f571-4603-4d2e-8476-96debe4b9f78 admin admin] The token cache is being invalidate because project 9661a6497e1c45a480635136a42daaab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:16:32.783903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a875f571-4603-4d2e-8476-96debe4b9f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:32.784587 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a875f571-4603-4d2e-8476-96debe4b9f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:32.786059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1306/2583] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:16:32 2022] DELETE /identity/v3/projects/9661a6497e1c45a480635136a42daaab => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:16:32.792178 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789308e-febb-456e-8652-496606f9cf51 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:32.792691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789308e-febb-456e-8652-496606f9cf51 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:32.792871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789308e-febb-456e-8652-496606f9cf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:32.816628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f789308e-febb-456e-8652-496606f9cf51 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:32.817844 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f789308e-febb-456e-8652-496606f9cf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:32.878196 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1278/2584] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:32.886045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baea4d2-d4da-4717-9764-52af7896c122 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:32.886325 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baea4d2-d4da-4717-9764-52af7896c122 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:32.886598 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baea4d2-d4da-4717-9764-52af7896c122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:32.907162 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9baea4d2-d4da-4717-9764-52af7896c122 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:32.908425 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9baea4d2-d4da-4717-9764-52af7896c122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:32.916404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1307/2585] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:32.921214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789308e-febb-456e-8652-496606f9cf51 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:32.930858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789308e-febb-456e-8652-496606f9cf51 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:32.935424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f5072-4d89-4343-83ed-c7f798b05e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:32.936043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f5072-4d89-4343-83ed-c7f798b05e56 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:32.936323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f5072-4d89-4343-83ed-c7f798b05e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:32.936591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f5072-4d89-4343-83ed-c7f798b05e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:32.937228 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f5072-4d89-4343-83ed-c7f798b05e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:16:32.937557 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f5072-4d89-4343-83ed-c7f798b05e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:32.939149 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f5072-4d89-4343-83ed-c7f798b05e56 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:32.951091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1279/2586] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:16:32.957110 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baea4d2-d4da-4717-9764-52af7896c122 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:32.967345 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baea4d2-d4da-4717-9764-52af7896c122 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:32.971845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109cdd7-24b9-4f35-96f6-b5b528f52031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:32.972471 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109cdd7-24b9-4f35-96f6-b5b528f52031 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:32.972744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109cdd7-24b9-4f35-96f6-b5b528f52031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:32.973010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109cdd7-24b9-4f35-96f6-b5b528f52031 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:32.973637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109cdd7-24b9-4f35-96f6-b5b528f52031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:32.975527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109cdd7-24b9-4f35-96f6-b5b528f52031 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:33.003606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1308/2587] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:16:32 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:33.007842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f5072-4d89-4343-83ed-c7f798b05e56 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:33.017981 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f5072-4d89-4343-83ed-c7f798b05e56 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:33.035777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:33.079292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4216e88-84d0-4d02-a7f2-97b486850435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:33.079891 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4216e88-84d0-4d02-a7f2-97b486850435 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:33.080197 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4216e88-84d0-4d02-a7f2-97b486850435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:33.080464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4216e88-84d0-4d02-a7f2-97b486850435 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:33.081094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4216e88-84d0-4d02-a7f2-97b486850435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:33.082981 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4216e88-84d0-4d02-a7f2-97b486850435 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:33.104924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1280/2588] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:16:33 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:33.109006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109cdd7-24b9-4f35-96f6-b5b528f52031 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:33.119160 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109cdd7-24b9-4f35-96f6-b5b528f52031 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:33.127796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742d166-35e9-4bae-b80b-deb885af45e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:33.128435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742d166-35e9-4bae-b80b-deb885af45e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:33.128710 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742d166-35e9-4bae-b80b-deb885af45e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:33.128975 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742d166-35e9-4bae-b80b-deb885af45e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:33.129615 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742d166-35e9-4bae-b80b-deb885af45e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:33.131205 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742d166-35e9-4bae-b80b-deb885af45e8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:33.142136 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1309/2589] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:33.146485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4216e88-84d0-4d02-a7f2-97b486850435 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:33.157102 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4216e88-84d0-4d02-a7f2-97b486850435 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:33.161693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb5be9-7a70-4baa-985d-039cd6ce99df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:33.162278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb5be9-7a70-4baa-985d-039cd6ce99df admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:33.162548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb5be9-7a70-4baa-985d-039cd6ce99df admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:33.162819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb5be9-7a70-4baa-985d-039cd6ce99df admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:33.163466 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb5be9-7a70-4baa-985d-039cd6ce99df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:33.165082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb5be9-7a70-4baa-985d-039cd6ce99df admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:33.176626 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1281/2590] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:33.180669 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742d166-35e9-4bae-b80b-deb885af45e8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:33.191253 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742d166-35e9-4bae-b80b-deb885af45e8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:33.195794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493f045-a7b4-4f26-a57b-22f6228927a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:33.196467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f045-a7b4-4f26-a57b-22f6228927a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:33.196743 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f045-a7b4-4f26-a57b-22f6228927a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:33.197011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f045-a7b4-4f26-a57b-22f6228927a1 admin admin] PATH_INFO: `/v3/projects/ad8307758386467288ee0f8b9e44e117/users/91ee15a909704afbba1d7f47a6e242ef/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:33.212500 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493f045-a7b4-4f26-a57b-22f6228927a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8307758386467288ee0f8b9e44e117, user_id=91ee15a909704afbba1d7f47a6e242ef, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:33.215800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493f045-a7b4-4f26-a57b-22f6228927a1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:33.229901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1310/2591] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:33 2022] PUT /identity/v3/projects/ad8307758386467288ee0f8b9e44e117/users/91ee15a909704afbba1d7f47a6e242ef/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:16:33.239603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f82e3-2b94-4a7e-b54e-d67da9955371 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:33.239909 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f82e3-2b94-4a7e-b54e-d67da9955371 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:33.240229 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f82e3-2b94-4a7e-b54e-d67da9955371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:33.268105 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b77f82e3-2b94-4a7e-b54e-d67da9955371 None None] MFA Rules not processed for user `91ee15a909704afbba1d7f47a6e242ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:33.269302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b77f82e3-2b94-4a7e-b54e-d67da9955371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:33.333238 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1282/2592] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:33.337686 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493f045-a7b4-4f26-a57b-22f6228927a1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:33.396575 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:33.400328 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493f045-a7b4-4f26-a57b-22f6228927a1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:33.406107 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb6a70-4539-459a-9e4a-f13964dd1a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:33.406713 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb6a70-4539-459a-9e4a-f13964dd1a6f admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:33.407195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb6a70-4539-459a-9e4a-f13964dd1a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:33.407509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb6a70-4539-459a-9e4a-f13964dd1a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:33.408369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb6a70-4539-459a-9e4a-f13964dd1a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:33.410411 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb6a70-4539-459a-9e4a-f13964dd1a6f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:33.437480 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1311/2593] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:16:33 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:16:33.441636 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f82e3-2b94-4a7e-b54e-d67da9955371 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:33.453254 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f82e3-2b94-4a7e-b54e-d67da9955371 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:33.510092 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f107a-34b1-420d-84de-5d2a013a7e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:33.510591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f107a-34b1-420d-84de-5d2a013a7e1f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:33.510866 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f107a-34b1-420d-84de-5d2a013a7e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:33.511135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f107a-34b1-420d-84de-5d2a013a7e1f admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:33.511771 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f107a-34b1-420d-84de-5d2a013a7e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:33.513709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f107a-34b1-420d-84de-5d2a013a7e1f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:33.535262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1283/2594] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:16:33 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:33.539356 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb6a70-4539-459a-9e4a-f13964dd1a6f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:33.550473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb6a70-4539-459a-9e4a-f13964dd1a6f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:33.555379 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17908c39-7bcd-46f4-917b-d8aaccde1b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:33.556006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17908c39-7bcd-46f4-917b-d8aaccde1b2a admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:33.556286 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17908c39-7bcd-46f4-917b-d8aaccde1b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:33.556553 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17908c39-7bcd-46f4-917b-d8aaccde1b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:33.557221 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17908c39-7bcd-46f4-917b-d8aaccde1b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:33.558799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17908c39-7bcd-46f4-917b-d8aaccde1b2a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:33.569334 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1312/2595] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:33.573511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f107a-34b1-420d-84de-5d2a013a7e1f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:33.583598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f107a-34b1-420d-84de-5d2a013a7e1f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:33.588924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188abb6-78be-4a02-a1aa-7fcf6f36723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:33.589597 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188abb6-78be-4a02-a1aa-7fcf6f36723e admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:33.589886 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188abb6-78be-4a02-a1aa-7fcf6f36723e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:33.590141 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188abb6-78be-4a02-a1aa-7fcf6f36723e admin admin] PATH_INFO: `/v3/projects/91240fb89cb94fabb7d95047d13d3b2a/users/6f771ee54c4c4929971716c79a7446f7/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:33.604952 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188abb6-78be-4a02-a1aa-7fcf6f36723e admin admin] RBAC: Authorizing `identity:create_grant(project_id=91240fb89cb94fabb7d95047d13d3b2a, user_id=6f771ee54c4c4929971716c79a7446f7, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:33.607602 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188abb6-78be-4a02-a1aa-7fcf6f36723e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:33.609796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:33.621776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1284/2596] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:33 2022] PUT /identity/v3/projects/91240fb89cb94fabb7d95047d13d3b2a/users/6f771ee54c4c4929971716c79a7446f7/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:33.625712 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17908c39-7bcd-46f4-917b-d8aaccde1b2a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:33.636228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17908c39-7bcd-46f4-917b-d8aaccde1b2a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:33.693111 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7800c-9de5-4d8a-9d93-dbbc1f426029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:33.693709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7800c-9de5-4d8a-9d93-dbbc1f426029 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:33.693983 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7800c-9de5-4d8a-9d93-dbbc1f426029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:33.694252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7800c-9de5-4d8a-9d93-dbbc1f426029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:33.694879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7800c-9de5-4d8a-9d93-dbbc1f426029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:33.696475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7800c-9de5-4d8a-9d93-dbbc1f426029 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:33.705999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1313/2597] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:33.710214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188abb6-78be-4a02-a1aa-7fcf6f36723e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:33.721199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188abb6-78be-4a02-a1aa-7fcf6f36723e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:33.725870 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4e114-2bff-4b53-ba3c-92db5e6abab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:33.726517 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4e114-2bff-4b53-ba3c-92db5e6abab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:33.726796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4e114-2bff-4b53-ba3c-92db5e6abab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:33.727052 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4e114-2bff-4b53-ba3c-92db5e6abab8 admin admin] PATH_INFO: `/v3/projects/91240fb89cb94fabb7d95047d13d3b2a/users/6f771ee54c4c4929971716c79a7446f7/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:33.729024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4e114-2bff-4b53-ba3c-92db5e6abab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91240fb89cb94fabb7d95047d13d3b2a, user_id=6f771ee54c4c4929971716c79a7446f7, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:33.732160 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4e114-2bff-4b53-ba3c-92db5e6abab8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:33.742611 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1285/2598] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:33 2022] PUT /identity/v3/projects/91240fb89cb94fabb7d95047d13d3b2a/users/6f771ee54c4c4929971716c79a7446f7/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:33.753447 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dcccb-1965-4a1b-8902-86863315e767 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:33.753732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dcccb-1965-4a1b-8902-86863315e767 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:33.754002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dcccb-1965-4a1b-8902-86863315e767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:33.782906 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c06dcccb-1965-4a1b-8902-86863315e767 None None] MFA Rules not processed for user `6f771ee54c4c4929971716c79a7446f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:33.784086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c06dcccb-1965-4a1b-8902-86863315e767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:33.861567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1314/2599] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:33.869367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4e114-2bff-4b53-ba3c-92db5e6abab8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:33.871447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-23a4e114-2bff-4b53-ba3c-92db5e6abab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:33.934863 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4e114-2bff-4b53-ba3c-92db5e6abab8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:33.939378 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26040d2-bbc2-4ce9-8e58-bae3a1924872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:33.940057 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26040d2-bbc2-4ce9-8e58-bae3a1924872 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:33.940336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26040d2-bbc2-4ce9-8e58-bae3a1924872 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:33.940601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26040d2-bbc2-4ce9-8e58-bae3a1924872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:33.951469 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26040d2-bbc2-4ce9-8e58-bae3a1924872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:33.953430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26040d2-bbc2-4ce9-8e58-bae3a1924872 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:33.966024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1286/2600] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:33 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:34.026793 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dcccb-1965-4a1b-8902-86863315e767 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:34.038106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dcccb-1965-4a1b-8902-86863315e767 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:34.042861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68780002-08ff-4ea0-a609-5bad39b2d9aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:34.043512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68780002-08ff-4ea0-a609-5bad39b2d9aa service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:34.043789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68780002-08ff-4ea0-a609-5bad39b2d9aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:34.044085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68780002-08ff-4ea0-a609-5bad39b2d9aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:34.096435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:34.109185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68780002-08ff-4ea0-a609-5bad39b2d9aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:34.110644 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68780002-08ff-4ea0-a609-5bad39b2d9aa service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:34.120590 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1315/2601] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:37.428441 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26040d2-bbc2-4ce9-8e58-bae3a1924872 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:37.491508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26040d2-bbc2-4ce9-8e58-bae3a1924872 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:37.496210 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb760a-742c-4a93-a6ba-b392b91b717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:37.496839 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb760a-742c-4a93-a6ba-b392b91b717e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:37.497116 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb760a-742c-4a93-a6ba-b392b91b717e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:37.497387 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb760a-742c-4a93-a6ba-b392b91b717e admin admin] PATH_INFO: `/v3/users/91ee15a909704afbba1d7f47a6e242ef` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:37.498512 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb760a-742c-4a93-a6ba-b392b91b717e admin admin] RBAC: Authorizing `identity:delete_user(user_id=91ee15a909704afbba1d7f47a6e242ef)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:37.500437 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb760a-742c-4a93-a6ba-b392b91b717e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:37.551902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-55eb760a-742c-4a93-a6ba-b392b91b717e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91ee15a909704afbba1d7f47a6e242ef'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:37.564845 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-55eb760a-742c-4a93-a6ba-b392b91b717e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91ee15a909704afbba1d7f47a6e242ef'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:37.577004 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-55eb760a-742c-4a93-a6ba-b392b91b717e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91ee15a909704afbba1d7f47a6e242ef'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:37.577728 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-55eb760a-742c-4a93-a6ba-b392b91b717e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91ee15a909704afbba1d7f47a6e242ef'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:37.578359 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-55eb760a-742c-4a93-a6ba-b392b91b717e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91ee15a909704afbba1d7f47a6e242ef'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:37.594618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1287/2602] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:16:37 2022] DELETE /identity/v3/users/91ee15a909704afbba1d7f47a6e242ef => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:37.599060 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e43e7-2fd0-4636-81bc-7a34036cd473 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:37.599545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e43e7-2fd0-4636-81bc-7a34036cd473 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:37.599669 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e43e7-2fd0-4636-81bc-7a34036cd473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:37.618738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-214e43e7-2fd0-4636-81bc-7a34036cd473 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:37.620020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-214e43e7-2fd0-4636-81bc-7a34036cd473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:37.678780 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1316/2603] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:37.688751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb760a-742c-4a93-a6ba-b392b91b717e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:37.690244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-55eb760a-742c-4a93-a6ba-b392b91b717e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:37.696060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:37.756105 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb760a-742c-4a93-a6ba-b392b91b717e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:37.759855 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943ee80-b4c7-4151-80cf-ae83daa51c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:37.761045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ee80-b4c7-4151-80cf-ae83daa51c93 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:37.761315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ee80-b4c7-4151-80cf-ae83daa51c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:37.761580 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ee80-b4c7-4151-80cf-ae83daa51c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:37.771097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943ee80-b4c7-4151-80cf-ae83daa51c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:37.772557 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943ee80-b4c7-4151-80cf-ae83daa51c93 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:37.784066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1288/2604] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:38.067836 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e43e7-2fd0-4636-81bc-7a34036cd473 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:38.069340 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-214e43e7-2fd0-4636-81bc-7a34036cd473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:38.082805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e43e7-2fd0-4636-81bc-7a34036cd473 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:38.087467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:38.088740 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:38.089411 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:38.089411 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e admin admin] PATH_INFO: `/v3/projects/ad8307758386467288ee0f8b9e44e117` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:38.090560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8307758386467288ee0f8b9e44e117)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:38.092568 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:38.144917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8307758386467288ee0f8b9e44e117', 'request_id': 'req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:38.153707 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8307758386467288ee0f8b9e44e117', 'request_id': 'req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:38.162213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8307758386467288ee0f8b9e44e117', 'request_id': 'req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:38.175837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e admin admin] The token cache is being invalidate because project ad8307758386467288ee0f8b9e44e117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:16:38.176154 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:38.176800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:38.178302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1317/2605] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:16:38 2022] DELETE /identity/v3/projects/ad8307758386467288ee0f8b9e44e117 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:38.182771 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943ee80-b4c7-4151-80cf-ae83daa51c93 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:38.196653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943ee80-b4c7-4151-80cf-ae83daa51c93 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:38.280405 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c442bf-d336-45b9-bf5e-f03d306c4428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:38.281330 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c442bf-d336-45b9-bf5e-f03d306c4428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:38.281759 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c442bf-d336-45b9-bf5e-f03d306c4428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:38.282179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c442bf-d336-45b9-bf5e-f03d306c4428 admin admin] PATH_INFO: `/v3/users/6f771ee54c4c4929971716c79a7446f7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:38.283811 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c442bf-d336-45b9-bf5e-f03d306c4428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f771ee54c4c4929971716c79a7446f7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:38.287005 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c442bf-d336-45b9-bf5e-f03d306c4428 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:38.342935 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c6c442bf-d336-45b9-bf5e-f03d306c4428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f771ee54c4c4929971716c79a7446f7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:38.354774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c6c442bf-d336-45b9-bf5e-f03d306c4428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f771ee54c4c4929971716c79a7446f7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:38.361489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c6c442bf-d336-45b9-bf5e-f03d306c4428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f771ee54c4c4929971716c79a7446f7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:38.362193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c6c442bf-d336-45b9-bf5e-f03d306c4428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f771ee54c4c4929971716c79a7446f7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:38.362812 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c6c442bf-d336-45b9-bf5e-f03d306c4428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f771ee54c4c4929971716c79a7446f7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:38.375377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1289/2606] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:16:38 2022] DELETE /identity/v3/users/6f771ee54c4c4929971716c79a7446f7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:38.670769 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:38.672312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:38.685601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b46db6-ee56-4e75-bc3d-e3b4b1ea4e3e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:38.745350 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdad6d-70d2-4d79-a892-93186a858e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:38.745978 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdad6d-70d2-4d79-a892-93186a858e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:38.746251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdad6d-70d2-4d79-a892-93186a858e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:38.746520 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdad6d-70d2-4d79-a892-93186a858e97 admin admin] PATH_INFO: `/v3/projects/91240fb89cb94fabb7d95047d13d3b2a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:38.747616 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdad6d-70d2-4d79-a892-93186a858e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91240fb89cb94fabb7d95047d13d3b2a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:38.749542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdad6d-70d2-4d79-a892-93186a858e97 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:38.766992 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:38.799531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f3fdad6d-70d2-4d79-a892-93186a858e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91240fb89cb94fabb7d95047d13d3b2a', 'request_id': 'req-f3fdad6d-70d2-4d79-a892-93186a858e97'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:38.806450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f3fdad6d-70d2-4d79-a892-93186a858e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91240fb89cb94fabb7d95047d13d3b2a', 'request_id': 'req-f3fdad6d-70d2-4d79-a892-93186a858e97'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:38.815754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f3fdad6d-70d2-4d79-a892-93186a858e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91240fb89cb94fabb7d95047d13d3b2a', 'request_id': 'req-f3fdad6d-70d2-4d79-a892-93186a858e97'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:38.830065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f3fdad6d-70d2-4d79-a892-93186a858e97 admin admin] The token cache is being invalidate because project 91240fb89cb94fabb7d95047d13d3b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:16:38.830352 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f3fdad6d-70d2-4d79-a892-93186a858e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:38.831030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f3fdad6d-70d2-4d79-a892-93186a858e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:38.832726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1318/2607] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:16:38 2022] DELETE /identity/v3/projects/91240fb89cb94fabb7d95047d13d3b2a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:38.838077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00de352-4ef2-4b0e-90c2-541e149e14f2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:38.838732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00de352-4ef2-4b0e-90c2-541e149e14f2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:38.838732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00de352-4ef2-4b0e-90c2-541e149e14f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:38.859285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e00de352-4ef2-4b0e-90c2-541e149e14f2 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:38.860514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e00de352-4ef2-4b0e-90c2-541e149e14f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:38.881003 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:38.928205 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1290/2608] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:16:38.937871 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20812db3-5503-4a57-aac7-999292499978 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:38.938235 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20812db3-5503-4a57-aac7-999292499978 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:38.938596 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20812db3-5503-4a57-aac7-999292499978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:38.959762 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-20812db3-5503-4a57-aac7-999292499978 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:38.961095 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-20812db3-5503-4a57-aac7-999292499978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:38.969175 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1319/2609] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:38.973427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00de352-4ef2-4b0e-90c2-541e149e14f2 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:38.983583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00de352-4ef2-4b0e-90c2-541e149e14f2 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:38.988447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8878815-dd1b-4f18-b310-099c606070f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:38.989058 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8878815-dd1b-4f18-b310-099c606070f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:38.989367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8878815-dd1b-4f18-b310-099c606070f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:38.989638 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8878815-dd1b-4f18-b310-099c606070f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:38.990289 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8878815-dd1b-4f18-b310-099c606070f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:16:38.990588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8878815-dd1b-4f18-b310-099c606070f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:38.992265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8878815-dd1b-4f18-b310-099c606070f9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:39.005556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1291/2610] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:16:39.009926 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20812db3-5503-4a57-aac7-999292499978 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:39.019979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20812db3-5503-4a57-aac7-999292499978 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:39.026530 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae4fb2-790d-4ad3-b15f-4b1451fc21ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:39.027294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae4fb2-790d-4ad3-b15f-4b1451fc21ac admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:39.027575 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae4fb2-790d-4ad3-b15f-4b1451fc21ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:39.027848 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae4fb2-790d-4ad3-b15f-4b1451fc21ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:39.028532 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae4fb2-790d-4ad3-b15f-4b1451fc21ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:39.030457 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae4fb2-790d-4ad3-b15f-4b1451fc21ac admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:39.061430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1320/2611] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:16:39 2022] POST /identity/v3/projects => generated 401 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:39.065588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8878815-dd1b-4f18-b310-099c606070f9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:39.076685 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8878815-dd1b-4f18-b310-099c606070f9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:39.136711 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003997c-db50-456b-8eea-34f2d6bfffbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:39.137984 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003997c-db50-456b-8eea-34f2d6bfffbc admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:39.138283 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003997c-db50-456b-8eea-34f2d6bfffbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:39.138558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003997c-db50-456b-8eea-34f2d6bfffbc admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:39.139230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003997c-db50-456b-8eea-34f2d6bfffbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:39.141202 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003997c-db50-456b-8eea-34f2d6bfffbc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:39.165681 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1292/2612] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:16:39 2022] POST /identity/v3/users => generated 301 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:16:39.170507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae4fb2-790d-4ad3-b15f-4b1451fc21ac admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:39.180701 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae4fb2-790d-4ad3-b15f-4b1451fc21ac admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:39.185921 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95840f-2e85-469c-be32-44f49adb3a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:39.186506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95840f-2e85-469c-be32-44f49adb3a26 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:39.186779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95840f-2e85-469c-be32-44f49adb3a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:39.187046 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95840f-2e85-469c-be32-44f49adb3a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:39.187667 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95840f-2e85-469c-be32-44f49adb3a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:39.189270 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95840f-2e85-469c-be32-44f49adb3a26 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:39.199221 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1321/2613] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:16:39.203077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003997c-db50-456b-8eea-34f2d6bfffbc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:39.212813 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003997c-db50-456b-8eea-34f2d6bfffbc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:39.217386 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e1fd6-c9a1-4b6d-b4f6-04822aaf4f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:39.217968 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e1fd6-c9a1-4b6d-b4f6-04822aaf4f8c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:39.218241 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e1fd6-c9a1-4b6d-b4f6-04822aaf4f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:39.218506 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e1fd6-c9a1-4b6d-b4f6-04822aaf4f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:39.219134 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e1fd6-c9a1-4b6d-b4f6-04822aaf4f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:39.220777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e1fd6-c9a1-4b6d-b4f6-04822aaf4f8c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:39.231616 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1293/2614] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:39.235518 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95840f-2e85-469c-be32-44f49adb3a26 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:39.245861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95840f-2e85-469c-be32-44f49adb3a26 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:39.250382 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcabeb-71c6-41a0-a05f-179ff37f96d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:39.251020 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcabeb-71c6-41a0-a05f-179ff37f96d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:39.251316 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcabeb-71c6-41a0-a05f-179ff37f96d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:39.251590 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcabeb-71c6-41a0-a05f-179ff37f96d1 admin admin] PATH_INFO: `/v3/projects/f9b49b97b8fb447ebb0bdfb8226e3f2e/users/79239b7a2df64d57992291307289c698/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:39.266443 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcabeb-71c6-41a0-a05f-179ff37f96d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b49b97b8fb447ebb0bdfb8226e3f2e, user_id=79239b7a2df64d57992291307289c698, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:39.269062 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcabeb-71c6-41a0-a05f-179ff37f96d1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:39.281312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1322/2615] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:39 2022] PUT /identity/v3/projects/f9b49b97b8fb447ebb0bdfb8226e3f2e/users/79239b7a2df64d57992291307289c698/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:16:39.292036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf7d8e-5b88-4de4-a34b-2621b4e319ea None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:39.292438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf7d8e-5b88-4de4-a34b-2621b4e319ea None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:39.292809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf7d8e-5b88-4de4-a34b-2621b4e319ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:39.320903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-dfdf7d8e-5b88-4de4-a34b-2621b4e319ea None None] MFA Rules not processed for user `79239b7a2df64d57992291307289c698`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:39.322099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dfdf7d8e-5b88-4de4-a34b-2621b4e319ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:39.387674 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1294/2616] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:39 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:39.392037 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcabeb-71c6-41a0-a05f-179ff37f96d1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:39.453212 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcabeb-71c6-41a0-a05f-179ff37f96d1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:39.457809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05d27a-c78b-4e01-80eb-cd3e9bb4b99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:39.458405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05d27a-c78b-4e01-80eb-cd3e9bb4b99e admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:39.458693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05d27a-c78b-4e01-80eb-cd3e9bb4b99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:39.458940 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05d27a-c78b-4e01-80eb-cd3e9bb4b99e admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:39.459558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05d27a-c78b-4e01-80eb-cd3e9bb4b99e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:39.461460 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05d27a-c78b-4e01-80eb-cd3e9bb4b99e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:39.489099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1323/2617] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:16:39 2022] POST /identity/v3/projects => generated 399 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:39.493115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf7d8e-5b88-4de4-a34b-2621b4e319ea None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:39.503872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf7d8e-5b88-4de4-a34b-2621b4e319ea None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:39.519762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:39.562598 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc3a58-5fea-4288-946b-634baff4a6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:39.563212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc3a58-5fea-4288-946b-634baff4a6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:39.563486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc3a58-5fea-4288-946b-634baff4a6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:39.563758 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc3a58-5fea-4288-946b-634baff4a6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:39.564468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc3a58-5fea-4288-946b-634baff4a6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:39.566376 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc3a58-5fea-4288-946b-634baff4a6b7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:39.588754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1295/2618] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:16:39 2022] POST /identity/v3/users => generated 306 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:39.592741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05d27a-c78b-4e01-80eb-cd3e9bb4b99e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:39.603478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05d27a-c78b-4e01-80eb-cd3e9bb4b99e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:39.608943 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9a5fa-2b1d-46ae-a513-9dfdc833c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:39.609560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9a5fa-2b1d-46ae-a513-9dfdc833c641 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:39.609839 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9a5fa-2b1d-46ae-a513-9dfdc833c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:39.610111 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9a5fa-2b1d-46ae-a513-9dfdc833c641 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:39.610759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9a5fa-2b1d-46ae-a513-9dfdc833c641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:39.612393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9a5fa-2b1d-46ae-a513-9dfdc833c641 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:39.623550 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1324/2619] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:39.628003 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc3a58-5fea-4288-946b-634baff4a6b7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:39.637916 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc3a58-5fea-4288-946b-634baff4a6b7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:39.642603 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81529d-3102-4899-ad19-f4c097430ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:39.643249 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81529d-3102-4899-ad19-f4c097430ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:39.643523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81529d-3102-4899-ad19-f4c097430ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:39.643791 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81529d-3102-4899-ad19-f4c097430ce6 admin admin] PATH_INFO: `/v3/projects/904e56bace8d4a8f88aa00d57394df9e/users/baa7c51a7d5f4b5794a8b591c7936b28/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:39.660595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81529d-3102-4899-ad19-f4c097430ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=904e56bace8d4a8f88aa00d57394df9e, user_id=baa7c51a7d5f4b5794a8b591c7936b28, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:39.663331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81529d-3102-4899-ad19-f4c097430ce6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:39.677191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1296/2620] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:39 2022] PUT /identity/v3/projects/904e56bace8d4a8f88aa00d57394df9e/users/baa7c51a7d5f4b5794a8b591c7936b28/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:39.681366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9a5fa-2b1d-46ae-a513-9dfdc833c641 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:39.691737 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9a5fa-2b1d-46ae-a513-9dfdc833c641 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:39.703211 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:39.752453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3639270-4c89-40c6-8d89-1cb98f04f771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:39.753073 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3639270-4c89-40c6-8d89-1cb98f04f771 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:39.753377 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3639270-4c89-40c6-8d89-1cb98f04f771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:39.753644 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3639270-4c89-40c6-8d89-1cb98f04f771 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:39.754297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3639270-4c89-40c6-8d89-1cb98f04f771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:39.755874 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3639270-4c89-40c6-8d89-1cb98f04f771 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:39.766782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1325/2621] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:39.770989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81529d-3102-4899-ad19-f4c097430ce6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:39.781193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81529d-3102-4899-ad19-f4c097430ce6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:39.785708 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ea66c-e489-4b35-9c76-27c5dce56d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:39.786347 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ea66c-e489-4b35-9c76-27c5dce56d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:39.786619 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ea66c-e489-4b35-9c76-27c5dce56d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:39.786888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ea66c-e489-4b35-9c76-27c5dce56d38 admin admin] PATH_INFO: `/v3/projects/904e56bace8d4a8f88aa00d57394df9e/users/baa7c51a7d5f4b5794a8b591c7936b28/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:39.788803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ea66c-e489-4b35-9c76-27c5dce56d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=904e56bace8d4a8f88aa00d57394df9e, user_id=baa7c51a7d5f4b5794a8b591c7936b28, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:39.791450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ea66c-e489-4b35-9c76-27c5dce56d38 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:39.801633 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1297/2622] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:39 2022] PUT /identity/v3/projects/904e56bace8d4a8f88aa00d57394df9e/users/baa7c51a7d5f4b5794a8b591c7936b28/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:39.812501 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907e995-5aa6-41eb-8787-d62bffa88882 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:39.812784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907e995-5aa6-41eb-8787-d62bffa88882 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:39.813058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907e995-5aa6-41eb-8787-d62bffa88882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:39.840613 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e907e995-5aa6-41eb-8787-d62bffa88882 None None] MFA Rules not processed for user `baa7c51a7d5f4b5794a8b591c7936b28`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:39.841816 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e907e995-5aa6-41eb-8787-d62bffa88882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:39.920272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1326/2623] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:39 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:39.930899 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ea66c-e489-4b35-9c76-27c5dce56d38 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:39.933305 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-322ea66c-e489-4b35-9c76-27c5dce56d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:39.995468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ea66c-e489-4b35-9c76-27c5dce56d38 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:39.999177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44bfaa-0cc3-433b-8ae9-8ae394e44278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:39.999806 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44bfaa-0cc3-433b-8ae9-8ae394e44278 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:40.000112 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44bfaa-0cc3-433b-8ae9-8ae394e44278 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:40.000379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44bfaa-0cc3-433b-8ae9-8ae394e44278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:40.009440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44bfaa-0cc3-433b-8ae9-8ae394e44278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:40.010903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44bfaa-0cc3-433b-8ae9-8ae394e44278 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:40.020187 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1298/2624] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:39 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:40.096993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907e995-5aa6-41eb-8787-d62bffa88882 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:40.107807 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907e995-5aa6-41eb-8787-d62bffa88882 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:40.111748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2623ea-d772-4037-9461-441e4da9b3bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:40.112382 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2623ea-d772-4037-9461-441e4da9b3bd service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:40.112662 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2623ea-d772-4037-9461-441e4da9b3bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:40.112932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2623ea-d772-4037-9461-441e4da9b3bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:40.177908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2623ea-d772-4037-9461-441e4da9b3bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:40.179353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2623ea-d772-4037-9461-441e4da9b3bd service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:40.189651 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1327/2625] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:40 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:44.261758 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44bfaa-0cc3-433b-8ae9-8ae394e44278 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:44.326718 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44bfaa-0cc3-433b-8ae9-8ae394e44278 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:44.331172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536171bc-07bf-46d5-a938-4e6ee636e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:44.331797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536171bc-07bf-46d5-a938-4e6ee636e970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:44.332113 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536171bc-07bf-46d5-a938-4e6ee636e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:44.332384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536171bc-07bf-46d5-a938-4e6ee636e970 admin admin] PATH_INFO: `/v3/users/79239b7a2df64d57992291307289c698` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:44.333515 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536171bc-07bf-46d5-a938-4e6ee636e970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79239b7a2df64d57992291307289c698)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:44.335423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536171bc-07bf-46d5-a938-4e6ee636e970 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:44.350594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:44.381645 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-536171bc-07bf-46d5-a938-4e6ee636e970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79239b7a2df64d57992291307289c698'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:44.393483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-536171bc-07bf-46d5-a938-4e6ee636e970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79239b7a2df64d57992291307289c698'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:44.400325 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-536171bc-07bf-46d5-a938-4e6ee636e970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79239b7a2df64d57992291307289c698'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:44.401004 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-536171bc-07bf-46d5-a938-4e6ee636e970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79239b7a2df64d57992291307289c698'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:44.401596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-536171bc-07bf-46d5-a938-4e6ee636e970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79239b7a2df64d57992291307289c698'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:44.413951 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1299/2626] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:16:44 2022] DELETE /identity/v3/users/79239b7a2df64d57992291307289c698 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:44.418855 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2bad1-6d97-43e1-bae0-ddfe63a946f9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:44.419340 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2bad1-6d97-43e1-bae0-ddfe63a946f9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:44.419459 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2bad1-6d97-43e1-bae0-ddfe63a946f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:44.438586 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2db2bad1-6d97-43e1-bae0-ddfe63a946f9 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:44.439767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2db2bad1-6d97-43e1-bae0-ddfe63a946f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:44.468879 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:44.499137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1328/2627] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:44.508943 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536171bc-07bf-46d5-a938-4e6ee636e970 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:44.510379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-536171bc-07bf-46d5-a938-4e6ee636e970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:44.568783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536171bc-07bf-46d5-a938-4e6ee636e970 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:44.572674 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872659b-cdb5-43db-a3f0-172eb27597f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:44.573325 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872659b-cdb5-43db-a3f0-172eb27597f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:44.573642 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872659b-cdb5-43db-a3f0-172eb27597f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:44.573911 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872659b-cdb5-43db-a3f0-172eb27597f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:44.582785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872659b-cdb5-43db-a3f0-172eb27597f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:44.584232 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872659b-cdb5-43db-a3f0-172eb27597f8 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:44.593803 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1300/2628] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:44.912380 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2bad1-6d97-43e1-bae0-ddfe63a946f9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:44.913958 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2db2bad1-6d97-43e1-bae0-ddfe63a946f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:44.927623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2bad1-6d97-43e1-bae0-ddfe63a946f9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:44.932910 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224bc1c-f377-46c2-b20c-b51957c602ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:44.933518 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224bc1c-f377-46c2-b20c-b51957c602ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:44.933664 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224bc1c-f377-46c2-b20c-b51957c602ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:44.934072 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224bc1c-f377-46c2-b20c-b51957c602ad admin admin] PATH_INFO: `/v3/projects/f9b49b97b8fb447ebb0bdfb8226e3f2e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:44.935527 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224bc1c-f377-46c2-b20c-b51957c602ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b49b97b8fb447ebb0bdfb8226e3f2e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:44.937610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224bc1c-f377-46c2-b20c-b51957c602ad admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:44.994673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3224bc1c-f377-46c2-b20c-b51957c602ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b49b97b8fb447ebb0bdfb8226e3f2e', 'request_id': 'req-3224bc1c-f377-46c2-b20c-b51957c602ad'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:45.000244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3224bc1c-f377-46c2-b20c-b51957c602ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b49b97b8fb447ebb0bdfb8226e3f2e', 'request_id': 'req-3224bc1c-f377-46c2-b20c-b51957c602ad'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:45.007615 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3224bc1c-f377-46c2-b20c-b51957c602ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b49b97b8fb447ebb0bdfb8226e3f2e', 'request_id': 'req-3224bc1c-f377-46c2-b20c-b51957c602ad'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:45.018505 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3224bc1c-f377-46c2-b20c-b51957c602ad admin admin] The token cache is being invalidate because project f9b49b97b8fb447ebb0bdfb8226e3f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:16:45.018818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3224bc1c-f377-46c2-b20c-b51957c602ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:45.019441 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3224bc1c-f377-46c2-b20c-b51957c602ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:45.020950 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1329/2629] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:16:44 2022] DELETE /identity/v3/projects/f9b49b97b8fb447ebb0bdfb8226e3f2e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:45.024922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872659b-cdb5-43db-a3f0-172eb27597f8 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:45.035150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872659b-cdb5-43db-a3f0-172eb27597f8 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:45.091575 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56d706-e2e6-4837-861e-c6ca57d82287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:45.092244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56d706-e2e6-4837-861e-c6ca57d82287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:45.092523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56d706-e2e6-4837-861e-c6ca57d82287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:45.092792 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56d706-e2e6-4837-861e-c6ca57d82287 admin admin] PATH_INFO: `/v3/users/baa7c51a7d5f4b5794a8b591c7936b28` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:45.093899 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56d706-e2e6-4837-861e-c6ca57d82287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baa7c51a7d5f4b5794a8b591c7936b28)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:45.095815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56d706-e2e6-4837-861e-c6ca57d82287 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:45.135797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:45.142862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-de56d706-e2e6-4837-861e-c6ca57d82287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baa7c51a7d5f4b5794a8b591c7936b28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:45.155748 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-de56d706-e2e6-4837-861e-c6ca57d82287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baa7c51a7d5f4b5794a8b591c7936b28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:45.162488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-de56d706-e2e6-4837-861e-c6ca57d82287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baa7c51a7d5f4b5794a8b591c7936b28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:45.163316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-de56d706-e2e6-4837-861e-c6ca57d82287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baa7c51a7d5f4b5794a8b591c7936b28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:45.163894 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-de56d706-e2e6-4837-861e-c6ca57d82287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baa7c51a7d5f4b5794a8b591c7936b28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:45.176041 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1301/2630] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:16:45 2022] DELETE /identity/v3/users/baa7c51a7d5f4b5794a8b591c7936b28 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:45.451089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224bc1c-f377-46c2-b20c-b51957c602ad admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:45.452592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3224bc1c-f377-46c2-b20c-b51957c602ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:45.466588 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224bc1c-f377-46c2-b20c-b51957c602ad admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:45.524481 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39462e9d-5cbd-4e53-a083-2945047b1615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:45.525026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39462e9d-5cbd-4e53-a083-2945047b1615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:45.525331 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39462e9d-5cbd-4e53-a083-2945047b1615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:45.525686 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39462e9d-5cbd-4e53-a083-2945047b1615 admin admin] PATH_INFO: `/v3/projects/904e56bace8d4a8f88aa00d57394df9e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:45.526804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39462e9d-5cbd-4e53-a083-2945047b1615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=904e56bace8d4a8f88aa00d57394df9e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:45.528795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39462e9d-5cbd-4e53-a083-2945047b1615 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:45.576951 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39462e9d-5cbd-4e53-a083-2945047b1615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '904e56bace8d4a8f88aa00d57394df9e', 'request_id': 'req-39462e9d-5cbd-4e53-a083-2945047b1615'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:45.582326 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39462e9d-5cbd-4e53-a083-2945047b1615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '904e56bace8d4a8f88aa00d57394df9e', 'request_id': 'req-39462e9d-5cbd-4e53-a083-2945047b1615'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:45.584757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:45.590237 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39462e9d-5cbd-4e53-a083-2945047b1615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '904e56bace8d4a8f88aa00d57394df9e', 'request_id': 'req-39462e9d-5cbd-4e53-a083-2945047b1615'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:45.602599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39462e9d-5cbd-4e53-a083-2945047b1615 admin admin] The token cache is being invalidate because project 904e56bace8d4a8f88aa00d57394df9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:16:45.602882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39462e9d-5cbd-4e53-a083-2945047b1615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:45.603545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39462e9d-5cbd-4e53-a083-2945047b1615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:45.605060 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1330/2631] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:16:45 2022] DELETE /identity/v3/projects/904e56bace8d4a8f88aa00d57394df9e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:45.609907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cc5da-4777-4794-8f1c-ee093efa7679 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:45.610413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cc5da-4777-4794-8f1c-ee093efa7679 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:45.610413 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cc5da-4777-4794-8f1c-ee093efa7679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:45.630420 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-786cc5da-4777-4794-8f1c-ee093efa7679 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:45.631616 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-786cc5da-4777-4794-8f1c-ee093efa7679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:45.691935 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1302/2632] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:45.700440 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd4c3c-8f78-4ba1-a376-e4bec6337cc6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:45.700717 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd4c3c-8f78-4ba1-a376-e4bec6337cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:45.700984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd4c3c-8f78-4ba1-a376-e4bec6337cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:45.720492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e5dd4c3c-8f78-4ba1-a376-e4bec6337cc6 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:45.721688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e5dd4c3c-8f78-4ba1-a376-e4bec6337cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:45.729409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1331/2633] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:45.733511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cc5da-4777-4794-8f1c-ee093efa7679 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:45.743256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cc5da-4777-4794-8f1c-ee093efa7679 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:45.748579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e892a5-d385-4d30-942c-e2e77ab74bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:45.749169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e892a5-d385-4d30-942c-e2e77ab74bff admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:45.749444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e892a5-d385-4d30-942c-e2e77ab74bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:45.749712 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e892a5-d385-4d30-942c-e2e77ab74bff admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:45.750383 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e892a5-d385-4d30-942c-e2e77ab74bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:16:45.750681 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e892a5-d385-4d30-942c-e2e77ab74bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:45.752558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e892a5-d385-4d30-942c-e2e77ab74bff admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:45.764558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1303/2634] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:16:45.768856 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd4c3c-8f78-4ba1-a376-e4bec6337cc6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:45.778295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd4c3c-8f78-4ba1-a376-e4bec6337cc6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:45.782787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b379912-49c0-4e72-ad16-dd958309b5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:45.783372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b379912-49c0-4e72-ad16-dd958309b5df admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:45.783645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b379912-49c0-4e72-ad16-dd958309b5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:45.783908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b379912-49c0-4e72-ad16-dd958309b5df admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:45.784559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b379912-49c0-4e72-ad16-dd958309b5df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:45.786398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b379912-49c0-4e72-ad16-dd958309b5df admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:45.813872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1332/2635] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:16:45 2022] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:16:45.817907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e892a5-d385-4d30-942c-e2e77ab74bff admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:45.828208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e892a5-d385-4d30-942c-e2e77ab74bff admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:45.883379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44681535-4fd6-45cf-925b-93cfd6832bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:45.883997 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44681535-4fd6-45cf-925b-93cfd6832bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:45.884273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44681535-4fd6-45cf-925b-93cfd6832bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:45.884538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44681535-4fd6-45cf-925b-93cfd6832bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:45.885169 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44681535-4fd6-45cf-925b-93cfd6832bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:45.887061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44681535-4fd6-45cf-925b-93cfd6832bf9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:45.907896 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1304/2636] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:16:45 2022] POST /identity/v3/users => generated 305 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:45.912132 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b379912-49c0-4e72-ad16-dd958309b5df admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:45.922850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b379912-49c0-4e72-ad16-dd958309b5df admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:45.927369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17d38c-c288-4e40-8bad-117521c75d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:45.927965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17d38c-c288-4e40-8bad-117521c75d6d admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:45.928254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17d38c-c288-4e40-8bad-117521c75d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:45.928521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17d38c-c288-4e40-8bad-117521c75d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:45.929149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17d38c-c288-4e40-8bad-117521c75d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:45.930739 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17d38c-c288-4e40-8bad-117521c75d6d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:45.941068 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1333/2637] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:45.944995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44681535-4fd6-45cf-925b-93cfd6832bf9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:45.954854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44681535-4fd6-45cf-925b-93cfd6832bf9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:45.959446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6bbcb-cd34-47c0-a8ee-027777876530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:45.960054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6bbcb-cd34-47c0-a8ee-027777876530 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:45.960331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6bbcb-cd34-47c0-a8ee-027777876530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:45.960599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6bbcb-cd34-47c0-a8ee-027777876530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:45.961228 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6bbcb-cd34-47c0-a8ee-027777876530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:45.962836 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6bbcb-cd34-47c0-a8ee-027777876530 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:45.973245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1305/2638] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:45.977225 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17d38c-c288-4e40-8bad-117521c75d6d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:45.988534 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17d38c-c288-4e40-8bad-117521c75d6d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:45.993932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b644e9-b17d-4d07-95ee-2823d507bd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:45.994058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b644e9-b17d-4d07-95ee-2823d507bd27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:45.994302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b644e9-b17d-4d07-95ee-2823d507bd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:45.994674 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b644e9-b17d-4d07-95ee-2823d507bd27 admin admin] PATH_INFO: `/v3/projects/496e0d0d0baf4227aa8f0e8ca1f90bef/users/7ba61b6a18fd46ada3c48b43e82b63d0/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:46.010541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b644e9-b17d-4d07-95ee-2823d507bd27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496e0d0d0baf4227aa8f0e8ca1f90bef, user_id=7ba61b6a18fd46ada3c48b43e82b63d0, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:46.013243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b644e9-b17d-4d07-95ee-2823d507bd27 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:46.026965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1334/2639] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:45 2022] PUT /identity/v3/projects/496e0d0d0baf4227aa8f0e8ca1f90bef/users/7ba61b6a18fd46ada3c48b43e82b63d0/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:46.037434 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52dc94-68f4-42d7-aaf3-953f0557144f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:46.037623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52dc94-68f4-42d7-aaf3-953f0557144f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:46.038895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52dc94-68f4-42d7-aaf3-953f0557144f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:46.067265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6c52dc94-68f4-42d7-aaf3-953f0557144f None None] MFA Rules not processed for user `7ba61b6a18fd46ada3c48b43e82b63d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:46.068594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6c52dc94-68f4-42d7-aaf3-953f0557144f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:46.081256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:46.142496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1306/2640] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:46 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:46.147068 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b644e9-b17d-4d07-95ee-2823d507bd27 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:46.208537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b644e9-b17d-4d07-95ee-2823d507bd27 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:46.213665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483244b-b68b-4e43-b70d-88bb063e17ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:46.214260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483244b-b68b-4e43-b70d-88bb063e17ef admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:46.214535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483244b-b68b-4e43-b70d-88bb063e17ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:46.214803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483244b-b68b-4e43-b70d-88bb063e17ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:46.215429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483244b-b68b-4e43-b70d-88bb063e17ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:46.217332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483244b-b68b-4e43-b70d-88bb063e17ef admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:46.247596 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1335/2641] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:16:46 2022] POST /identity/v3/projects => generated 409 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:16:46.251772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52dc94-68f4-42d7-aaf3-953f0557144f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:46.263556 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52dc94-68f4-42d7-aaf3-953f0557144f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:46.321466 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742517d8-b167-43b3-95ec-d9398d5d36cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:46.321959 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742517d8-b167-43b3-95ec-d9398d5d36cc admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:46.322278 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742517d8-b167-43b3-95ec-d9398d5d36cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:46.322547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742517d8-b167-43b3-95ec-d9398d5d36cc admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:46.323159 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742517d8-b167-43b3-95ec-d9398d5d36cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:46.325120 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742517d8-b167-43b3-95ec-d9398d5d36cc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:46.349733 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1307/2642] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:16:46 2022] POST /identity/v3/users => generated 311 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:46.351228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483244b-b68b-4e43-b70d-88bb063e17ef admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:46.362162 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483244b-b68b-4e43-b70d-88bb063e17ef admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:46.366759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5296a-b620-4314-a7a2-27b8135db135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:46.367359 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5296a-b620-4314-a7a2-27b8135db135 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:46.367631 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5296a-b620-4314-a7a2-27b8135db135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:46.367897 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5296a-b620-4314-a7a2-27b8135db135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:46.368578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5296a-b620-4314-a7a2-27b8135db135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:46.370176 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5296a-b620-4314-a7a2-27b8135db135 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:46.381318 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1336/2643] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:46.385539 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742517d8-b167-43b3-95ec-d9398d5d36cc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:46.396328 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742517d8-b167-43b3-95ec-d9398d5d36cc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:46.401962 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00b74f-6ae7-4724-bd18-15eddf6048a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:46.402711 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00b74f-6ae7-4724-bd18-15eddf6048a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:46.403056 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00b74f-6ae7-4724-bd18-15eddf6048a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:46.403330 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00b74f-6ae7-4724-bd18-15eddf6048a5 admin admin] PATH_INFO: `/v3/projects/f712485347b24769a9cfa4c8dbd0f267/users/b9660f9bad884583b4945a0c58681914/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:46.419878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00b74f-6ae7-4724-bd18-15eddf6048a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f712485347b24769a9cfa4c8dbd0f267, user_id=b9660f9bad884583b4945a0c58681914, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:46.422541 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00b74f-6ae7-4724-bd18-15eddf6048a5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:46.437688 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1308/2644] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:46 2022] PUT /identity/v3/projects/f712485347b24769a9cfa4c8dbd0f267/users/b9660f9bad884583b4945a0c58681914/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:46.441833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5296a-b620-4314-a7a2-27b8135db135 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:46.452123 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5296a-b620-4314-a7a2-27b8135db135 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:46.512601 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c2957-967b-449b-b7fb-d9e6ccfa2855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:46.513303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c2957-967b-449b-b7fb-d9e6ccfa2855 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:46.513577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c2957-967b-449b-b7fb-d9e6ccfa2855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:46.513943 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c2957-967b-449b-b7fb-d9e6ccfa2855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:46.514580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c2957-967b-449b-b7fb-d9e6ccfa2855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:46.516231 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c2957-967b-449b-b7fb-d9e6ccfa2855 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:46.517618 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:46.536204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00b74f-6ae7-4724-bd18-15eddf6048a5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:46.536849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1337/2645] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:46.547560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00b74f-6ae7-4724-bd18-15eddf6048a5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:46.552485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b0657-26f8-4bf4-ba5e-bbc693ecaa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:46.553140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b0657-26f8-4bf4-ba5e-bbc693ecaa7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:46.553418 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b0657-26f8-4bf4-ba5e-bbc693ecaa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:46.553691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b0657-26f8-4bf4-ba5e-bbc693ecaa7b admin admin] PATH_INFO: `/v3/projects/f712485347b24769a9cfa4c8dbd0f267/users/b9660f9bad884583b4945a0c58681914/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:46.555825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b0657-26f8-4bf4-ba5e-bbc693ecaa7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f712485347b24769a9cfa4c8dbd0f267, user_id=b9660f9bad884583b4945a0c58681914, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:46.558973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b0657-26f8-4bf4-ba5e-bbc693ecaa7b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:46.571000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1309/2646] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:46 2022] PUT /identity/v3/projects/f712485347b24769a9cfa4c8dbd0f267/users/b9660f9bad884583b4945a0c58681914/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:46.637576 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236f0ed-ccae-4c8b-9ffd-669a93ff9a16 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:46.637855 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236f0ed-ccae-4c8b-9ffd-669a93ff9a16 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:46.638124 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236f0ed-ccae-4c8b-9ffd-669a93ff9a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:46.665703 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0236f0ed-ccae-4c8b-9ffd-669a93ff9a16 None None] MFA Rules not processed for user `b9660f9bad884583b4945a0c58681914`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:46.667485 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0236f0ed-ccae-4c8b-9ffd-669a93ff9a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:46.735180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1338/2647] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:46 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:46.746523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b0657-26f8-4bf4-ba5e-bbc693ecaa7b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:46.748407 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4a4b0657-26f8-4bf4-ba5e-bbc693ecaa7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:46.813322 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b0657-26f8-4bf4-ba5e-bbc693ecaa7b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:46.817059 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1f8c9-18f0-482b-9e8a-bd243b895023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:46.817674 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1f8c9-18f0-482b-9e8a-bd243b895023 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:46.817944 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1f8c9-18f0-482b-9e8a-bd243b895023 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:46.818207 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1f8c9-18f0-482b-9e8a-bd243b895023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:46.827633 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1f8c9-18f0-482b-9e8a-bd243b895023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:46.829226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1f8c9-18f0-482b-9e8a-bd243b895023 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:46.838432 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1310/2648] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:46 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:46.988094 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236f0ed-ccae-4c8b-9ffd-669a93ff9a16 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:46.998378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236f0ed-ccae-4c8b-9ffd-669a93ff9a16 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:47.001960 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8c296-d056-47da-88d8-2e827e51a837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:47.002804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8c296-d056-47da-88d8-2e827e51a837 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:47.003087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8c296-d056-47da-88d8-2e827e51a837 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:47.003346 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8c296-d056-47da-88d8-2e827e51a837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:47.060639 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8c296-d056-47da-88d8-2e827e51a837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:47.062059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8c296-d056-47da-88d8-2e827e51a837 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:47.070819 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1339/2649] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:46 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:52.513736 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1f8c9-18f0-482b-9e8a-bd243b895023 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:52.522451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:52.580265 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1f8c9-18f0-482b-9e8a-bd243b895023 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:52.584875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ef602-ff83-4d5e-a52b-498cd6065980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:52.585552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ef602-ff83-4d5e-a52b-498cd6065980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:52.585846 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ef602-ff83-4d5e-a52b-498cd6065980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:52.586130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ef602-ff83-4d5e-a52b-498cd6065980 admin admin] PATH_INFO: `/v3/users/7ba61b6a18fd46ada3c48b43e82b63d0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:52.587281 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ef602-ff83-4d5e-a52b-498cd6065980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ba61b6a18fd46ada3c48b43e82b63d0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:52.589262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ef602-ff83-4d5e-a52b-498cd6065980 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:52.639552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c39ef602-ff83-4d5e-a52b-498cd6065980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ba61b6a18fd46ada3c48b43e82b63d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:52.653179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c39ef602-ff83-4d5e-a52b-498cd6065980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ba61b6a18fd46ada3c48b43e82b63d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:52.659930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c39ef602-ff83-4d5e-a52b-498cd6065980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ba61b6a18fd46ada3c48b43e82b63d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:52.660655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c39ef602-ff83-4d5e-a52b-498cd6065980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ba61b6a18fd46ada3c48b43e82b63d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:52.661261 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c39ef602-ff83-4d5e-a52b-498cd6065980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ba61b6a18fd46ada3c48b43e82b63d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:52.677352 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1311/2650] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:16:52 2022] DELETE /identity/v3/users/7ba61b6a18fd46ada3c48b43e82b63d0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:52.683215 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d128b1-4a6f-442c-8573-a498ae3f47b2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:52.683747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d128b1-4a6f-442c-8573-a498ae3f47b2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:52.683747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d128b1-4a6f-442c-8573-a498ae3f47b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:52.703414 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-64d128b1-4a6f-442c-8573-a498ae3f47b2 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:52.704660 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-64d128b1-4a6f-442c-8573-a498ae3f47b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:52.764434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1340/2651] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:52.774360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ef602-ff83-4d5e-a52b-498cd6065980 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:52.776870 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c39ef602-ff83-4d5e-a52b-498cd6065980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:52.835810 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ef602-ff83-4d5e-a52b-498cd6065980 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:52.840083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3038425-c345-4530-8147-3a2ca30fcd39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:52.840693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3038425-c345-4530-8147-3a2ca30fcd39 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:52.840967 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3038425-c345-4530-8147-3a2ca30fcd39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:52.841236 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3038425-c345-4530-8147-3a2ca30fcd39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:52.850284 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3038425-c345-4530-8147-3a2ca30fcd39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:52.851725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3038425-c345-4530-8147-3a2ca30fcd39 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:52.862612 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1312/2652] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:53.163395 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d128b1-4a6f-442c-8573-a498ae3f47b2 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:53.165271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-64d128b1-4a6f-442c-8573-a498ae3f47b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:53.179276 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d128b1-4a6f-442c-8573-a498ae3f47b2 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:53.184360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:53.185077 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:53.185683 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:53.186179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181 admin admin] PATH_INFO: `/v3/projects/496e0d0d0baf4227aa8f0e8ca1f90bef` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:53.191829 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=496e0d0d0baf4227aa8f0e8ca1f90bef)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:53.194794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:53.221530 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:53.258103 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496e0d0d0baf4227aa8f0e8ca1f90bef', 'request_id': 'req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:53.264397 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496e0d0d0baf4227aa8f0e8ca1f90bef', 'request_id': 'req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:53.272695 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496e0d0d0baf4227aa8f0e8ca1f90bef', 'request_id': 'req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:53.284846 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181 admin admin] The token cache is being invalidate because project 496e0d0d0baf4227aa8f0e8ca1f90bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:16:53.285132 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:53.285784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:53.287431 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1341/2653] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:16:53 2022] DELETE /identity/v3/projects/496e0d0d0baf4227aa8f0e8ca1f90bef => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:53.291396 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3038425-c345-4530-8147-3a2ca30fcd39 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:53.302368 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3038425-c345-4530-8147-3a2ca30fcd39 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:53.330909 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:53.364932 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a548eb-fd42-40bc-91b4-bb0c261cdc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:53.365599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a548eb-fd42-40bc-91b4-bb0c261cdc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:53.365877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a548eb-fd42-40bc-91b4-bb0c261cdc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:53.366137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a548eb-fd42-40bc-91b4-bb0c261cdc38 admin admin] PATH_INFO: `/v3/users/b9660f9bad884583b4945a0c58681914` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:53.367249 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a548eb-fd42-40bc-91b4-bb0c261cdc38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9660f9bad884583b4945a0c58681914)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:53.369400 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a548eb-fd42-40bc-91b4-bb0c261cdc38 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:53.417796 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d9a548eb-fd42-40bc-91b4-bb0c261cdc38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9660f9bad884583b4945a0c58681914'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:53.430882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d9a548eb-fd42-40bc-91b4-bb0c261cdc38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9660f9bad884583b4945a0c58681914'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:53.437801 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d9a548eb-fd42-40bc-91b4-bb0c261cdc38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9660f9bad884583b4945a0c58681914'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:53.438508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d9a548eb-fd42-40bc-91b4-bb0c261cdc38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9660f9bad884583b4945a0c58681914'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:53.439118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d9a548eb-fd42-40bc-91b4-bb0c261cdc38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9660f9bad884583b4945a0c58681914'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:53.452900 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1313/2654] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:16:53 2022] DELETE /identity/v3/users/b9660f9bad884583b4945a0c58681914 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:53.748990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:53.750949 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:53.764869 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098f7cd-1cc6-4f06-897c-5cf3b05c4181 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:53.831528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa610630-c671-4b35-b187-6406deba7a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:53.832200 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa610630-c671-4b35-b187-6406deba7a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:53.832481 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa610630-c671-4b35-b187-6406deba7a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:53.832785 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa610630-c671-4b35-b187-6406deba7a25 admin admin] PATH_INFO: `/v3/projects/f712485347b24769a9cfa4c8dbd0f267` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:53.834108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa610630-c671-4b35-b187-6406deba7a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f712485347b24769a9cfa4c8dbd0f267)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:53.836119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa610630-c671-4b35-b187-6406deba7a25 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:53.886695 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-aa610630-c671-4b35-b187-6406deba7a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f712485347b24769a9cfa4c8dbd0f267', 'request_id': 'req-aa610630-c671-4b35-b187-6406deba7a25'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:53.892743 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-aa610630-c671-4b35-b187-6406deba7a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f712485347b24769a9cfa4c8dbd0f267', 'request_id': 'req-aa610630-c671-4b35-b187-6406deba7a25'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:53.901445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-aa610630-c671-4b35-b187-6406deba7a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f712485347b24769a9cfa4c8dbd0f267', 'request_id': 'req-aa610630-c671-4b35-b187-6406deba7a25'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:53.919362 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-aa610630-c671-4b35-b187-6406deba7a25 admin admin] The token cache is being invalidate because project f712485347b24769a9cfa4c8dbd0f267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:16:53.919650 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-aa610630-c671-4b35-b187-6406deba7a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:53.920332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-aa610630-c671-4b35-b187-6406deba7a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:53.921833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1342/2655] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:16:53 2022] DELETE /identity/v3/projects/f712485347b24769a9cfa4c8dbd0f267 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:53.926857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708a623-95a4-484c-99b2-95975b6e256c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:53.927371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708a623-95a4-484c-99b2-95975b6e256c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:53.927548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708a623-95a4-484c-99b2-95975b6e256c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:53.947529 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1708a623-95a4-484c-99b2-95975b6e256c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:53.948842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1708a623-95a4-484c-99b2-95975b6e256c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:54.012936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1314/2656] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:54.020442 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a62ef-06ab-4ec8-bcf5-7d9ec1e3b391 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:54.020725 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a62ef-06ab-4ec8-bcf5-7d9ec1e3b391 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:54.020994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a62ef-06ab-4ec8-bcf5-7d9ec1e3b391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:54.043224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b92a62ef-06ab-4ec8-bcf5-7d9ec1e3b391 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:54.045055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b92a62ef-06ab-4ec8-bcf5-7d9ec1e3b391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:54.053274 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1343/2657] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:54.057540 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708a623-95a4-484c-99b2-95975b6e256c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:54.067174 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708a623-95a4-484c-99b2-95975b6e256c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:54.072056 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b378707-200b-475c-882a-e6297d45105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:54.073302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b378707-200b-475c-882a-e6297d45105c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:54.073586 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b378707-200b-475c-882a-e6297d45105c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:54.073858 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b378707-200b-475c-882a-e6297d45105c admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:54.074611 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b378707-200b-475c-882a-e6297d45105c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:16:54.074913 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b378707-200b-475c-882a-e6297d45105c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:54.076586 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b378707-200b-475c-882a-e6297d45105c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:54.093798 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1315/2658] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:16:54.095169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a62ef-06ab-4ec8-bcf5-7d9ec1e3b391 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:54.105972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a62ef-06ab-4ec8-bcf5-7d9ec1e3b391 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:54.110835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db8705-da8d-4434-8cef-00a98fe3bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:54.111514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db8705-da8d-4434-8cef-00a98fe3bbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:54.111870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db8705-da8d-4434-8cef-00a98fe3bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:54.112170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db8705-da8d-4434-8cef-00a98fe3bbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:54.112792 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db8705-da8d-4434-8cef-00a98fe3bbf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:54.114934 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db8705-da8d-4434-8cef-00a98fe3bbf1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:54.151908 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1344/2659] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:16:54 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:54.156201 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b378707-200b-475c-882a-e6297d45105c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:54.166683 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b378707-200b-475c-882a-e6297d45105c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:54.208145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:54.235489 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488902f4-5133-4613-b314-ca33ad86cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:54.236222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488902f4-5133-4613-b314-ca33ad86cdcd admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:54.236492 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488902f4-5133-4613-b314-ca33ad86cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:54.236761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488902f4-5133-4613-b314-ca33ad86cdcd admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:54.237523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488902f4-5133-4613-b314-ca33ad86cdcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:54.239632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488902f4-5133-4613-b314-ca33ad86cdcd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:54.267650 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1316/2660] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:16:54 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:54.268746 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db8705-da8d-4434-8cef-00a98fe3bbf1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:54.276505 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:54.280832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db8705-da8d-4434-8cef-00a98fe3bbf1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:54.289241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af38ae9-a11e-4fb0-924e-e7cec4b61280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:54.289241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af38ae9-a11e-4fb0-924e-e7cec4b61280 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:54.289677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af38ae9-a11e-4fb0-924e-e7cec4b61280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:54.290388 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af38ae9-a11e-4fb0-924e-e7cec4b61280 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:54.291051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af38ae9-a11e-4fb0-924e-e7cec4b61280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:54.292779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af38ae9-a11e-4fb0-924e-e7cec4b61280 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:54.306525 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1345/2661] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:54.312213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488902f4-5133-4613-b314-ca33ad86cdcd admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:54.322129 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488902f4-5133-4613-b314-ca33ad86cdcd admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:54.327472 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddc2cd-6f03-4943-b710-1e5df6a744b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:54.328128 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddc2cd-6f03-4943-b710-1e5df6a744b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:54.328445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddc2cd-6f03-4943-b710-1e5df6a744b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:54.328799 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddc2cd-6f03-4943-b710-1e5df6a744b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:54.329447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddc2cd-6f03-4943-b710-1e5df6a744b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:54.331035 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddc2cd-6f03-4943-b710-1e5df6a744b4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:54.342192 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1317/2662] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:54.346791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af38ae9-a11e-4fb0-924e-e7cec4b61280 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:54.357078 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af38ae9-a11e-4fb0-924e-e7cec4b61280 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:54.362268 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fee79-40f3-499c-a52c-920d156584c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:54.363265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fee79-40f3-499c-a52c-920d156584c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:54.363540 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fee79-40f3-499c-a52c-920d156584c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:54.363805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fee79-40f3-499c-a52c-920d156584c2 admin admin] PATH_INFO: `/v3/projects/39b791a2521143039740c917444f86ba/users/e15e4ec923f7496591c8e4d854cfadeb/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:54.384648 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fee79-40f3-499c-a52c-920d156584c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b791a2521143039740c917444f86ba, user_id=e15e4ec923f7496591c8e4d854cfadeb, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:54.387484 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fee79-40f3-499c-a52c-920d156584c2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:54.401624 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1346/2663] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:54 2022] PUT /identity/v3/projects/39b791a2521143039740c917444f86ba/users/e15e4ec923f7496591c8e4d854cfadeb/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:54.412148 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d11b3a-817d-4cd8-8df0-99f748454b29 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:54.412497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d11b3a-817d-4cd8-8df0-99f748454b29 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:54.412699 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d11b3a-817d-4cd8-8df0-99f748454b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:54.442106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d5d11b3a-817d-4cd8-8df0-99f748454b29 None None] MFA Rules not processed for user `e15e4ec923f7496591c8e4d854cfadeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:54.443333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d5d11b3a-817d-4cd8-8df0-99f748454b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:54.509225 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1318/2664] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:54.513738 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fee79-40f3-499c-a52c-920d156584c2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:54.577191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fee79-40f3-499c-a52c-920d156584c2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:54.581739 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29f190-0eb9-48e7-a24e-88b94351b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:54.582332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29f190-0eb9-48e7-a24e-88b94351b65a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:54.582607 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29f190-0eb9-48e7-a24e-88b94351b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:54.582870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29f190-0eb9-48e7-a24e-88b94351b65a admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:54.583484 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29f190-0eb9-48e7-a24e-88b94351b65a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:54.585505 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29f190-0eb9-48e7-a24e-88b94351b65a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:54.614658 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1347/2665] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:16:54 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:54.618829 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d11b3a-817d-4cd8-8df0-99f748454b29 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:54.630772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d11b3a-817d-4cd8-8df0-99f748454b29 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:54.689025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb8bcb-dbe2-4c6f-94b6-58057f9f7c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:54.689531 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb8bcb-dbe2-4c6f-94b6-58057f9f7c5b admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:54.689835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb8bcb-dbe2-4c6f-94b6-58057f9f7c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:54.690103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb8bcb-dbe2-4c6f-94b6-58057f9f7c5b admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:54.690733 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb8bcb-dbe2-4c6f-94b6-58057f9f7c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:54.692697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb8bcb-dbe2-4c6f-94b6-58057f9f7c5b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:54.713925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1319/2666] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:16:54 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:54.717996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29f190-0eb9-48e7-a24e-88b94351b65a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:54.728185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29f190-0eb9-48e7-a24e-88b94351b65a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:54.739291 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bae8b-fbae-4fb1-b59a-ab38a429bf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:54.739898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bae8b-fbae-4fb1-b59a-ab38a429bf5b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:54.740217 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bae8b-fbae-4fb1-b59a-ab38a429bf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:54.740489 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bae8b-fbae-4fb1-b59a-ab38a429bf5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:54.741127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bae8b-fbae-4fb1-b59a-ab38a429bf5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:54.742718 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bae8b-fbae-4fb1-b59a-ab38a429bf5b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:54.754323 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1348/2667] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:54.758325 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb8bcb-dbe2-4c6f-94b6-58057f9f7c5b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:54.768492 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb8bcb-dbe2-4c6f-94b6-58057f9f7c5b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:54.772979 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9163329-0763-4412-9a15-ce1e199b4a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:54.773574 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9163329-0763-4412-9a15-ce1e199b4a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:54.774077 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9163329-0763-4412-9a15-ce1e199b4a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:54.774218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9163329-0763-4412-9a15-ce1e199b4a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:54.774782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9163329-0763-4412-9a15-ce1e199b4a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:54.776975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9163329-0763-4412-9a15-ce1e199b4a4d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:54.787155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1320/2668] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:54.791420 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bae8b-fbae-4fb1-b59a-ab38a429bf5b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:54.802045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bae8b-fbae-4fb1-b59a-ab38a429bf5b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:54.807320 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4cc45-f532-4739-a2e5-279bab719f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:54.807565 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4cc45-f532-4739-a2e5-279bab719f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:54.807843 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4cc45-f532-4739-a2e5-279bab719f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:54.808148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4cc45-f532-4739-a2e5-279bab719f97 admin admin] PATH_INFO: `/v3/projects/29872b7e40da4c1ab9e92b8809efc9be/users/297593a592f64dfb86ac67b800e0b1ed/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:54.825088 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4cc45-f532-4739-a2e5-279bab719f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29872b7e40da4c1ab9e92b8809efc9be, user_id=297593a592f64dfb86ac67b800e0b1ed, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:54.827855 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4cc45-f532-4739-a2e5-279bab719f97 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:54.842202 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1349/2669] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:54 2022] PUT /identity/v3/projects/29872b7e40da4c1ab9e92b8809efc9be/users/297593a592f64dfb86ac67b800e0b1ed/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:54.853863 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd73b5-2ceb-4a5b-b697-6357f835c197 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:54.854256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd73b5-2ceb-4a5b-b697-6357f835c197 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:54.854621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd73b5-2ceb-4a5b-b697-6357f835c197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:54.883938 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-82fd73b5-2ceb-4a5b-b697-6357f835c197 None None] MFA Rules not processed for user `297593a592f64dfb86ac67b800e0b1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:54.885734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-82fd73b5-2ceb-4a5b-b697-6357f835c197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:54.895349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:54.952948 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1321/2670] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:16:54.957365 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4cc45-f532-4739-a2e5-279bab719f97 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:55.023199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4cc45-f532-4739-a2e5-279bab719f97 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:55.028781 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f147e0-13fd-40e3-bbdf-e3fc7d7ed0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:55.029376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f147e0-13fd-40e3-bbdf-e3fc7d7ed0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:55.029650 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f147e0-13fd-40e3-bbdf-e3fc7d7ed0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:55.029919 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f147e0-13fd-40e3-bbdf-e3fc7d7ed0f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:55.030548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f147e0-13fd-40e3-bbdf-e3fc7d7ed0f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:55.032465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f147e0-13fd-40e3-bbdf-e3fc7d7ed0f4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:55.059415 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1350/2671] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:16:54 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:55.063447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd73b5-2ceb-4a5b-b697-6357f835c197 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:55.076668 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd73b5-2ceb-4a5b-b697-6357f835c197 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:55.138988 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e42a56-8e3a-4cee-820c-e93be84155e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:55.139639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e42a56-8e3a-4cee-820c-e93be84155e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:55.139849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e42a56-8e3a-4cee-820c-e93be84155e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:55.140130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e42a56-8e3a-4cee-820c-e93be84155e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:55.140768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e42a56-8e3a-4cee-820c-e93be84155e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:55.142666 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e42a56-8e3a-4cee-820c-e93be84155e5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:55.162424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1322/2672] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:16:55 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:16:55.167105 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f147e0-13fd-40e3-bbdf-e3fc7d7ed0f4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:55.173802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:55.178149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f147e0-13fd-40e3-bbdf-e3fc7d7ed0f4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:55.184270 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b5c9b-01df-4bbc-bcf3-4e57572ab404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:55.184877 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b5c9b-01df-4bbc-bcf3-4e57572ab404 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:55.185156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b5c9b-01df-4bbc-bcf3-4e57572ab404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:55.185423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b5c9b-01df-4bbc-bcf3-4e57572ab404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:55.186057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b5c9b-01df-4bbc-bcf3-4e57572ab404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:55.187676 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b5c9b-01df-4bbc-bcf3-4e57572ab404 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:55.198196 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1351/2673] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:55.203228 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e42a56-8e3a-4cee-820c-e93be84155e5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:55.214949 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e42a56-8e3a-4cee-820c-e93be84155e5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:55.219558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ada1e-ae9d-4d33-98b2-4d0d9d5a13f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:55.220241 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ada1e-ae9d-4d33-98b2-4d0d9d5a13f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:55.220515 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ada1e-ae9d-4d33-98b2-4d0d9d5a13f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:55.220782 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ada1e-ae9d-4d33-98b2-4d0d9d5a13f9 admin admin] PATH_INFO: `/v3/projects/015fb8fdaa194b74b059206bf51a1c95/users/9a0277dace2b4dd89190652504946de9/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:55.236066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ada1e-ae9d-4d33-98b2-4d0d9d5a13f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015fb8fdaa194b74b059206bf51a1c95, user_id=9a0277dace2b4dd89190652504946de9, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:55.238716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ada1e-ae9d-4d33-98b2-4d0d9d5a13f9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:55.251686 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1323/2674] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:55 2022] PUT /identity/v3/projects/015fb8fdaa194b74b059206bf51a1c95/users/9a0277dace2b4dd89190652504946de9/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:55.256206 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b5c9b-01df-4bbc-bcf3-4e57572ab404 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:55.265935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b5c9b-01df-4bbc-bcf3-4e57572ab404 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:55.321160 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9a976-c727-4cb8-8ae9-ca28c9aa260f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:55.321754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9a976-c727-4cb8-8ae9-ca28c9aa260f admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:55.322027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9a976-c727-4cb8-8ae9-ca28c9aa260f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:55.322295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9a976-c727-4cb8-8ae9-ca28c9aa260f admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:55.322923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9a976-c727-4cb8-8ae9-ca28c9aa260f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:55.324534 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9a976-c727-4cb8-8ae9-ca28c9aa260f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:55.337561 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1352/2675] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:55.339332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ada1e-ae9d-4d33-98b2-4d0d9d5a13f9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:55.349887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ada1e-ae9d-4d33-98b2-4d0d9d5a13f9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:55.355165 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59a2a9-c47a-4369-afdf-7019a381cbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:55.355822 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59a2a9-c47a-4369-afdf-7019a381cbf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:55.356154 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59a2a9-c47a-4369-afdf-7019a381cbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:55.356429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59a2a9-c47a-4369-afdf-7019a381cbf4 admin admin] PATH_INFO: `/v3/projects/015fb8fdaa194b74b059206bf51a1c95/users/9a0277dace2b4dd89190652504946de9/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:55.358338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59a2a9-c47a-4369-afdf-7019a381cbf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015fb8fdaa194b74b059206bf51a1c95, user_id=9a0277dace2b4dd89190652504946de9, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:55.360993 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59a2a9-c47a-4369-afdf-7019a381cbf4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:55.372074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1324/2676] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:55 2022] PUT /identity/v3/projects/015fb8fdaa194b74b059206bf51a1c95/users/9a0277dace2b4dd89190652504946de9/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:55.385566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31edce-8bfd-434a-ae18-9f978bbd2643 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:55.385850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31edce-8bfd-434a-ae18-9f978bbd2643 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:55.386159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31edce-8bfd-434a-ae18-9f978bbd2643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:55.418125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3d31edce-8bfd-434a-ae18-9f978bbd2643 None None] MFA Rules not processed for user `9a0277dace2b4dd89190652504946de9`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:55.418125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3d31edce-8bfd-434a-ae18-9f978bbd2643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:55.425505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59a2a9-c47a-4369-afdf-7019a381cbf4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:55.427251 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ba59a2a9-c47a-4369-afdf-7019a381cbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:55.488837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59a2a9-c47a-4369-afdf-7019a381cbf4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:55.491009 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1353/2677] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:55.494194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaf62d-13d0-4387-9b5f-cf21efa12d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:55.495692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaf62d-13d0-4387-9b5f-cf21efa12d73 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:55.496084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaf62d-13d0-4387-9b5f-cf21efa12d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:55.496417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaf62d-13d0-4387-9b5f-cf21efa12d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:55.498496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-edfaf62d-13d0-4387-9b5f-cf21efa12d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:55.502983 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31edce-8bfd-434a-ae18-9f978bbd2643 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:55.504430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3d31edce-8bfd-434a-ae18-9f978bbd2643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:55.520304 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:55.563339 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31edce-8bfd-434a-ae18-9f978bbd2643 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:55.573548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc7ec7-8122-45ef-9fd3-04d80d47a94f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:55.574199 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7ec7-8122-45ef-9fd3-04d80d47a94f service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:55.574467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7ec7-8122-45ef-9fd3-04d80d47a94f service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:55.574731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7ec7-8122-45ef-9fd3-04d80d47a94f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:55.579852 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfaf62d-13d0-4387-9b5f-cf21efa12d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:55.581342 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfaf62d-13d0-4387-9b5f-cf21efa12d73 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:55.591843 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1325/2678] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:16:55.612555 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:55.641525 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc7ec7-8122-45ef-9fd3-04d80d47a94f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:55.643026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc7ec7-8122-45ef-9fd3-04d80d47a94f service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:55.653144 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1354/2679] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:16:57.241202 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaf62d-13d0-4387-9b5f-cf21efa12d73 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:57.245937 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-edfaf62d-13d0-4387-9b5f-cf21efa12d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:57.258714 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaf62d-13d0-4387-9b5f-cf21efa12d73 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:57.263549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80d12a-d104-4012-ac90-d6746ebd4b33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:57.264428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80d12a-d104-4012-ac90-d6746ebd4b33 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:57.264775 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80d12a-d104-4012-ac90-d6746ebd4b33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:57.265117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80d12a-d104-4012-ac90-d6746ebd4b33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:57.340369 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80d12a-d104-4012-ac90-d6746ebd4b33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:57.341823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80d12a-d104-4012-ac90-d6746ebd4b33 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:57.352966 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1326/2680] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:57.967211 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc7ec7-8122-45ef-9fd3-04d80d47a94f service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:57.976127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc7ec7-8122-45ef-9fd3-04d80d47a94f service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:57.980185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dbcd7-6dcd-4f43-9344-9176182e12fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:57.985137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dbcd7-6dcd-4f43-9344-9176182e12fb service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:57.985137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dbcd7-6dcd-4f43-9344-9176182e12fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:57.985137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dbcd7-6dcd-4f43-9344-9176182e12fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:57.995330 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dbcd7-6dcd-4f43-9344-9176182e12fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:57.996801 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dbcd7-6dcd-4f43-9344-9176182e12fb service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:58.007377 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1355/2681] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:58.872375 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80d12a-d104-4012-ac90-d6746ebd4b33 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:58.874832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7d80d12a-d104-4012-ac90-d6746ebd4b33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:58.936089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dbcd7-6dcd-4f43-9344-9176182e12fb service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:58.937682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-408dbcd7-6dcd-4f43-9344-9176182e12fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:58.958492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dbcd7-6dcd-4f43-9344-9176182e12fb service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:58.963392 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478f260-97c2-4d9d-82a8-622e2fbcfcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:58.964096 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478f260-97c2-4d9d-82a8-622e2fbcfcb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:58.964398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478f260-97c2-4d9d-82a8-622e2fbcfcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:58.964673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478f260-97c2-4d9d-82a8-622e2fbcfcb3 admin admin] PATH_INFO: `/v3/users/8c48a0f56a484813af66d8b691c79113` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:58.965794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478f260-97c2-4d9d-82a8-622e2fbcfcb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c48a0f56a484813af66d8b691c79113)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:58.966868 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80d12a-d104-4012-ac90-d6746ebd4b33 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:58.967768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478f260-97c2-4d9d-82a8-622e2fbcfcb3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:58.981751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2218942-4ea5-4a89-9e15-fb902d325ca1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed835047051142d2bc98bb1564e3a98f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:58.982045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2218942-4ea5-4a89-9e15-fb902d325ca1 service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:58.982318 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2218942-4ea5-4a89-9e15-fb902d325ca1 service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:58.982583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2218942-4ea5-4a89-9e15-fb902d325ca1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:58.987333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e2218942-4ea5-4a89-9e15-fb902d325ca1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:59.001707 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2218942-4ea5-4a89-9e15-fb902d325ca1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:59.003676 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2218942-4ea5-4a89-9e15-fb902d325ca1 service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:59.016734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1327/2682] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:59.034280 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d478f260-97c2-4d9d-82a8-622e2fbcfcb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c48a0f56a484813af66d8b691c79113'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:59.049215 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d478f260-97c2-4d9d-82a8-622e2fbcfcb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c48a0f56a484813af66d8b691c79113'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:59.058976 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d478f260-97c2-4d9d-82a8-622e2fbcfcb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c48a0f56a484813af66d8b691c79113'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:59.060082 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d478f260-97c2-4d9d-82a8-622e2fbcfcb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c48a0f56a484813af66d8b691c79113'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:59.077231 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d478f260-97c2-4d9d-82a8-622e2fbcfcb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c48a0f56a484813af66d8b691c79113'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:59.086052 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1356/2683] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:16:58 2022] DELETE /identity/v3/users/8c48a0f56a484813af66d8b691c79113 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:59.280957 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2218942-4ea5-4a89-9e15-fb902d325ca1 service placement] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:59.293793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2218942-4ea5-4a89-9e15-fb902d325ca1 service placement] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:59.345766 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:59.363506 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145231f2-f726-435a-8b5a-435846a582c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:59.364184 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145231f2-f726-435a-8b5a-435846a582c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:59.364500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145231f2-f726-435a-8b5a-435846a582c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:59.364771 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145231f2-f726-435a-8b5a-435846a582c9 admin admin] PATH_INFO: `/v3/projects/7ecf819b4c6d4eda90cec9a989fe3a29` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:59.367608 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145231f2-f726-435a-8b5a-435846a582c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ecf819b4c6d4eda90cec9a989fe3a29)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:59.369457 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145231f2-f726-435a-8b5a-435846a582c9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:59.433718 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-145231f2-f726-435a-8b5a-435846a582c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ecf819b4c6d4eda90cec9a989fe3a29', 'request_id': 'req-145231f2-f726-435a-8b5a-435846a582c9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:59.441037 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-145231f2-f726-435a-8b5a-435846a582c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ecf819b4c6d4eda90cec9a989fe3a29', 'request_id': 'req-145231f2-f726-435a-8b5a-435846a582c9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:59.453755 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-145231f2-f726-435a-8b5a-435846a582c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ecf819b4c6d4eda90cec9a989fe3a29', 'request_id': 'req-145231f2-f726-435a-8b5a-435846a582c9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:59.474571 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-145231f2-f726-435a-8b5a-435846a582c9 admin admin] The token cache is being invalidate because project 7ecf819b4c6d4eda90cec9a989fe3a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:16:59.474819 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-145231f2-f726-435a-8b5a-435846a582c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:59.475763 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-145231f2-f726-435a-8b5a-435846a582c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:16:59.477567 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1328/2684] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:16:59 2022] DELETE /identity/v3/projects/7ecf819b4c6d4eda90cec9a989fe3a29 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:59.483254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16ad1a-9d43-4667-bfbf-d1fd10095544 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:59.483492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16ad1a-9d43-4667-bfbf-d1fd10095544 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:59.483772 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16ad1a-9d43-4667-bfbf-d1fd10095544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:59.506011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1f16ad1a-9d43-4667-bfbf-d1fd10095544 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:59.507495 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1f16ad1a-9d43-4667-bfbf-d1fd10095544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:59.567677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1357/2685] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:16:59.576288 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a84ac-f337-44a2-bbbd-bf2af566c61f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:59.576578 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a84ac-f337-44a2-bbbd-bf2af566c61f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:59.576852 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a84ac-f337-44a2-bbbd-bf2af566c61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:59.597426 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-998a84ac-f337-44a2-bbbd-bf2af566c61f None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:59.598646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-998a84ac-f337-44a2-bbbd-bf2af566c61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:59.607059 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1329/2686] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:59.611306 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16ad1a-9d43-4667-bfbf-d1fd10095544 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:59.621636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16ad1a-9d43-4667-bfbf-d1fd10095544 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:59.626131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6edf76-72bb-472d-b970-e315d78e622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:59.626721 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6edf76-72bb-472d-b970-e315d78e622d admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:59.627248 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6edf76-72bb-472d-b970-e315d78e622d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:59.627514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6edf76-72bb-472d-b970-e315d78e622d admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:59.628193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6edf76-72bb-472d-b970-e315d78e622d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:16:59.628492 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6edf76-72bb-472d-b970-e315d78e622d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:59.630057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6edf76-72bb-472d-b970-e315d78e622d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:59.641792 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1358/2687] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:16:59.646321 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a84ac-f337-44a2-bbbd-bf2af566c61f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:59.657496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a84ac-f337-44a2-bbbd-bf2af566c61f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:59.662411 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71885bb-954b-45b9-8f8c-e5d67d442683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:59.663011 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71885bb-954b-45b9-8f8c-e5d67d442683 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:59.663288 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71885bb-954b-45b9-8f8c-e5d67d442683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:59.663630 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71885bb-954b-45b9-8f8c-e5d67d442683 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:59.664393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71885bb-954b-45b9-8f8c-e5d67d442683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:59.667032 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71885bb-954b-45b9-8f8c-e5d67d442683 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:59.701263 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1330/2688] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:16:59 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:59.705980 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6edf76-72bb-472d-b970-e315d78e622d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:59.716804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6edf76-72bb-472d-b970-e315d78e622d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:59.728674 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:59.777210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12621301-e549-4a25-be2a-cefbfeee978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:59.777812 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12621301-e549-4a25-be2a-cefbfeee978e admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:59.778089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12621301-e549-4a25-be2a-cefbfeee978e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:59.778365 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12621301-e549-4a25-be2a-cefbfeee978e admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:59.778977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12621301-e549-4a25-be2a-cefbfeee978e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:59.780962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12621301-e549-4a25-be2a-cefbfeee978e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:59.804423 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1359/2689] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:16:59 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:16:59.805560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71885bb-954b-45b9-8f8c-e5d67d442683 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:59.816183 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71885bb-954b-45b9-8f8c-e5d67d442683 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:59.820731 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28df107-8be2-4390-b376-7b4d24623db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:59.821262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28df107-8be2-4390-b376-7b4d24623db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:59.821531 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28df107-8be2-4390-b376-7b4d24623db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:59.821793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28df107-8be2-4390-b376-7b4d24623db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:59.823046 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28df107-8be2-4390-b376-7b4d24623db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:59.824661 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28df107-8be2-4390-b376-7b4d24623db3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:59.834860 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1331/2690] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:59.838770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12621301-e549-4a25-be2a-cefbfeee978e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:59.848641 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12621301-e549-4a25-be2a-cefbfeee978e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:59.853727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93edd29-f531-497c-82f9-bfd6a1f6c3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:59.854323 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93edd29-f531-497c-82f9-bfd6a1f6c3cd admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:59.854600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93edd29-f531-497c-82f9-bfd6a1f6c3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:59.854867 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93edd29-f531-497c-82f9-bfd6a1f6c3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:59.855499 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93edd29-f531-497c-82f9-bfd6a1f6c3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:59.857106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93edd29-f531-497c-82f9-bfd6a1f6c3cd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:59.867771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1360/2691] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:16:59.872601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28df107-8be2-4390-b376-7b4d24623db3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:59.882770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28df107-8be2-4390-b376-7b4d24623db3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:59.887972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07995c7e-c460-42d8-b72a-1cb52bba3233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:59.888699 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07995c7e-c460-42d8-b72a-1cb52bba3233 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:59.889018 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07995c7e-c460-42d8-b72a-1cb52bba3233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:59.889325 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07995c7e-c460-42d8-b72a-1cb52bba3233 admin admin] PATH_INFO: `/v3/projects/5264991702da40098656c84c049be7bd/users/83c3ba965bf94d75a48dc6ecf03008b5/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:59.903544 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07995c7e-c460-42d8-b72a-1cb52bba3233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5264991702da40098656c84c049be7bd, user_id=83c3ba965bf94d75a48dc6ecf03008b5, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:59.906226 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07995c7e-c460-42d8-b72a-1cb52bba3233 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:59.924605 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1332/2692] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:16:59 2022] PUT /identity/v3/projects/5264991702da40098656c84c049be7bd/users/83c3ba965bf94d75a48dc6ecf03008b5/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:16:59.935387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a4d62-fccb-4ead-a33e-784547482db8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:59.935666 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a4d62-fccb-4ead-a33e-784547482db8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:59.935937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a4d62-fccb-4ead-a33e-784547482db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:59.963416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-de2a4d62-fccb-4ead-a33e-784547482db8 None None] MFA Rules not processed for user `83c3ba965bf94d75a48dc6ecf03008b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:59.964693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-de2a4d62-fccb-4ead-a33e-784547482db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:00.029450 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1361/2693] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:16:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:00.034483 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07995c7e-c460-42d8-b72a-1cb52bba3233 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:00.100660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07995c7e-c460-42d8-b72a-1cb52bba3233 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:00.105335 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552124c-6109-458e-b2f6-764c28d52686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:00.105934 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552124c-6109-458e-b2f6-764c28d52686 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:00.106210 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552124c-6109-458e-b2f6-764c28d52686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:00.106477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552124c-6109-458e-b2f6-764c28d52686 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:00.107117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552124c-6109-458e-b2f6-764c28d52686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:00.109049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552124c-6109-458e-b2f6-764c28d52686 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:00.122871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:00.136885 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1333/2694] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:17:00 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:17:00.141045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a4d62-fccb-4ead-a33e-784547482db8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:00.152445 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a4d62-fccb-4ead-a33e-784547482db8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:00.210291 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b7b5f-b1c4-467e-9c73-1493cc13fce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:00.210901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b7b5f-b1c4-467e-9c73-1493cc13fce4 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:00.211176 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b7b5f-b1c4-467e-9c73-1493cc13fce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:00.211447 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b7b5f-b1c4-467e-9c73-1493cc13fce4 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:00.212106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b7b5f-b1c4-467e-9c73-1493cc13fce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:00.214574 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b7b5f-b1c4-467e-9c73-1493cc13fce4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:00.235567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1362/2695] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:17:00 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:17:00.239710 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552124c-6109-458e-b2f6-764c28d52686 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:00.250683 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552124c-6109-458e-b2f6-764c28d52686 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:00.255497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e69c4-da03-4e1a-a88a-f85881670888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:00.256132 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e69c4-da03-4e1a-a88a-f85881670888 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:00.256411 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e69c4-da03-4e1a-a88a-f85881670888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:00.256698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e69c4-da03-4e1a-a88a-f85881670888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:00.257323 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e69c4-da03-4e1a-a88a-f85881670888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:00.258906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e69c4-da03-4e1a-a88a-f85881670888 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:00.270219 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1334/2696] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:00.274375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b7b5f-b1c4-467e-9c73-1493cc13fce4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:00.290702 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b7b5f-b1c4-467e-9c73-1493cc13fce4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:00.295853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e31418-1923-4fe4-bf2b-e8bb1768d8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:00.296588 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e31418-1923-4fe4-bf2b-e8bb1768d8fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:00.296885 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e31418-1923-4fe4-bf2b-e8bb1768d8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:00.297243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e31418-1923-4fe4-bf2b-e8bb1768d8fc admin admin] PATH_INFO: `/v3/projects/7981dafc049a49e5ac390648a72208df/users/d767b2c8a1404004bfb546ef9ad4b853/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:00.310827 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:00.315008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e31418-1923-4fe4-bf2b-e8bb1768d8fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7981dafc049a49e5ac390648a72208df, user_id=d767b2c8a1404004bfb546ef9ad4b853, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:00.318048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e31418-1923-4fe4-bf2b-e8bb1768d8fc admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:00.333468 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1363/2697] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:17:00 2022] PUT /identity/v3/projects/7981dafc049a49e5ac390648a72208df/users/d767b2c8a1404004bfb546ef9ad4b853/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:00.337486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e69c4-da03-4e1a-a88a-f85881670888 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:00.349545 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e69c4-da03-4e1a-a88a-f85881670888 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:00.410547 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b171023-a806-4cb3-bedc-2bffeb8356fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:00.411066 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171023-a806-4cb3-bedc-2bffeb8356fe admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:00.411348 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171023-a806-4cb3-bedc-2bffeb8356fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:00.411620 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171023-a806-4cb3-bedc-2bffeb8356fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:00.412297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b171023-a806-4cb3-bedc-2bffeb8356fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:00.413930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b171023-a806-4cb3-bedc-2bffeb8356fe admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:00.423859 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1335/2698] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:00.428085 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e31418-1923-4fe4-bf2b-e8bb1768d8fc admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:00.439012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e31418-1923-4fe4-bf2b-e8bb1768d8fc admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:00.443552 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d41d8-47f1-47d9-9b1c-93dfee06cebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:00.444232 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d41d8-47f1-47d9-9b1c-93dfee06cebf admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:00.444510 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d41d8-47f1-47d9-9b1c-93dfee06cebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:00.444774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d41d8-47f1-47d9-9b1c-93dfee06cebf admin admin] PATH_INFO: `/v3/projects/7981dafc049a49e5ac390648a72208df/users/d767b2c8a1404004bfb546ef9ad4b853/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:00.446676 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d41d8-47f1-47d9-9b1c-93dfee06cebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7981dafc049a49e5ac390648a72208df, user_id=d767b2c8a1404004bfb546ef9ad4b853, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:00.449874 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d41d8-47f1-47d9-9b1c-93dfee06cebf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:00.460142 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1364/2699] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:17:00 2022] PUT /identity/v3/projects/7981dafc049a49e5ac390648a72208df/users/d767b2c8a1404004bfb546ef9ad4b853/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:17:00.471199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f0444-5a61-42dc-a798-06f2ec537056 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:00.471563 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f0444-5a61-42dc-a798-06f2ec537056 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:00.471912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f0444-5a61-42dc-a798-06f2ec537056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:00.502531 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c79f0444-5a61-42dc-a798-06f2ec537056 None None] MFA Rules not processed for user `d767b2c8a1404004bfb546ef9ad4b853`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:00.503758 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c79f0444-5a61-42dc-a798-06f2ec537056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:00.583140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1336/2700] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:00.590541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d41d8-47f1-47d9-9b1c-93dfee06cebf admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:00.592358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ed7d41d8-47f1-47d9-9b1c-93dfee06cebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:00.655590 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d41d8-47f1-47d9-9b1c-93dfee06cebf admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:00.659329 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4f3a2-19a8-47ce-b933-92f537ee5bf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:00.660002 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4f3a2-19a8-47ce-b933-92f537ee5bf9 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:00.660269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4f3a2-19a8-47ce-b933-92f537ee5bf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:00.660538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4f3a2-19a8-47ce-b933-92f537ee5bf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:00.669998 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4f3a2-19a8-47ce-b933-92f537ee5bf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:00.671419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4f3a2-19a8-47ce-b933-92f537ee5bf9 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:00.681239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1365/2701] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:00.769705 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f0444-5a61-42dc-a798-06f2ec537056 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:00.782508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f0444-5a61-42dc-a798-06f2ec537056 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:00.786205 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf009d-7030-4180-8472-d878186b8b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:00.786810 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf009d-7030-4180-8472-d878186b8b12 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:00.787083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf009d-7030-4180-8472-d878186b8b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:00.787349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf009d-7030-4180-8472-d878186b8b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:00.858206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf009d-7030-4180-8472-d878186b8b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:00.859324 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf009d-7030-4180-8472-d878186b8b12 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:00.869180 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1337/2702] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:01.964494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4f3a2-19a8-47ce-b933-92f537ee5bf9 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:01.965917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-51c4f3a2-19a8-47ce-b933-92f537ee5bf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:02.032142 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4f3a2-19a8-47ce-b933-92f537ee5bf9 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:02.037889 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f150db-d5b2-4e1e-aa49-802c6e3f8230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:02.038663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f150db-d5b2-4e1e-aa49-802c6e3f8230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:02.038939 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f150db-d5b2-4e1e-aa49-802c6e3f8230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:02.039206 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f150db-d5b2-4e1e-aa49-802c6e3f8230 admin admin] PATH_INFO: `/v3/users/e15e4ec923f7496591c8e4d854cfadeb` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:02.040374 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f150db-d5b2-4e1e-aa49-802c6e3f8230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15e4ec923f7496591c8e4d854cfadeb)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:02.042293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f150db-d5b2-4e1e-aa49-802c6e3f8230 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:02.097439 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-92f150db-d5b2-4e1e-aa49-802c6e3f8230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15e4ec923f7496591c8e4d854cfadeb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:02.104523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-92f150db-d5b2-4e1e-aa49-802c6e3f8230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15e4ec923f7496591c8e4d854cfadeb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:02.112632 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-92f150db-d5b2-4e1e-aa49-802c6e3f8230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15e4ec923f7496591c8e4d854cfadeb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:02.113432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-92f150db-d5b2-4e1e-aa49-802c6e3f8230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15e4ec923f7496591c8e4d854cfadeb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:02.126633 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-92f150db-d5b2-4e1e-aa49-802c6e3f8230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15e4ec923f7496591c8e4d854cfadeb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:02.128637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:02.134805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1366/2703] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:17:01 2022] DELETE /identity/v3/users/e15e4ec923f7496591c8e4d854cfadeb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:02.140235 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8b8e6-2935-4811-a080-94a735543a83 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:02.140750 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8b8e6-2935-4811-a080-94a735543a83 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:02.140862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8b8e6-2935-4811-a080-94a735543a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:02.147991 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:02.161977 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-68c8b8e6-2935-4811-a080-94a735543a83 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:02.163191 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-68c8b8e6-2935-4811-a080-94a735543a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:02.230127 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1338/2704] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:02.240885 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f150db-d5b2-4e1e-aa49-802c6e3f8230 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:02.242424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-92f150db-d5b2-4e1e-aa49-802c6e3f8230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:02.304470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f150db-d5b2-4e1e-aa49-802c6e3f8230 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:02.308342 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d22637-7a36-4ea7-9ebf-face5ce43e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:02.308953 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d22637-7a36-4ea7-9ebf-face5ce43e1e service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:02.309250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d22637-7a36-4ea7-9ebf-face5ce43e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:02.309523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d22637-7a36-4ea7-9ebf-face5ce43e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:02.319346 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d22637-7a36-4ea7-9ebf-face5ce43e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:02.321055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d22637-7a36-4ea7-9ebf-face5ce43e1e service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:02.335329 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1367/2705] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:02.625604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8b8e6-2935-4811-a080-94a735543a83 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:02.627454 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-68c8b8e6-2935-4811-a080-94a735543a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:02.639857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8b8e6-2935-4811-a080-94a735543a83 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:02.644584 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5116c-8bf3-4bed-b43f-92eac14d466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:02.645365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5116c-8bf3-4bed-b43f-92eac14d466f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:02.645644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5116c-8bf3-4bed-b43f-92eac14d466f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:02.645920 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5116c-8bf3-4bed-b43f-92eac14d466f admin admin] PATH_INFO: `/v3/projects/39b791a2521143039740c917444f86ba` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:02.647024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5116c-8bf3-4bed-b43f-92eac14d466f admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b791a2521143039740c917444f86ba)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:02.649059 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5116c-8bf3-4bed-b43f-92eac14d466f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:02.697131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1df5116c-8bf3-4bed-b43f-92eac14d466f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b791a2521143039740c917444f86ba', 'request_id': 'req-1df5116c-8bf3-4bed-b43f-92eac14d466f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:02.703393 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1df5116c-8bf3-4bed-b43f-92eac14d466f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b791a2521143039740c917444f86ba', 'request_id': 'req-1df5116c-8bf3-4bed-b43f-92eac14d466f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:02.709043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1df5116c-8bf3-4bed-b43f-92eac14d466f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b791a2521143039740c917444f86ba', 'request_id': 'req-1df5116c-8bf3-4bed-b43f-92eac14d466f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:02.721975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1df5116c-8bf3-4bed-b43f-92eac14d466f admin admin] The token cache is being invalidate because project 39b791a2521143039740c917444f86ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:02.722262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1df5116c-8bf3-4bed-b43f-92eac14d466f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:02.722926 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1df5116c-8bf3-4bed-b43f-92eac14d466f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:02.724458 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1339/2706] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:02 2022] DELETE /identity/v3/projects/39b791a2521143039740c917444f86ba => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:02.729146 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d22637-7a36-4ea7-9ebf-face5ce43e1e service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:02.738549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d22637-7a36-4ea7-9ebf-face5ce43e1e service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:02.795098 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9ac6b-ea87-40a4-8572-293002e35916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:02.795750 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9ac6b-ea87-40a4-8572-293002e35916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:02.796034 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9ac6b-ea87-40a4-8572-293002e35916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:02.796306 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9ac6b-ea87-40a4-8572-293002e35916 admin admin] PATH_INFO: `/v3/users/297593a592f64dfb86ac67b800e0b1ed` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:02.797444 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9ac6b-ea87-40a4-8572-293002e35916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=297593a592f64dfb86ac67b800e0b1ed)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:02.799347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9ac6b-ea87-40a4-8572-293002e35916 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:02.849988 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bed9ac6b-ea87-40a4-8572-293002e35916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297593a592f64dfb86ac67b800e0b1ed'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:02.857626 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bed9ac6b-ea87-40a4-8572-293002e35916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297593a592f64dfb86ac67b800e0b1ed'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:02.867413 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bed9ac6b-ea87-40a4-8572-293002e35916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297593a592f64dfb86ac67b800e0b1ed'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:02.868434 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bed9ac6b-ea87-40a4-8572-293002e35916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297593a592f64dfb86ac67b800e0b1ed'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:02.882923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bed9ac6b-ea87-40a4-8572-293002e35916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297593a592f64dfb86ac67b800e0b1ed'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:02.890382 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1368/2707] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:17:02 2022] DELETE /identity/v3/users/297593a592f64dfb86ac67b800e0b1ed => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:03.180972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5116c-8bf3-4bed-b43f-92eac14d466f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:03.182651 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1df5116c-8bf3-4bed-b43f-92eac14d466f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:03.196746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5116c-8bf3-4bed-b43f-92eac14d466f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:03.259021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61018280-8b63-4a7d-b2e8-f52390e304f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:03.260067 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61018280-8b63-4a7d-b2e8-f52390e304f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:03.260067 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61018280-8b63-4a7d-b2e8-f52390e304f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:03.260301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61018280-8b63-4a7d-b2e8-f52390e304f6 admin admin] PATH_INFO: `/v3/projects/29872b7e40da4c1ab9e92b8809efc9be` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:03.261388 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61018280-8b63-4a7d-b2e8-f52390e304f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29872b7e40da4c1ab9e92b8809efc9be)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:03.263316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61018280-8b63-4a7d-b2e8-f52390e304f6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:03.297238 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:03.320709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-61018280-8b63-4a7d-b2e8-f52390e304f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29872b7e40da4c1ab9e92b8809efc9be', 'request_id': 'req-61018280-8b63-4a7d-b2e8-f52390e304f6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:03.328026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-61018280-8b63-4a7d-b2e8-f52390e304f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29872b7e40da4c1ab9e92b8809efc9be', 'request_id': 'req-61018280-8b63-4a7d-b2e8-f52390e304f6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:03.334424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-61018280-8b63-4a7d-b2e8-f52390e304f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29872b7e40da4c1ab9e92b8809efc9be', 'request_id': 'req-61018280-8b63-4a7d-b2e8-f52390e304f6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:03.348447 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-61018280-8b63-4a7d-b2e8-f52390e304f6 admin admin] The token cache is being invalidate because project 29872b7e40da4c1ab9e92b8809efc9be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:03.348857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-61018280-8b63-4a7d-b2e8-f52390e304f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:03.349627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-61018280-8b63-4a7d-b2e8-f52390e304f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:03.351206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1340/2708] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:03 2022] DELETE /identity/v3/projects/29872b7e40da4c1ab9e92b8809efc9be => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:03.355155 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9ac6b-ea87-40a4-8572-293002e35916 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:03.356596 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bed9ac6b-ea87-40a4-8572-293002e35916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:03.372157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9ac6b-ea87-40a4-8572-293002e35916 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:03.389496 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:03.441250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08597862-c54d-48e0-8c45-554fa340f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:03.441798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08597862-c54d-48e0-8c45-554fa340f018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:03.442067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08597862-c54d-48e0-8c45-554fa340f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:03.442332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08597862-c54d-48e0-8c45-554fa340f018 admin admin] PATH_INFO: `/v3/users/9a0277dace2b4dd89190652504946de9` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:03.444053 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08597862-c54d-48e0-8c45-554fa340f018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0277dace2b4dd89190652504946de9)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:03.445387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08597862-c54d-48e0-8c45-554fa340f018 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:03.507409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-08597862-c54d-48e0-8c45-554fa340f018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0277dace2b4dd89190652504946de9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:03.515685 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-08597862-c54d-48e0-8c45-554fa340f018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0277dace2b4dd89190652504946de9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:03.524541 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-08597862-c54d-48e0-8c45-554fa340f018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0277dace2b4dd89190652504946de9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:03.526170 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-08597862-c54d-48e0-8c45-554fa340f018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0277dace2b4dd89190652504946de9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:03.545759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-08597862-c54d-48e0-8c45-554fa340f018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0277dace2b4dd89190652504946de9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:03.551801 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1369/2709] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:17:03 2022] DELETE /identity/v3/users/9a0277dace2b4dd89190652504946de9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:03.877653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61018280-8b63-4a7d-b2e8-f52390e304f6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:03.879132 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-61018280-8b63-4a7d-b2e8-f52390e304f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:03.895229 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61018280-8b63-4a7d-b2e8-f52390e304f6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:03.974214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfb568-7c64-4b9c-b979-0fc4c59814c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:03.975391 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfb568-7c64-4b9c-b979-0fc4c59814c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:03.975678 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfb568-7c64-4b9c-b979-0fc4c59814c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:03.976068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfb568-7c64-4b9c-b979-0fc4c59814c6 admin admin] PATH_INFO: `/v3/projects/015fb8fdaa194b74b059206bf51a1c95` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:03.977300 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfb568-7c64-4b9c-b979-0fc4c59814c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=015fb8fdaa194b74b059206bf51a1c95)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:03.980233 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfb568-7c64-4b9c-b979-0fc4c59814c6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:04.050314 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c6dfb568-7c64-4b9c-b979-0fc4c59814c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015fb8fdaa194b74b059206bf51a1c95', 'request_id': 'req-c6dfb568-7c64-4b9c-b979-0fc4c59814c6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:04.059652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c6dfb568-7c64-4b9c-b979-0fc4c59814c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015fb8fdaa194b74b059206bf51a1c95', 'request_id': 'req-c6dfb568-7c64-4b9c-b979-0fc4c59814c6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:04.067339 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c6dfb568-7c64-4b9c-b979-0fc4c59814c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015fb8fdaa194b74b059206bf51a1c95', 'request_id': 'req-c6dfb568-7c64-4b9c-b979-0fc4c59814c6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:04.086867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c6dfb568-7c64-4b9c-b979-0fc4c59814c6 admin admin] The token cache is being invalidate because project 015fb8fdaa194b74b059206bf51a1c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:04.087647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c6dfb568-7c64-4b9c-b979-0fc4c59814c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:04.088579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c6dfb568-7c64-4b9c-b979-0fc4c59814c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:04.090702 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1341/2710] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:03 2022] DELETE /identity/v3/projects/015fb8fdaa194b74b059206bf51a1c95 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:17:07.082893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08597862-c54d-48e0-8c45-554fa340f018 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:07.084369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-08597862-c54d-48e0-8c45-554fa340f018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:07.099906 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08597862-c54d-48e0-8c45-554fa340f018 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:07.158728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0540af-7697-4a36-a73c-30c72e82025b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:07.159343 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0540af-7697-4a36-a73c-30c72e82025b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:07.159621 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0540af-7697-4a36-a73c-30c72e82025b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:07.159892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0540af-7697-4a36-a73c-30c72e82025b admin admin] PATH_INFO: `/v3/users/83c3ba965bf94d75a48dc6ecf03008b5` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:07.161114 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0540af-7697-4a36-a73c-30c72e82025b admin admin] RBAC: Authorizing `identity:delete_user(user_id=83c3ba965bf94d75a48dc6ecf03008b5)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:07.163027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0540af-7697-4a36-a73c-30c72e82025b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:07.205589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:07.211176 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4b0540af-7697-4a36-a73c-30c72e82025b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83c3ba965bf94d75a48dc6ecf03008b5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:07.220119 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4b0540af-7697-4a36-a73c-30c72e82025b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83c3ba965bf94d75a48dc6ecf03008b5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:07.227531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4b0540af-7697-4a36-a73c-30c72e82025b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83c3ba965bf94d75a48dc6ecf03008b5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:07.228323 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4b0540af-7697-4a36-a73c-30c72e82025b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83c3ba965bf94d75a48dc6ecf03008b5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:07.240573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4b0540af-7697-4a36-a73c-30c72e82025b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83c3ba965bf94d75a48dc6ecf03008b5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:07.247015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1370/2711] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:17:07 2022] DELETE /identity/v3/users/83c3ba965bf94d75a48dc6ecf03008b5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:07.253494 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc60987-de57-438c-aeb5-b878229bb018 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:07.254012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc60987-de57-438c-aeb5-b878229bb018 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:07.254012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc60987-de57-438c-aeb5-b878229bb018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:07.274081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-dcc60987-de57-438c-aeb5-b878229bb018 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:07.275280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dcc60987-de57-438c-aeb5-b878229bb018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:07.316601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:07.336220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1342/2712] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:17:07.346699 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0540af-7697-4a36-a73c-30c72e82025b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:07.348156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4b0540af-7697-4a36-a73c-30c72e82025b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:07.407152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0540af-7697-4a36-a73c-30c72e82025b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:07.410781 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee1820-1066-4306-92e5-02c15985f113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:07.411371 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee1820-1066-4306-92e5-02c15985f113 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:07.411647 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee1820-1066-4306-92e5-02c15985f113 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:07.411914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee1820-1066-4306-92e5-02c15985f113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:07.421412 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee1820-1066-4306-92e5-02c15985f113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:07.422824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee1820-1066-4306-92e5-02c15985f113 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:07.432058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1371/2713] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:07.705554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc60987-de57-438c-aeb5-b878229bb018 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:07.707098 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dcc60987-de57-438c-aeb5-b878229bb018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:07.724721 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc60987-de57-438c-aeb5-b878229bb018 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:07.729544 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53eada-3e1a-49ae-ace6-b5972c720426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:07.730244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53eada-3e1a-49ae-ace6-b5972c720426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:07.730539 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53eada-3e1a-49ae-ace6-b5972c720426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:07.730707 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53eada-3e1a-49ae-ace6-b5972c720426 admin admin] PATH_INFO: `/v3/projects/5264991702da40098656c84c049be7bd` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:07.731827 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53eada-3e1a-49ae-ace6-b5972c720426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5264991702da40098656c84c049be7bd)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:07.733797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53eada-3e1a-49ae-ace6-b5972c720426 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:07.781572 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b53eada-3e1a-49ae-ace6-b5972c720426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5264991702da40098656c84c049be7bd', 'request_id': 'req-9b53eada-3e1a-49ae-ace6-b5972c720426'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:07.787662 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b53eada-3e1a-49ae-ace6-b5972c720426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5264991702da40098656c84c049be7bd', 'request_id': 'req-9b53eada-3e1a-49ae-ace6-b5972c720426'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:07.793885 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b53eada-3e1a-49ae-ace6-b5972c720426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5264991702da40098656c84c049be7bd', 'request_id': 'req-9b53eada-3e1a-49ae-ace6-b5972c720426'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:07.806125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b53eada-3e1a-49ae-ace6-b5972c720426 admin admin] The token cache is being invalidate because project 5264991702da40098656c84c049be7bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:07.806985 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b53eada-3e1a-49ae-ace6-b5972c720426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:07.807606 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b53eada-3e1a-49ae-ace6-b5972c720426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:07.809140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1343/2714] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:07 2022] DELETE /identity/v3/projects/5264991702da40098656c84c049be7bd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:07.813084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee1820-1066-4306-92e5-02c15985f113 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:07.822822 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee1820-1066-4306-92e5-02c15985f113 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:07.878926 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae596f-91ff-4885-ab64-97f626033dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:07.879550 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae596f-91ff-4885-ab64-97f626033dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:07.879832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae596f-91ff-4885-ab64-97f626033dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:07.880143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae596f-91ff-4885-ab64-97f626033dc0 admin admin] PATH_INFO: `/v3/users/d767b2c8a1404004bfb546ef9ad4b853` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:07.881252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae596f-91ff-4885-ab64-97f626033dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d767b2c8a1404004bfb546ef9ad4b853)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:07.883180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae596f-91ff-4885-ab64-97f626033dc0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:07.927389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79ae596f-91ff-4885-ab64-97f626033dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd767b2c8a1404004bfb546ef9ad4b853'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:07.934211 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79ae596f-91ff-4885-ab64-97f626033dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd767b2c8a1404004bfb546ef9ad4b853'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:07.941127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79ae596f-91ff-4885-ab64-97f626033dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd767b2c8a1404004bfb546ef9ad4b853'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:07.941798 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79ae596f-91ff-4885-ab64-97f626033dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd767b2c8a1404004bfb546ef9ad4b853'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:07.942937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:07.956665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79ae596f-91ff-4885-ab64-97f626033dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd767b2c8a1404004bfb546ef9ad4b853'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:07.963498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1372/2715] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:17:07 2022] DELETE /identity/v3/users/d767b2c8a1404004bfb546ef9ad4b853 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:08.234500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53eada-3e1a-49ae-ace6-b5972c720426 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:08.235965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9b53eada-3e1a-49ae-ace6-b5972c720426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:08.250505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53eada-3e1a-49ae-ace6-b5972c720426 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:08.310677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8256626-1034-4825-acd8-6d03ddd37fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:08.311354 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8256626-1034-4825-acd8-6d03ddd37fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:08.311506 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8256626-1034-4825-acd8-6d03ddd37fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:08.311777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8256626-1034-4825-acd8-6d03ddd37fba admin admin] PATH_INFO: `/v3/projects/7981dafc049a49e5ac390648a72208df` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:08.312947 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8256626-1034-4825-acd8-6d03ddd37fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=7981dafc049a49e5ac390648a72208df)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:08.314835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8256626-1034-4825-acd8-6d03ddd37fba admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:08.365604 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f8256626-1034-4825-acd8-6d03ddd37fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7981dafc049a49e5ac390648a72208df', 'request_id': 'req-f8256626-1034-4825-acd8-6d03ddd37fba'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:08.371878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f8256626-1034-4825-acd8-6d03ddd37fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7981dafc049a49e5ac390648a72208df', 'request_id': 'req-f8256626-1034-4825-acd8-6d03ddd37fba'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:08.377846 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f8256626-1034-4825-acd8-6d03ddd37fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7981dafc049a49e5ac390648a72208df', 'request_id': 'req-f8256626-1034-4825-acd8-6d03ddd37fba'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:08.387621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:08.391924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f8256626-1034-4825-acd8-6d03ddd37fba admin admin] The token cache is being invalidate because project 7981dafc049a49e5ac390648a72208df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:08.392425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f8256626-1034-4825-acd8-6d03ddd37fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:08.393297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f8256626-1034-4825-acd8-6d03ddd37fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:08.396167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1344/2716] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:08 2022] DELETE /identity/v3/projects/7981dafc049a49e5ac390648a72208df => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:08.401479 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179eaa6-b00d-4671-94c0-168b9108d131 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:08.401963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179eaa6-b00d-4671-94c0-168b9108d131 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:08.402069 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179eaa6-b00d-4671-94c0-168b9108d131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:08.421876 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8179eaa6-b00d-4671-94c0-168b9108d131 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:08.423167 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8179eaa6-b00d-4671-94c0-168b9108d131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:08.481677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1373/2717] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:08.489493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbce7a4-3c96-4389-bfc1-75755234e4e1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:08.489748 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbce7a4-3c96-4389-bfc1-75755234e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:08.490020 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbce7a4-3c96-4389-bfc1-75755234e4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:08.510183 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2dbce7a4-3c96-4389-bfc1-75755234e4e1 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:08.511380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2dbce7a4-3c96-4389-bfc1-75755234e4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:08.519146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1345/2718] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:08.523387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179eaa6-b00d-4671-94c0-168b9108d131 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:08.534027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179eaa6-b00d-4671-94c0-168b9108d131 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:08.538636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184409b6-31f0-40e7-9cd2-2632462a9b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:08.539301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184409b6-31f0-40e7-9cd2-2632462a9b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:08.539576 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184409b6-31f0-40e7-9cd2-2632462a9b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:08.539843 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184409b6-31f0-40e7-9cd2-2632462a9b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:08.540517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184409b6-31f0-40e7-9cd2-2632462a9b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:17:08.540820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184409b6-31f0-40e7-9cd2-2632462a9b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:08.542397 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184409b6-31f0-40e7-9cd2-2632462a9b9b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:08.553869 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1374/2719] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:17:08.558383 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbce7a4-3c96-4389-bfc1-75755234e4e1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:08.568012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbce7a4-3c96-4389-bfc1-75755234e4e1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:08.573176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593596d-c592-4b06-8ac1-ec886dbc766d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:08.573761 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593596d-c592-4b06-8ac1-ec886dbc766d admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:08.574038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593596d-c592-4b06-8ac1-ec886dbc766d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:08.574355 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593596d-c592-4b06-8ac1-ec886dbc766d admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:08.574997 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593596d-c592-4b06-8ac1-ec886dbc766d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:08.576924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593596d-c592-4b06-8ac1-ec886dbc766d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:08.606054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1346/2720] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:17:08 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:17:08.610293 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184409b6-31f0-40e7-9cd2-2632462a9b9b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:08.620376 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184409b6-31f0-40e7-9cd2-2632462a9b9b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:08.676800 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1155a76-800e-4c64-aa2a-ad1da6a627f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:08.677417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1155a76-800e-4c64-aa2a-ad1da6a627f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:08.677675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1155a76-800e-4c64-aa2a-ad1da6a627f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:08.677946 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1155a76-800e-4c64-aa2a-ad1da6a627f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:08.678571 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1155a76-800e-4c64-aa2a-ad1da6a627f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:08.680498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1155a76-800e-4c64-aa2a-ad1da6a627f0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:08.704639 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1375/2721] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:17:08 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:17:08.706249 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593596d-c592-4b06-8ac1-ec886dbc766d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:08.716762 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593596d-c592-4b06-8ac1-ec886dbc766d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:08.721331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752263-7dab-4e2d-a0af-b38e810caa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:08.721921 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752263-7dab-4e2d-a0af-b38e810caa5e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:08.722193 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752263-7dab-4e2d-a0af-b38e810caa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:08.722460 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752263-7dab-4e2d-a0af-b38e810caa5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:08.723097 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6752263-7dab-4e2d-a0af-b38e810caa5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:08.724718 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6752263-7dab-4e2d-a0af-b38e810caa5e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:08.735311 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1347/2722] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:08.739267 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1155a76-800e-4c64-aa2a-ad1da6a627f0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:08.749764 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1155a76-800e-4c64-aa2a-ad1da6a627f0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:08.754701 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d6e53-e313-46e0-bd80-291a27f74c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:08.755295 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d6e53-e313-46e0-bd80-291a27f74c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:08.755573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d6e53-e313-46e0-bd80-291a27f74c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:08.755843 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d6e53-e313-46e0-bd80-291a27f74c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:08.756514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d6e53-e313-46e0-bd80-291a27f74c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:08.758193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d6e53-e313-46e0-bd80-291a27f74c09 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:08.769281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1376/2723] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:17:08.773442 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752263-7dab-4e2d-a0af-b38e810caa5e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:08.784043 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752263-7dab-4e2d-a0af-b38e810caa5e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:08.788596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0108-9689-43cb-85f5-76e4bf1a55a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:08.789239 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0108-9689-43cb-85f5-76e4bf1a55a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:08.789514 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0108-9689-43cb-85f5-76e4bf1a55a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:08.789805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0108-9689-43cb-85f5-76e4bf1a55a4 admin admin] PATH_INFO: `/v3/projects/521bd0dbf10f48468a1b66dfa723e09d/users/a138d0452ffa46f69c33483b29570b7c/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:08.804660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a0108-9689-43cb-85f5-76e4bf1a55a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=521bd0dbf10f48468a1b66dfa723e09d, user_id=a138d0452ffa46f69c33483b29570b7c, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:08.808083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a0108-9689-43cb-85f5-76e4bf1a55a4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:08.821094 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1348/2724] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:17:08 2022] PUT /identity/v3/projects/521bd0dbf10f48468a1b66dfa723e09d/users/a138d0452ffa46f69c33483b29570b7c/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:08.831916 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa2374-2a86-4d15-89f4-5b3cd02360cb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:08.832244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa2374-2a86-4d15-89f4-5b3cd02360cb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:08.832516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa2374-2a86-4d15-89f4-5b3cd02360cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:08.861030 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f7fa2374-2a86-4d15-89f4-5b3cd02360cb None None] MFA Rules not processed for user `a138d0452ffa46f69c33483b29570b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:08.862243 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f7fa2374-2a86-4d15-89f4-5b3cd02360cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:08.896224 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:08.932942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1377/2725] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:17:08.937373 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0108-9689-43cb-85f5-76e4bf1a55a4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:09.023135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0108-9689-43cb-85f5-76e4bf1a55a4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:09.027835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0341e6e-6f0a-48ff-8c66-db4e70f423bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:09.028569 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0341e6e-6f0a-48ff-8c66-db4e70f423bf admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:09.028738 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0341e6e-6f0a-48ff-8c66-db4e70f423bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:09.028993 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0341e6e-6f0a-48ff-8c66-db4e70f423bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:09.029646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0341e6e-6f0a-48ff-8c66-db4e70f423bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:09.031534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0341e6e-6f0a-48ff-8c66-db4e70f423bf admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:09.060777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1349/2726] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:17:08 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:17:09.064805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa2374-2a86-4d15-89f4-5b3cd02360cb None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:09.077901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa2374-2a86-4d15-89f4-5b3cd02360cb None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:09.133996 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4804e4-29c7-4ea8-9a37-aa6d50f2fc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:09.134636 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4804e4-29c7-4ea8-9a37-aa6d50f2fc9a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:09.134910 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4804e4-29c7-4ea8-9a37-aa6d50f2fc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:09.135178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4804e4-29c7-4ea8-9a37-aa6d50f2fc9a admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:09.135791 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4804e4-29c7-4ea8-9a37-aa6d50f2fc9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:09.137715 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4804e4-29c7-4ea8-9a37-aa6d50f2fc9a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:09.158542 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1378/2727] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:17:09 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:17:09.162580 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0341e6e-6f0a-48ff-8c66-db4e70f423bf admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:09.173272 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0341e6e-6f0a-48ff-8c66-db4e70f423bf admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:09.177838 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee0bd6-4df7-4d2e-96c7-bf74e7fe4cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:09.178430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee0bd6-4df7-4d2e-96c7-bf74e7fe4cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:09.178703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee0bd6-4df7-4d2e-96c7-bf74e7fe4cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:09.178972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee0bd6-4df7-4d2e-96c7-bf74e7fe4cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:09.179609 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee0bd6-4df7-4d2e-96c7-bf74e7fe4cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:09.181266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee0bd6-4df7-4d2e-96c7-bf74e7fe4cf7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:09.192239 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1350/2728] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:09.196500 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4804e4-29c7-4ea8-9a37-aa6d50f2fc9a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:09.206563 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4804e4-29c7-4ea8-9a37-aa6d50f2fc9a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:09.211349 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d1da6-2adb-467d-9a6a-4b4f939aea36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:09.212023 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d1da6-2adb-467d-9a6a-4b4f939aea36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:09.212302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d1da6-2adb-467d-9a6a-4b4f939aea36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:09.212576 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d1da6-2adb-467d-9a6a-4b4f939aea36 admin admin] PATH_INFO: `/v3/projects/6cc44cf0ca4848b9b1ffe2275bf3aa69/users/534c076b35954250bec265732593bba8/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:09.227605 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d1da6-2adb-467d-9a6a-4b4f939aea36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc44cf0ca4848b9b1ffe2275bf3aa69, user_id=534c076b35954250bec265732593bba8, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:09.230836 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d1da6-2adb-467d-9a6a-4b4f939aea36 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:09.243324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1379/2729] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:17:09 2022] PUT /identity/v3/projects/6cc44cf0ca4848b9b1ffe2275bf3aa69/users/534c076b35954250bec265732593bba8/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:17:09.247885 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee0bd6-4df7-4d2e-96c7-bf74e7fe4cf7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:09.257995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee0bd6-4df7-4d2e-96c7-bf74e7fe4cf7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:09.319530 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376db25-f137-4999-8cac-dc88cfbfadca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:09.320317 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376db25-f137-4999-8cac-dc88cfbfadca admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:09.320594 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376db25-f137-4999-8cac-dc88cfbfadca admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:09.320861 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376db25-f137-4999-8cac-dc88cfbfadca admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:09.321505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376db25-f137-4999-8cac-dc88cfbfadca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:09.325400 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376db25-f137-4999-8cac-dc88cfbfadca admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:09.337271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1351/2730] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:09.341868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d1da6-2adb-467d-9a6a-4b4f939aea36 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:09.352772 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d1da6-2adb-467d-9a6a-4b4f939aea36 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:09.359911 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839213e-e97e-466f-b8ba-9c573f99647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:09.360610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839213e-e97e-466f-b8ba-9c573f99647b admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:09.360893 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839213e-e97e-466f-b8ba-9c573f99647b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:09.361166 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839213e-e97e-466f-b8ba-9c573f99647b admin admin] PATH_INFO: `/v3/projects/6cc44cf0ca4848b9b1ffe2275bf3aa69/users/534c076b35954250bec265732593bba8/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:09.363118 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839213e-e97e-466f-b8ba-9c573f99647b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc44cf0ca4848b9b1ffe2275bf3aa69, user_id=534c076b35954250bec265732593bba8, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:09.365792 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839213e-e97e-466f-b8ba-9c573f99647b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:09.376040 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1380/2731] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:17:09 2022] PUT /identity/v3/projects/6cc44cf0ca4848b9b1ffe2275bf3aa69/users/534c076b35954250bec265732593bba8/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:09.388206 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44023723-5e65-4d20-8d08-f06611618ec7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:09.388513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44023723-5e65-4d20-8d08-f06611618ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:09.388780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44023723-5e65-4d20-8d08-f06611618ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:09.403190 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:09.417455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-44023723-5e65-4d20-8d08-f06611618ec7 None None] MFA Rules not processed for user `534c076b35954250bec265732593bba8`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:09.418665 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-44023723-5e65-4d20-8d08-f06611618ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:09.484860 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1352/2732] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:09.497559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839213e-e97e-466f-b8ba-9c573f99647b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:09.499301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2839213e-e97e-466f-b8ba-9c573f99647b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:09.558337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839213e-e97e-466f-b8ba-9c573f99647b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:09.561956 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ce596-3c05-46fc-b8bd-9045cf0f06d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:09.562555 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ce596-3c05-46fc-b8bd-9045cf0f06d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:09.562828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ce596-3c05-46fc-b8bd-9045cf0f06d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:09.563094 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ce596-3c05-46fc-b8bd-9045cf0f06d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:09.572925 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ce596-3c05-46fc-b8bd-9045cf0f06d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:09.574332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ce596-3c05-46fc-b8bd-9045cf0f06d1 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:09.583695 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1381/2733] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:09.904952 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44023723-5e65-4d20-8d08-f06611618ec7 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:09.914333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44023723-5e65-4d20-8d08-f06611618ec7 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:09.919471 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb66daa-d576-4b6b-a54e-e10a11000bf8 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534c076b35954250bec265732593bba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cc44cf0ca4848b9b1ffe2275bf3aa69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:09.920247 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb66daa-d576-4b6b-a54e-e10a11000bf8 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:09.920534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb66daa-d576-4b6b-a54e-e10a11000bf8 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:09.920837 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb66daa-d576-4b6b-a54e-e10a11000bf8 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:09.921490 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb66daa-d576-4b6b-a54e-e10a11000bf8 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:17:09.921797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb66daa-d576-4b6b-a54e-e10a11000bf8 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:09.923506 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb66daa-d576-4b6b-a54e-e10a11000bf8 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:09.936660 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1353/2734] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:17:09.940837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ce596-3c05-46fc-b8bd-9045cf0f06d1 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:09.949856 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ce596-3c05-46fc-b8bd-9045cf0f06d1 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:09.954629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca512359-25cd-41fe-8dcc-57aa9ee85aee tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534c076b35954250bec265732593bba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cc44cf0ca4848b9b1ffe2275bf3aa69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:09.955273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca512359-25cd-41fe-8dcc-57aa9ee85aee tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:09.955548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca512359-25cd-41fe-8dcc-57aa9ee85aee tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:09.955846 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca512359-25cd-41fe-8dcc-57aa9ee85aee tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:09.956507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca512359-25cd-41fe-8dcc-57aa9ee85aee tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:09.958372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca512359-25cd-41fe-8dcc-57aa9ee85aee tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:09.992716 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1382/2735] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:17:09 2022] POST /identity/v3/projects => generated 353 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:17:09.999664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb66daa-d576-4b6b-a54e-e10a11000bf8 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:10.016789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb66daa-d576-4b6b-a54e-e10a11000bf8 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:10.082599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d296a0-63eb-4146-bfee-694db9843a48 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534c076b35954250bec265732593bba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cc44cf0ca4848b9b1ffe2275bf3aa69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:10.083204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d296a0-63eb-4146-bfee-694db9843a48 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:10.083480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d296a0-63eb-4146-bfee-694db9843a48 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:10.083748 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d296a0-63eb-4146-bfee-694db9843a48 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:10.084424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d296a0-63eb-4146-bfee-694db9843a48 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:17:10.084723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d296a0-63eb-4146-bfee-694db9843a48 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:10.086338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d296a0-63eb-4146-bfee-694db9843a48 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:10.098380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1354/2736] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:17:10.135512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca512359-25cd-41fe-8dcc-57aa9ee85aee tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:10.145510 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca512359-25cd-41fe-8dcc-57aa9ee85aee tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:10.150481 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c97cf-61b3-48ff-bbb5-6cd13244abe1 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534c076b35954250bec265732593bba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cc44cf0ca4848b9b1ffe2275bf3aa69', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:10.151104 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c97cf-61b3-48ff-bbb5-6cd13244abe1 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:10.151386 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c97cf-61b3-48ff-bbb5-6cd13244abe1 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:10.151654 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c97cf-61b3-48ff-bbb5-6cd13244abe1 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] PATH_INFO: `/v3/projects/ad195209b3bb490ea0fbb4ae0f34449a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:10.152808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c97cf-61b3-48ff-bbb5-6cd13244abe1 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ad195209b3bb490ea0fbb4ae0f34449a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:10.154689 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c97cf-61b3-48ff-bbb5-6cd13244abe1 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:10.157213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:10.326633 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-930c97cf-61b3-48ff-bbb5-6cd13244abe1 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad195209b3bb490ea0fbb4ae0f34449a', 'request_id': 'req-930c97cf-61b3-48ff-bbb5-6cd13244abe1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:10.332250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-930c97cf-61b3-48ff-bbb5-6cd13244abe1 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad195209b3bb490ea0fbb4ae0f34449a', 'request_id': 'req-930c97cf-61b3-48ff-bbb5-6cd13244abe1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:10.339677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-930c97cf-61b3-48ff-bbb5-6cd13244abe1 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad195209b3bb490ea0fbb4ae0f34449a', 'request_id': 'req-930c97cf-61b3-48ff-bbb5-6cd13244abe1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:10.350562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-930c97cf-61b3-48ff-bbb5-6cd13244abe1 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] The token cache is being invalidate because project ad195209b3bb490ea0fbb4ae0f34449a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:10.350875 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-930c97cf-61b3-48ff-bbb5-6cd13244abe1 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:10.351528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-930c97cf-61b3-48ff-bbb5-6cd13244abe1 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:10.353066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1383/2737] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:10 2022] DELETE /identity/v3/projects/ad195209b3bb490ea0fbb4ae0f34449a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:10.553153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d296a0-63eb-4146-bfee-694db9843a48 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:10.554886 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-52d296a0-63eb-4146-bfee-694db9843a48 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:10.618636 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d296a0-63eb-4146-bfee-694db9843a48 tempest-VolumeQuotaClassesTest-1964036903 tempest-VolumeQuotaClassesTest-1964036903-project-admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:10.635749 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:10.675294 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70c08a-5c47-45e5-b067-44d66e4b5796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:10.675912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70c08a-5c47-45e5-b067-44d66e4b5796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:10.676218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70c08a-5c47-45e5-b067-44d66e4b5796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:10.676485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70c08a-5c47-45e5-b067-44d66e4b5796 admin admin] PATH_INFO: `/v3/users/a138d0452ffa46f69c33483b29570b7c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:10.677595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70c08a-5c47-45e5-b067-44d66e4b5796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a138d0452ffa46f69c33483b29570b7c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:10.679491 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70c08a-5c47-45e5-b067-44d66e4b5796 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:10.723672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1f70c08a-5c47-45e5-b067-44d66e4b5796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a138d0452ffa46f69c33483b29570b7c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:10.735384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1f70c08a-5c47-45e5-b067-44d66e4b5796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a138d0452ffa46f69c33483b29570b7c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:10.741995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1f70c08a-5c47-45e5-b067-44d66e4b5796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a138d0452ffa46f69c33483b29570b7c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:10.742753 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1f70c08a-5c47-45e5-b067-44d66e4b5796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a138d0452ffa46f69c33483b29570b7c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:10.743275 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1f70c08a-5c47-45e5-b067-44d66e4b5796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a138d0452ffa46f69c33483b29570b7c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:10.756439 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1355/2738] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:17:10 2022] DELETE /identity/v3/users/a138d0452ffa46f69c33483b29570b7c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:10.761283 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15ab6c-c9f3-44eb-ab1e-b6cdb2267ac5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:10.761766 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15ab6c-c9f3-44eb-ab1e-b6cdb2267ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:10.761861 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15ab6c-c9f3-44eb-ab1e-b6cdb2267ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:10.780770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1d15ab6c-c9f3-44eb-ab1e-b6cdb2267ac5 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:10.782027 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1d15ab6c-c9f3-44eb-ab1e-b6cdb2267ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:10.838822 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1384/2739] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:10.848541 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70c08a-5c47-45e5-b067-44d66e4b5796 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:10.849967 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1f70c08a-5c47-45e5-b067-44d66e4b5796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:10.907681 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70c08a-5c47-45e5-b067-44d66e4b5796 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:10.911331 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f21fe-6d6f-4c67-b41f-7e17b7cc9140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:10.911928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f21fe-6d6f-4c67-b41f-7e17b7cc9140 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:10.912236 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f21fe-6d6f-4c67-b41f-7e17b7cc9140 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:10.912503 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f21fe-6d6f-4c67-b41f-7e17b7cc9140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:10.921328 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f21fe-6d6f-4c67-b41f-7e17b7cc9140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:10.922751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f21fe-6d6f-4c67-b41f-7e17b7cc9140 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:10.932573 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1356/2740] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:11.211677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15ab6c-c9f3-44eb-ab1e-b6cdb2267ac5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:11.213134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1d15ab6c-c9f3-44eb-ab1e-b6cdb2267ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:11.225375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15ab6c-c9f3-44eb-ab1e-b6cdb2267ac5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:11.230108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb369b-0893-4770-9547-8d0b610c6a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:11.230963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb369b-0893-4770-9547-8d0b610c6a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:11.231239 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb369b-0893-4770-9547-8d0b610c6a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:11.231508 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb369b-0893-4770-9547-8d0b610c6a12 admin admin] PATH_INFO: `/v3/projects/521bd0dbf10f48468a1b66dfa723e09d` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:11.232664 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb369b-0893-4770-9547-8d0b610c6a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=521bd0dbf10f48468a1b66dfa723e09d)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:11.234544 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb369b-0893-4770-9547-8d0b610c6a12 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:11.286506 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-56eb369b-0893-4770-9547-8d0b610c6a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521bd0dbf10f48468a1b66dfa723e09d', 'request_id': 'req-56eb369b-0893-4770-9547-8d0b610c6a12'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:11.292734 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-56eb369b-0893-4770-9547-8d0b610c6a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521bd0dbf10f48468a1b66dfa723e09d', 'request_id': 'req-56eb369b-0893-4770-9547-8d0b610c6a12'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:11.301012 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-56eb369b-0893-4770-9547-8d0b610c6a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521bd0dbf10f48468a1b66dfa723e09d', 'request_id': 'req-56eb369b-0893-4770-9547-8d0b610c6a12'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:11.313250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-56eb369b-0893-4770-9547-8d0b610c6a12 admin admin] The token cache is being invalidate because project 521bd0dbf10f48468a1b66dfa723e09d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:11.313530 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-56eb369b-0893-4770-9547-8d0b610c6a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:11.314180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-56eb369b-0893-4770-9547-8d0b610c6a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:11.315657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1385/2741] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:11 2022] DELETE /identity/v3/projects/521bd0dbf10f48468a1b66dfa723e09d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:17:11.319582 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f21fe-6d6f-4c67-b41f-7e17b7cc9140 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:11.329637 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f21fe-6d6f-4c67-b41f-7e17b7cc9140 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:11.368697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:11.387749 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16890306-22f6-471a-aa60-e1c520a94afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:11.388404 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16890306-22f6-471a-aa60-e1c520a94afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:11.388682 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16890306-22f6-471a-aa60-e1c520a94afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:11.388954 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16890306-22f6-471a-aa60-e1c520a94afa admin admin] PATH_INFO: `/v3/users/534c076b35954250bec265732593bba8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:11.390096 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16890306-22f6-471a-aa60-e1c520a94afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=534c076b35954250bec265732593bba8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:11.392085 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16890306-22f6-471a-aa60-e1c520a94afa admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:11.438488 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-16890306-22f6-471a-aa60-e1c520a94afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '534c076b35954250bec265732593bba8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:11.450352 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-16890306-22f6-471a-aa60-e1c520a94afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '534c076b35954250bec265732593bba8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:11.457141 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-16890306-22f6-471a-aa60-e1c520a94afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '534c076b35954250bec265732593bba8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:11.457808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-16890306-22f6-471a-aa60-e1c520a94afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '534c076b35954250bec265732593bba8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:11.458416 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-16890306-22f6-471a-aa60-e1c520a94afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '534c076b35954250bec265732593bba8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:11.470773 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1357/2742] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:17:11 2022] DELETE /identity/v3/users/534c076b35954250bec265732593bba8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:11.747156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb369b-0893-4770-9547-8d0b610c6a12 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:11.748657 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-56eb369b-0893-4770-9547-8d0b610c6a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:11.762796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb369b-0893-4770-9547-8d0b610c6a12 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:11.774774 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:11.821200 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbea89-c767-45fb-a85e-583d5fddc1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:11.821750 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbea89-c767-45fb-a85e-583d5fddc1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:11.822655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbea89-c767-45fb-a85e-583d5fddc1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:11.822921 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbea89-c767-45fb-a85e-583d5fddc1a0 admin admin] PATH_INFO: `/v3/projects/6cc44cf0ca4848b9b1ffe2275bf3aa69` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:11.824043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbea89-c767-45fb-a85e-583d5fddc1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cc44cf0ca4848b9b1ffe2275bf3aa69)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:11.825951 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbea89-c767-45fb-a85e-583d5fddc1a0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:11.871147 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-fecbea89-c767-45fb-a85e-583d5fddc1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc44cf0ca4848b9b1ffe2275bf3aa69', 'request_id': 'req-fecbea89-c767-45fb-a85e-583d5fddc1a0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:11.876475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-fecbea89-c767-45fb-a85e-583d5fddc1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc44cf0ca4848b9b1ffe2275bf3aa69', 'request_id': 'req-fecbea89-c767-45fb-a85e-583d5fddc1a0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:11.884055 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-fecbea89-c767-45fb-a85e-583d5fddc1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc44cf0ca4848b9b1ffe2275bf3aa69', 'request_id': 'req-fecbea89-c767-45fb-a85e-583d5fddc1a0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:11.895353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-fecbea89-c767-45fb-a85e-583d5fddc1a0 admin admin] The token cache is being invalidate because project 6cc44cf0ca4848b9b1ffe2275bf3aa69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:11.895639 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-fecbea89-c767-45fb-a85e-583d5fddc1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:11.896271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-fecbea89-c767-45fb-a85e-583d5fddc1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:11.897787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1386/2743] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:11 2022] DELETE /identity/v3/projects/6cc44cf0ca4848b9b1ffe2275bf3aa69 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:11.903337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c82a0-37b1-40b4-913e-7df763f07f39 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:11.903810 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c82a0-37b1-40b4-913e-7df763f07f39 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:11.903925 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c82a0-37b1-40b4-913e-7df763f07f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:11.923597 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8d5c82a0-37b1-40b4-913e-7df763f07f39 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:11.924826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8d5c82a0-37b1-40b4-913e-7df763f07f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:11.983044 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1358/2744] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:11.990806 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695a59b-9275-4960-a26e-207b56bed77d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:11.991117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695a59b-9275-4960-a26e-207b56bed77d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:11.991389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695a59b-9275-4960-a26e-207b56bed77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:12.010592 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8695a59b-9275-4960-a26e-207b56bed77d None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:12.011768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8695a59b-9275-4960-a26e-207b56bed77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:12.019409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1387/2745] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:12.023503 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c82a0-37b1-40b4-913e-7df763f07f39 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:12.033582 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c82a0-37b1-40b4-913e-7df763f07f39 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:12.038211 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c4b50-c257-4237-9cff-d248f88b838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:12.038808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c4b50-c257-4237-9cff-d248f88b838c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:12.039084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c4b50-c257-4237-9cff-d248f88b838c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:12.039352 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c4b50-c257-4237-9cff-d248f88b838c admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:12.040034 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c4b50-c257-4237-9cff-d248f88b838c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:17:12.040335 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c4b50-c257-4237-9cff-d248f88b838c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:12.042497 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c4b50-c257-4237-9cff-d248f88b838c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:12.054037 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1359/2746] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:17:12.059062 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695a59b-9275-4960-a26e-207b56bed77d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:12.068211 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695a59b-9275-4960-a26e-207b56bed77d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:12.073299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97d77c-d5ba-4359-957a-19aa7f1fbcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:12.073824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97d77c-d5ba-4359-957a-19aa7f1fbcb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:12.074095 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97d77c-d5ba-4359-957a-19aa7f1fbcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:12.074361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97d77c-d5ba-4359-957a-19aa7f1fbcb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:12.074980 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97d77c-d5ba-4359-957a-19aa7f1fbcb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:12.076882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97d77c-d5ba-4359-957a-19aa7f1fbcb3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:12.103731 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1388/2747] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:17:12 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:17:12.107989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c4b50-c257-4237-9cff-d248f88b838c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:12.117847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c4b50-c257-4237-9cff-d248f88b838c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:12.162155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:12.175711 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b2d05-7fa3-4cbd-9407-f72663f63b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:12.176354 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b2d05-7fa3-4cbd-9407-f72663f63b7e admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:12.176634 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b2d05-7fa3-4cbd-9407-f72663f63b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:12.176905 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b2d05-7fa3-4cbd-9407-f72663f63b7e admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:12.177546 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b2d05-7fa3-4cbd-9407-f72663f63b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:12.180238 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b2d05-7fa3-4cbd-9407-f72663f63b7e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:12.201022 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1360/2748] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:17:12 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:17:12.205064 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97d77c-d5ba-4359-957a-19aa7f1fbcb3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:12.216166 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97d77c-d5ba-4359-957a-19aa7f1fbcb3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:12.220753 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbb805-4447-4b31-a4f8-5c702f5290b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:12.221344 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbb805-4447-4b31-a4f8-5c702f5290b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:12.221621 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbb805-4447-4b31-a4f8-5c702f5290b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:12.221891 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbb805-4447-4b31-a4f8-5c702f5290b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:12.222523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbb805-4447-4b31-a4f8-5c702f5290b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:12.224133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbb805-4447-4b31-a4f8-5c702f5290b0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:12.233750 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1389/2749] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:12.237800 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b2d05-7fa3-4cbd-9407-f72663f63b7e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:12.247639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b2d05-7fa3-4cbd-9407-f72663f63b7e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:12.252425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca18044-f2e1-49da-8747-2248dadd082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:12.253009 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca18044-f2e1-49da-8747-2248dadd082a admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:12.253282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca18044-f2e1-49da-8747-2248dadd082a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:12.253549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca18044-f2e1-49da-8747-2248dadd082a admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:12.254186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca18044-f2e1-49da-8747-2248dadd082a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:12.255751 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca18044-f2e1-49da-8747-2248dadd082a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:12.266662 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1361/2750] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:12.270683 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbb805-4447-4b31-a4f8-5c702f5290b0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:12.281051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbb805-4447-4b31-a4f8-5c702f5290b0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:12.285549 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc680c5-6273-4730-8ebf-9424872a90f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:12.286183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc680c5-6273-4730-8ebf-9424872a90f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:12.286454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc680c5-6273-4730-8ebf-9424872a90f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:12.286719 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc680c5-6273-4730-8ebf-9424872a90f4 admin admin] PATH_INFO: `/v3/projects/ff776f430c8a43a79ad9055e3f3882d1/users/fc8306ef9fe94750ac5cf2a4bdf2e746/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:12.301505 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc680c5-6273-4730-8ebf-9424872a90f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff776f430c8a43a79ad9055e3f3882d1, user_id=fc8306ef9fe94750ac5cf2a4bdf2e746, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:12.304311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc680c5-6273-4730-8ebf-9424872a90f4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:12.318366 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1390/2751] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:17:12 2022] PUT /identity/v3/projects/ff776f430c8a43a79ad9055e3f3882d1/users/fc8306ef9fe94750ac5cf2a4bdf2e746/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:12.330450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5114b50-0738-47f6-b1d5-5914fb4d0592 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:12.330692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5114b50-0738-47f6-b1d5-5914fb4d0592 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:12.330961 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5114b50-0738-47f6-b1d5-5914fb4d0592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:12.358810 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b5114b50-0738-47f6-b1d5-5914fb4d0592 None None] MFA Rules not processed for user `fc8306ef9fe94750ac5cf2a4bdf2e746`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:12.360091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b5114b50-0738-47f6-b1d5-5914fb4d0592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:12.425493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1362/2752] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:12.429957 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc680c5-6273-4730-8ebf-9424872a90f4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:12.475787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:12.495679 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc680c5-6273-4730-8ebf-9424872a90f4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:12.500281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14949a7-a81e-45f8-bb0f-32808ed1e4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:12.500878 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14949a7-a81e-45f8-bb0f-32808ed1e4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:12.501154 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14949a7-a81e-45f8-bb0f-32808ed1e4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:12.501425 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14949a7-a81e-45f8-bb0f-32808ed1e4e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:12.502331 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14949a7-a81e-45f8-bb0f-32808ed1e4e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:12.504241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14949a7-a81e-45f8-bb0f-32808ed1e4e2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:12.532287 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1391/2753] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:17:12 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:17:12.536493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5114b50-0738-47f6-b1d5-5914fb4d0592 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:12.547071 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5114b50-0738-47f6-b1d5-5914fb4d0592 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:12.603293 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9de1b-1b2a-48b5-b767-751087d124a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:12.603898 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9de1b-1b2a-48b5-b767-751087d124a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:12.604204 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9de1b-1b2a-48b5-b767-751087d124a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:12.604474 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9de1b-1b2a-48b5-b767-751087d124a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:12.605090 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9de1b-1b2a-48b5-b767-751087d124a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:12.606978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9de1b-1b2a-48b5-b767-751087d124a0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:12.628202 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1363/2754] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:17:12 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:17:12.632569 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14949a7-a81e-45f8-bb0f-32808ed1e4e2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:12.643615 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14949a7-a81e-45f8-bb0f-32808ed1e4e2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:12.650201 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d89d0-79cf-4f7d-922d-682532d139f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:12.651212 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d89d0-79cf-4f7d-922d-682532d139f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:12.651700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d89d0-79cf-4f7d-922d-682532d139f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:12.652244 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d89d0-79cf-4f7d-922d-682532d139f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:12.653018 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d89d0-79cf-4f7d-922d-682532d139f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:12.654577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d89d0-79cf-4f7d-922d-682532d139f6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:12.665698 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1392/2755] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:12.670199 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9de1b-1b2a-48b5-b767-751087d124a0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:12.680599 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9de1b-1b2a-48b5-b767-751087d124a0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:12.686096 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da25d91-5c79-4155-907c-80e3293a36eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:12.686770 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da25d91-5c79-4155-907c-80e3293a36eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:12.687049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da25d91-5c79-4155-907c-80e3293a36eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:12.687318 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da25d91-5c79-4155-907c-80e3293a36eb admin admin] PATH_INFO: `/v3/projects/7667b8d38e5347dfbaa23de226decc7e/users/3963cdfab31846c3a7d42df5fd367e5a/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:12.703309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da25d91-5c79-4155-907c-80e3293a36eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7667b8d38e5347dfbaa23de226decc7e, user_id=3963cdfab31846c3a7d42df5fd367e5a, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:12.706004 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da25d91-5c79-4155-907c-80e3293a36eb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:12.719649 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1364/2756] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:17:12 2022] PUT /identity/v3/projects/7667b8d38e5347dfbaa23de226decc7e/users/3963cdfab31846c3a7d42df5fd367e5a/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:12.723732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d89d0-79cf-4f7d-922d-682532d139f6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:12.734442 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d89d0-79cf-4f7d-922d-682532d139f6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:12.789029 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b306c-4e15-4032-b2d9-0160177c5a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:12.789671 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b306c-4e15-4032-b2d9-0160177c5a9b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:12.789906 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b306c-4e15-4032-b2d9-0160177c5a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:12.790174 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b306c-4e15-4032-b2d9-0160177c5a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:12.791469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b306c-4e15-4032-b2d9-0160177c5a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:12.793130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b306c-4e15-4032-b2d9-0160177c5a9b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:12.802983 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1393/2757] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:12.807455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da25d91-5c79-4155-907c-80e3293a36eb admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:12.817538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da25d91-5c79-4155-907c-80e3293a36eb admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:12.822536 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eae2bd-c251-429e-9592-4440d9600b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:12.823176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eae2bd-c251-429e-9592-4440d9600b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:12.823449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eae2bd-c251-429e-9592-4440d9600b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:12.823716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eae2bd-c251-429e-9592-4440d9600b40 admin admin] PATH_INFO: `/v3/projects/7667b8d38e5347dfbaa23de226decc7e/users/3963cdfab31846c3a7d42df5fd367e5a/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:12.825631 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eae2bd-c251-429e-9592-4440d9600b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7667b8d38e5347dfbaa23de226decc7e, user_id=3963cdfab31846c3a7d42df5fd367e5a, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:12.828256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eae2bd-c251-429e-9592-4440d9600b40 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:12.838839 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1365/2758] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:17:12 2022] PUT /identity/v3/projects/7667b8d38e5347dfbaa23de226decc7e/users/3963cdfab31846c3a7d42df5fd367e5a/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:17:12.849853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53c31f-9f61-407e-9d4c-3cf699095c97 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:12.850128 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53c31f-9f61-407e-9d4c-3cf699095c97 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:12.850395 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53c31f-9f61-407e-9d4c-3cf699095c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:12.877724 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5b53c31f-9f61-407e-9d4c-3cf699095c97 None None] MFA Rules not processed for user `3963cdfab31846c3a7d42df5fd367e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:12.878850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5b53c31f-9f61-407e-9d4c-3cf699095c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:12.944933 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1394/2759] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:12.957371 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eae2bd-c251-429e-9592-4440d9600b40 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:12.959105 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a2eae2bd-c251-429e-9592-4440d9600b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:12.971155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:13.031040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eae2bd-c251-429e-9592-4440d9600b40 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:13.034887 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c80fc-0150-43f5-839d-ec9f3ee10ddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:13.035496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c80fc-0150-43f5-839d-ec9f3ee10ddb service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:13.035777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c80fc-0150-43f5-839d-ec9f3ee10ddb service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:13.036083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c80fc-0150-43f5-839d-ec9f3ee10ddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:13.046597 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c80fc-0150-43f5-839d-ec9f3ee10ddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:13.048059 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c80fc-0150-43f5-839d-ec9f3ee10ddb service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:13.058207 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1366/2760] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:13.140670 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53c31f-9f61-407e-9d4c-3cf699095c97 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:13.151274 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53c31f-9f61-407e-9d4c-3cf699095c97 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:13.154805 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccb6d2-2a65-422e-bda3-6f1fd4a527d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:13.155396 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccb6d2-2a65-422e-bda3-6f1fd4a527d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:13.155693 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccb6d2-2a65-422e-bda3-6f1fd4a527d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:13.155988 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccb6d2-2a65-422e-bda3-6f1fd4a527d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:13.189470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:13.213971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccb6d2-2a65-422e-bda3-6f1fd4a527d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:13.215381 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccb6d2-2a65-422e-bda3-6f1fd4a527d3 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:13.224048 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1395/2761] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:18.098465 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c80fc-0150-43f5-839d-ec9f3ee10ddb service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:18.167384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c80fc-0150-43f5-839d-ec9f3ee10ddb service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:18.172047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e082bb-6c47-465f-8ecc-f85719af052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:18.172674 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e082bb-6c47-465f-8ecc-f85719af052b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:18.172950 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e082bb-6c47-465f-8ecc-f85719af052b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:18.173216 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e082bb-6c47-465f-8ecc-f85719af052b admin admin] PATH_INFO: `/v3/users/fc8306ef9fe94750ac5cf2a4bdf2e746` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:18.174333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e082bb-6c47-465f-8ecc-f85719af052b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8306ef9fe94750ac5cf2a4bdf2e746)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:18.176312 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e082bb-6c47-465f-8ecc-f85719af052b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:18.224903 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-80e082bb-6c47-465f-8ecc-f85719af052b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8306ef9fe94750ac5cf2a4bdf2e746'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:18.237024 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-80e082bb-6c47-465f-8ecc-f85719af052b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8306ef9fe94750ac5cf2a4bdf2e746'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:18.244356 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-80e082bb-6c47-465f-8ecc-f85719af052b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8306ef9fe94750ac5cf2a4bdf2e746'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:18.245628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-80e082bb-6c47-465f-8ecc-f85719af052b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8306ef9fe94750ac5cf2a4bdf2e746'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:18.246234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-80e082bb-6c47-465f-8ecc-f85719af052b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8306ef9fe94750ac5cf2a4bdf2e746'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:18.259315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1367/2762] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:17:18 2022] DELETE /identity/v3/users/fc8306ef9fe94750ac5cf2a4bdf2e746 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:18.264061 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c089f2-d63c-4f89-a0fd-90ef99c83975 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:18.264521 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c089f2-d63c-4f89-a0fd-90ef99c83975 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:18.264618 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c089f2-d63c-4f89-a0fd-90ef99c83975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:18.283305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a3c089f2-d63c-4f89-a0fd-90ef99c83975 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:18.284559 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a3c089f2-d63c-4f89-a0fd-90ef99c83975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:18.345859 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1396/2763] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:18.356194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e082bb-6c47-465f-8ecc-f85719af052b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:18.357607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-80e082bb-6c47-465f-8ecc-f85719af052b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:18.397825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:18.423305 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e082bb-6c47-465f-8ecc-f85719af052b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:18.426965 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674788ea-35f9-47e8-a5e2-857278db4723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:18.427568 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674788ea-35f9-47e8-a5e2-857278db4723 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:18.427845 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674788ea-35f9-47e8-a5e2-857278db4723 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:18.428141 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674788ea-35f9-47e8-a5e2-857278db4723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:18.436997 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674788ea-35f9-47e8-a5e2-857278db4723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:18.438410 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674788ea-35f9-47e8-a5e2-857278db4723 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:18.447973 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1368/2764] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:18.728612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c089f2-d63c-4f89-a0fd-90ef99c83975 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:18.730954 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a3c089f2-d63c-4f89-a0fd-90ef99c83975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:18.743087 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c089f2-d63c-4f89-a0fd-90ef99c83975 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:18.748604 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85595b2-fb2b-4881-aeed-d31840786642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:18.749303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85595b2-fb2b-4881-aeed-d31840786642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:18.749583 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85595b2-fb2b-4881-aeed-d31840786642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:18.749854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85595b2-fb2b-4881-aeed-d31840786642 admin admin] PATH_INFO: `/v3/projects/ff776f430c8a43a79ad9055e3f3882d1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:18.750971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85595b2-fb2b-4881-aeed-d31840786642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff776f430c8a43a79ad9055e3f3882d1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:18.753150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85595b2-fb2b-4881-aeed-d31840786642 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:18.809006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a85595b2-fb2b-4881-aeed-d31840786642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff776f430c8a43a79ad9055e3f3882d1', 'request_id': 'req-a85595b2-fb2b-4881-aeed-d31840786642'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:18.814519 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a85595b2-fb2b-4881-aeed-d31840786642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff776f430c8a43a79ad9055e3f3882d1', 'request_id': 'req-a85595b2-fb2b-4881-aeed-d31840786642'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:18.821803 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a85595b2-fb2b-4881-aeed-d31840786642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff776f430c8a43a79ad9055e3f3882d1', 'request_id': 'req-a85595b2-fb2b-4881-aeed-d31840786642'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:18.833628 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a85595b2-fb2b-4881-aeed-d31840786642 admin admin] The token cache is being invalidate because project ff776f430c8a43a79ad9055e3f3882d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:18.833923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a85595b2-fb2b-4881-aeed-d31840786642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:18.834595 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a85595b2-fb2b-4881-aeed-d31840786642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:18.836093 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1397/2765] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:18 2022] DELETE /identity/v3/projects/ff776f430c8a43a79ad9055e3f3882d1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:18.840975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674788ea-35f9-47e8-a5e2-857278db4723 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:18.850867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674788ea-35f9-47e8-a5e2-857278db4723 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:18.907928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af9309-2b69-4590-8b99-022a36b0368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:18.908597 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af9309-2b69-4590-8b99-022a36b0368a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:18.908871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af9309-2b69-4590-8b99-022a36b0368a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:18.909140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af9309-2b69-4590-8b99-022a36b0368a admin admin] PATH_INFO: `/v3/users/3963cdfab31846c3a7d42df5fd367e5a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:18.910245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af9309-2b69-4590-8b99-022a36b0368a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3963cdfab31846c3a7d42df5fd367e5a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:18.912188 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af9309-2b69-4590-8b99-022a36b0368a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:18.958008 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-99af9309-2b69-4590-8b99-022a36b0368a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3963cdfab31846c3a7d42df5fd367e5a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:18.970638 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-99af9309-2b69-4590-8b99-022a36b0368a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3963cdfab31846c3a7d42df5fd367e5a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:18.977607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-99af9309-2b69-4590-8b99-022a36b0368a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3963cdfab31846c3a7d42df5fd367e5a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:18.978534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-99af9309-2b69-4590-8b99-022a36b0368a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3963cdfab31846c3a7d42df5fd367e5a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:18.979615 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-99af9309-2b69-4590-8b99-022a36b0368a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3963cdfab31846c3a7d42df5fd367e5a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:19.000287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1369/2766] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:17:18 2022] DELETE /identity/v3/users/3963cdfab31846c3a7d42df5fd367e5a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:19.290017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85595b2-fb2b-4881-aeed-d31840786642 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:19.291818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a85595b2-fb2b-4881-aeed-d31840786642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:19.311057 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85595b2-fb2b-4881-aeed-d31840786642 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:19.373314 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112cd28-fb9a-4b41-a67e-a0d79d315fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:19.373854 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112cd28-fb9a-4b41-a67e-a0d79d315fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:19.374128 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112cd28-fb9a-4b41-a67e-a0d79d315fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:19.374395 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112cd28-fb9a-4b41-a67e-a0d79d315fe3 admin admin] PATH_INFO: `/v3/projects/7667b8d38e5347dfbaa23de226decc7e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:19.375538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112cd28-fb9a-4b41-a67e-a0d79d315fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7667b8d38e5347dfbaa23de226decc7e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:19.377748 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112cd28-fb9a-4b41-a67e-a0d79d315fe3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:19.379283 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:19.429846 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d112cd28-fb9a-4b41-a67e-a0d79d315fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7667b8d38e5347dfbaa23de226decc7e', 'request_id': 'req-d112cd28-fb9a-4b41-a67e-a0d79d315fe3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:19.435317 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d112cd28-fb9a-4b41-a67e-a0d79d315fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7667b8d38e5347dfbaa23de226decc7e', 'request_id': 'req-d112cd28-fb9a-4b41-a67e-a0d79d315fe3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:19.442523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d112cd28-fb9a-4b41-a67e-a0d79d315fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7667b8d38e5347dfbaa23de226decc7e', 'request_id': 'req-d112cd28-fb9a-4b41-a67e-a0d79d315fe3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:19.453747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d112cd28-fb9a-4b41-a67e-a0d79d315fe3 admin admin] The token cache is being invalidate because project 7667b8d38e5347dfbaa23de226decc7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:19.454042 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d112cd28-fb9a-4b41-a67e-a0d79d315fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:19.454730 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d112cd28-fb9a-4b41-a67e-a0d79d315fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:19.456311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1398/2767] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:19 2022] DELETE /identity/v3/projects/7667b8d38e5347dfbaa23de226decc7e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:19.462641 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3fd37-f118-4b48-ae05-4b7e0d43b866 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:19.463118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3fd37-f118-4b48-ae05-4b7e0d43b866 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:19.463222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3fd37-f118-4b48-ae05-4b7e0d43b866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:19.483919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-07b3fd37-f118-4b48-ae05-4b7e0d43b866 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:19.485230 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-07b3fd37-f118-4b48-ae05-4b7e0d43b866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:19.533181 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:19.547399 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1370/2768] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:19.555402 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae1123-80e3-48be-98d1-9cf30e80a10f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:19.555682 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae1123-80e3-48be-98d1-9cf30e80a10f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:19.555964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae1123-80e3-48be-98d1-9cf30e80a10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:19.575872 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a4ae1123-80e3-48be-98d1-9cf30e80a10f None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:19.577092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a4ae1123-80e3-48be-98d1-9cf30e80a10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:19.584809 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1399/2769] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:19.589084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3fd37-f118-4b48-ae05-4b7e0d43b866 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:19.598808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3fd37-f118-4b48-ae05-4b7e0d43b866 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:19.603366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab9b2f-cfea-4e01-bee1-02370630c2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:19.603979 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab9b2f-cfea-4e01-bee1-02370630c2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:19.604775 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab9b2f-cfea-4e01-bee1-02370630c2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:19.605049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab9b2f-cfea-4e01-bee1-02370630c2d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:19.605697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab9b2f-cfea-4e01-bee1-02370630c2d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:17:19.605999 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab9b2f-cfea-4e01-bee1-02370630c2d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:19.607595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab9b2f-cfea-4e01-bee1-02370630c2d4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:19.623110 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1371/2770] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:17:19.627627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae1123-80e3-48be-98d1-9cf30e80a10f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:19.637283 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae1123-80e3-48be-98d1-9cf30e80a10f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:19.641931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bbbf7-2e77-4be8-8ee2-d655bb91ac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:19.642517 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bbbf7-2e77-4be8-8ee2-d655bb91ac0b admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:19.642795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bbbf7-2e77-4be8-8ee2-d655bb91ac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:19.643059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bbbf7-2e77-4be8-8ee2-d655bb91ac0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:19.643712 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bbbf7-2e77-4be8-8ee2-d655bb91ac0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:19.645610 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bbbf7-2e77-4be8-8ee2-d655bb91ac0b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:19.674529 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1400/2771] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:17:19 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:17:19.678788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab9b2f-cfea-4e01-bee1-02370630c2d4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:19.689422 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab9b2f-cfea-4e01-bee1-02370630c2d4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:19.744989 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00718da-cf06-4f73-9fb2-092328186aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:19.745609 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00718da-cf06-4f73-9fb2-092328186aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:19.745873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00718da-cf06-4f73-9fb2-092328186aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:19.746146 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00718da-cf06-4f73-9fb2-092328186aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:19.746775 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00718da-cf06-4f73-9fb2-092328186aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:19.748725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00718da-cf06-4f73-9fb2-092328186aa6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:19.773252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1372/2772] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:17:19 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:17:19.777874 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bbbf7-2e77-4be8-8ee2-d655bb91ac0b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:19.787918 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bbbf7-2e77-4be8-8ee2-d655bb91ac0b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:19.792768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a5c95-814e-4001-961f-1f9b1286fe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:19.793353 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a5c95-814e-4001-961f-1f9b1286fe7e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:19.793625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a5c95-814e-4001-961f-1f9b1286fe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:19.793887 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a5c95-814e-4001-961f-1f9b1286fe7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:19.794507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a5c95-814e-4001-961f-1f9b1286fe7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:19.796105 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a5c95-814e-4001-961f-1f9b1286fe7e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:19.805799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1401/2773] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:19.809534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00718da-cf06-4f73-9fb2-092328186aa6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:19.819549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00718da-cf06-4f73-9fb2-092328186aa6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:19.824953 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e57fb-9234-4742-9eeb-e4f1e754e12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:19.825573 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e57fb-9234-4742-9eeb-e4f1e754e12f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:19.825855 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e57fb-9234-4742-9eeb-e4f1e754e12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:19.826130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e57fb-9234-4742-9eeb-e4f1e754e12f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:19.826775 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e57fb-9234-4742-9eeb-e4f1e754e12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:19.828441 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e57fb-9234-4742-9eeb-e4f1e754e12f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:19.839783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1373/2774] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:19.843900 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a5c95-814e-4001-961f-1f9b1286fe7e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:19.853848 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a5c95-814e-4001-961f-1f9b1286fe7e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:19.858402 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78c7f7-d15a-47fc-9662-751708a4d6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:19.859038 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78c7f7-d15a-47fc-9662-751708a4d6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:19.859311 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78c7f7-d15a-47fc-9662-751708a4d6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:19.859577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78c7f7-d15a-47fc-9662-751708a4d6b4 admin admin] PATH_INFO: `/v3/projects/c4d594416c8a4a3da95b6b032848ed02/users/dcd603f58c28435faa4fb29ea9b831ac/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:19.873726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78c7f7-d15a-47fc-9662-751708a4d6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d594416c8a4a3da95b6b032848ed02, user_id=dcd603f58c28435faa4fb29ea9b831ac, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:19.876418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78c7f7-d15a-47fc-9662-751708a4d6b4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:19.889808 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1402/2775] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:17:19 2022] PUT /identity/v3/projects/c4d594416c8a4a3da95b6b032848ed02/users/dcd603f58c28435faa4fb29ea9b831ac/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:17:19.901068 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f8572-6e81-44bf-94cb-3870fadfae86 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:19.902110 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f8572-6e81-44bf-94cb-3870fadfae86 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:19.902249 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f8572-6e81-44bf-94cb-3870fadfae86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:19.930013 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-258f8572-6e81-44bf-94cb-3870fadfae86 None None] MFA Rules not processed for user `dcd603f58c28435faa4fb29ea9b831ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:19.931240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-258f8572-6e81-44bf-94cb-3870fadfae86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:19.996984 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1374/2776] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:20.008447 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78c7f7-d15a-47fc-9662-751708a4d6b4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:20.010264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fb78c7f7-d15a-47fc-9662-751708a4d6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:20.067870 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78c7f7-d15a-47fc-9662-751708a4d6b4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:20.071523 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa7596-ad7a-4fed-a0ac-ea5769ffb28d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:20.072196 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa7596-ad7a-4fed-a0ac-ea5769ffb28d service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:20.072470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa7596-ad7a-4fed-a0ac-ea5769ffb28d service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:20.072735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa7596-ad7a-4fed-a0ac-ea5769ffb28d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:20.081622 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa7596-ad7a-4fed-a0ac-ea5769ffb28d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:20.083024 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa7596-ad7a-4fed-a0ac-ea5769ffb28d service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:20.091828 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1403/2777] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:17:20.110942 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f8572-6e81-44bf-94cb-3870fadfae86 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:20.160003 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:20.176332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f8572-6e81-44bf-94cb-3870fadfae86 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:20.180842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6f88b-4fa7-4d9f-a9b2-357f916f746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:20.181499 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6f88b-4fa7-4d9f-a9b2-357f916f746a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:20.181793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6f88b-4fa7-4d9f-a9b2-357f916f746a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:20.182045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6f88b-4fa7-4d9f-a9b2-357f916f746a admin admin] PATH_INFO: `/v3/users/dcd603f58c28435faa4fb29ea9b831ac` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:20.183808 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6f88b-4fa7-4d9f-a9b2-357f916f746a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd603f58c28435faa4fb29ea9b831ac)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:20.186407 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6f88b-4fa7-4d9f-a9b2-357f916f746a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:20.234767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e9c6f88b-4fa7-4d9f-a9b2-357f916f746a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd603f58c28435faa4fb29ea9b831ac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:20.248143 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e9c6f88b-4fa7-4d9f-a9b2-357f916f746a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd603f58c28435faa4fb29ea9b831ac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:20.255438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e9c6f88b-4fa7-4d9f-a9b2-357f916f746a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd603f58c28435faa4fb29ea9b831ac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:20.256194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e9c6f88b-4fa7-4d9f-a9b2-357f916f746a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd603f58c28435faa4fb29ea9b831ac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:20.256816 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e9c6f88b-4fa7-4d9f-a9b2-357f916f746a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd603f58c28435faa4fb29ea9b831ac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:20.269558 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1375/2778] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:17:20 2022] DELETE /identity/v3/users/dcd603f58c28435faa4fb29ea9b831ac => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:20.274132 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28791698-656c-457c-afcd-a623b67b3ac1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:20.274564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28791698-656c-457c-afcd-a623b67b3ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:20.274688 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28791698-656c-457c-afcd-a623b67b3ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:20.303419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-28791698-656c-457c-afcd-a623b67b3ac1 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:20.304977 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-28791698-656c-457c-afcd-a623b67b3ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:20.329512 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:20.367892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1404/2779] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:20.378126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6f88b-4fa7-4d9f-a9b2-357f916f746a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:20.379531 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e9c6f88b-4fa7-4d9f-a9b2-357f916f746a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:20.440179 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6f88b-4fa7-4d9f-a9b2-357f916f746a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:20.443731 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfa52c-1c8d-478e-817d-05bc69fa55fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:20.444362 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfa52c-1c8d-478e-817d-05bc69fa55fd service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:20.444641 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfa52c-1c8d-478e-817d-05bc69fa55fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:20.444911 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfa52c-1c8d-478e-817d-05bc69fa55fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:20.454358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfa52c-1c8d-478e-817d-05bc69fa55fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:20.455777 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfa52c-1c8d-478e-817d-05bc69fa55fd service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:20.465653 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1376/2780] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:20.735246 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28791698-656c-457c-afcd-a623b67b3ac1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:20.736683 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-28791698-656c-457c-afcd-a623b67b3ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:20.750384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28791698-656c-457c-afcd-a623b67b3ac1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:20.755393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d5d64-8576-4c72-8fe5-20669434bee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:20.756039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d5d64-8576-4c72-8fe5-20669434bee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:20.756333 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d5d64-8576-4c72-8fe5-20669434bee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:20.756616 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d5d64-8576-4c72-8fe5-20669434bee9 admin admin] PATH_INFO: `/v3/projects/c4d594416c8a4a3da95b6b032848ed02` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:20.758251 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d5d64-8576-4c72-8fe5-20669434bee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d594416c8a4a3da95b6b032848ed02)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:20.760569 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d5d64-8576-4c72-8fe5-20669434bee9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:20.809180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-045d5d64-8576-4c72-8fe5-20669434bee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d594416c8a4a3da95b6b032848ed02', 'request_id': 'req-045d5d64-8576-4c72-8fe5-20669434bee9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:20.815279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-045d5d64-8576-4c72-8fe5-20669434bee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d594416c8a4a3da95b6b032848ed02', 'request_id': 'req-045d5d64-8576-4c72-8fe5-20669434bee9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:20.823771 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-045d5d64-8576-4c72-8fe5-20669434bee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d594416c8a4a3da95b6b032848ed02', 'request_id': 'req-045d5d64-8576-4c72-8fe5-20669434bee9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:20.834822 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-045d5d64-8576-4c72-8fe5-20669434bee9 admin admin] The token cache is being invalidate because project c4d594416c8a4a3da95b6b032848ed02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:20.835137 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-045d5d64-8576-4c72-8fe5-20669434bee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:20.835758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-045d5d64-8576-4c72-8fe5-20669434bee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:20.837256 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1405/2781] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:20 2022] DELETE /identity/v3/projects/c4d594416c8a4a3da95b6b032848ed02 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:20.842592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afb9d6-4254-4bf0-9b95-8dc348190cb9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:20.842875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afb9d6-4254-4bf0-9b95-8dc348190cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:20.843150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afb9d6-4254-4bf0-9b95-8dc348190cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:20.862998 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-31afb9d6-4254-4bf0-9b95-8dc348190cb9 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:20.864228 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-31afb9d6-4254-4bf0-9b95-8dc348190cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:20.925625 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1377/2782] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:20.934217 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a31782-d8ac-48e8-824f-2d4694331483 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:20.934525 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a31782-d8ac-48e8-824f-2d4694331483 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:20.934788 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a31782-d8ac-48e8-824f-2d4694331483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:20.955009 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d1a31782-d8ac-48e8-824f-2d4694331483 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:20.956242 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d1a31782-d8ac-48e8-824f-2d4694331483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:20.964314 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1406/2783] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:20.969498 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afb9d6-4254-4bf0-9b95-8dc348190cb9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:20.979408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afb9d6-4254-4bf0-9b95-8dc348190cb9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:20.984106 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26cf1a-e7d9-452f-943f-8be792c6f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:20.984622 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26cf1a-e7d9-452f-943f-8be792c6f50b admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:20.984891 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26cf1a-e7d9-452f-943f-8be792c6f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:20.985155 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26cf1a-e7d9-452f-943f-8be792c6f50b admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:20.985847 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26cf1a-e7d9-452f-943f-8be792c6f50b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:17:20.986143 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26cf1a-e7d9-452f-943f-8be792c6f50b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:20.987852 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26cf1a-e7d9-452f-943f-8be792c6f50b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:20.995559 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:21.002307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1378/2784] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:17:21.006732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a31782-d8ac-48e8-824f-2d4694331483 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:21.018342 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a31782-d8ac-48e8-824f-2d4694331483 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:21.023066 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6da997-d7d7-4e27-801b-f6901c1e5134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:21.023659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6da997-d7d7-4e27-801b-f6901c1e5134 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:21.023932 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6da997-d7d7-4e27-801b-f6901c1e5134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:21.024221 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6da997-d7d7-4e27-801b-f6901c1e5134 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:21.024850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6da997-d7d7-4e27-801b-f6901c1e5134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:21.027383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6da997-d7d7-4e27-801b-f6901c1e5134 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:21.058136 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1407/2785] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:17:21 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:17:21.062569 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26cf1a-e7d9-452f-943f-8be792c6f50b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:21.072552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26cf1a-e7d9-452f-943f-8be792c6f50b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:21.136996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca1fbf-0067-4c9f-9308-5a8b7f0fb9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:21.137596 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca1fbf-0067-4c9f-9308-5a8b7f0fb9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:21.137874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca1fbf-0067-4c9f-9308-5a8b7f0fb9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:21.138139 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca1fbf-0067-4c9f-9308-5a8b7f0fb9c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:21.138768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca1fbf-0067-4c9f-9308-5a8b7f0fb9c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:21.140727 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca1fbf-0067-4c9f-9308-5a8b7f0fb9c2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:21.162213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1379/2786] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:17:21 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:17:21.167182 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6da997-d7d7-4e27-801b-f6901c1e5134 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:21.178561 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6da997-d7d7-4e27-801b-f6901c1e5134 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:21.183717 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817de2d-8e40-43ba-bdeb-7fc74aee1822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:21.184394 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817de2d-8e40-43ba-bdeb-7fc74aee1822 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:21.184696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817de2d-8e40-43ba-bdeb-7fc74aee1822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:21.185023 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817de2d-8e40-43ba-bdeb-7fc74aee1822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:21.185776 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817de2d-8e40-43ba-bdeb-7fc74aee1822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:21.187363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817de2d-8e40-43ba-bdeb-7fc74aee1822 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:21.197187 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1408/2787] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:21.202091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca1fbf-0067-4c9f-9308-5a8b7f0fb9c2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:21.212279 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca1fbf-0067-4c9f-9308-5a8b7f0fb9c2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:21.217620 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da35ad1-b680-4f0c-8d71-f41a4e3c7b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:21.218237 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35ad1-b680-4f0c-8d71-f41a4e3c7b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:21.218521 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35ad1-b680-4f0c-8d71-f41a4e3c7b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:21.218789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35ad1-b680-4f0c-8d71-f41a4e3c7b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:21.219425 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da35ad1-b680-4f0c-8d71-f41a4e3c7b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:21.221045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da35ad1-b680-4f0c-8d71-f41a4e3c7b17 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:21.231673 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1380/2788] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:17:21.235979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817de2d-8e40-43ba-bdeb-7fc74aee1822 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:21.245834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817de2d-8e40-43ba-bdeb-7fc74aee1822 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:21.250281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0bbd6-3f89-4bb7-821e-a46e191d56b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:21.250912 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0bbd6-3f89-4bb7-821e-a46e191d56b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:21.251185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0bbd6-3f89-4bb7-821e-a46e191d56b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:21.251710 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0bbd6-3f89-4bb7-821e-a46e191d56b0 admin admin] PATH_INFO: `/v3/projects/ce99544d2a5f4d27a8a82d1345938a6e/users/92e3d65d308a48a99f9ceddffda25397/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:21.266804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0bbd6-3f89-4bb7-821e-a46e191d56b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce99544d2a5f4d27a8a82d1345938a6e, user_id=92e3d65d308a48a99f9ceddffda25397, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:21.269452 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0bbd6-3f89-4bb7-821e-a46e191d56b0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:21.282655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1409/2789] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:17:21 2022] PUT /identity/v3/projects/ce99544d2a5f4d27a8a82d1345938a6e/users/92e3d65d308a48a99f9ceddffda25397/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:21.292957 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f269a-a993-4ef2-ae1d-4f1468d13f2d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:21.293301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f269a-a993-4ef2-ae1d-4f1468d13f2d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:21.293503 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f269a-a993-4ef2-ae1d-4f1468d13f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:21.322364 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a95f269a-a993-4ef2-ae1d-4f1468d13f2d None None] MFA Rules not processed for user `92e3d65d308a48a99f9ceddffda25397`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:21.324156 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a95f269a-a993-4ef2-ae1d-4f1468d13f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:21.395553 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1381/2790] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:21.406750 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0bbd6-3f89-4bb7-821e-a46e191d56b0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:21.408518 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e2b0bbd6-3f89-4bb7-821e-a46e191d56b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:21.460779 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:21.465022 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0bbd6-3f89-4bb7-821e-a46e191d56b0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:21.473043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b58be2-6113-4660-9677-3d2b218bc39e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:21.473941 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b58be2-6113-4660-9677-3d2b218bc39e service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:21.474279 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b58be2-6113-4660-9677-3d2b218bc39e service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:21.474763 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b58be2-6113-4660-9677-3d2b218bc39e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:21.483851 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b58be2-6113-4660-9677-3d2b218bc39e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:21.485227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b58be2-6113-4660-9677-3d2b218bc39e service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:21.493962 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1410/2791] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:24.550515 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f269a-a993-4ef2-ae1d-4f1468d13f2d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:24.614630 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f269a-a993-4ef2-ae1d-4f1468d13f2d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:24.619064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa618b-da63-4e46-98e6-28ff434d0afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:24.620239 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa618b-da63-4e46-98e6-28ff434d0afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:24.620507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa618b-da63-4e46-98e6-28ff434d0afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:24.620779 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa618b-da63-4e46-98e6-28ff434d0afd admin admin] PATH_INFO: `/v3/users/92e3d65d308a48a99f9ceddffda25397` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:24.621936 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa618b-da63-4e46-98e6-28ff434d0afd admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e3d65d308a48a99f9ceddffda25397)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:24.623849 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa618b-da63-4e46-98e6-28ff434d0afd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:24.629636 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:24.672091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-72aa618b-da63-4e46-98e6-28ff434d0afd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e3d65d308a48a99f9ceddffda25397'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:24.685023 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-72aa618b-da63-4e46-98e6-28ff434d0afd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e3d65d308a48a99f9ceddffda25397'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:24.691794 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-72aa618b-da63-4e46-98e6-28ff434d0afd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e3d65d308a48a99f9ceddffda25397'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:24.692550 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-72aa618b-da63-4e46-98e6-28ff434d0afd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e3d65d308a48a99f9ceddffda25397'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:24.693149 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-72aa618b-da63-4e46-98e6-28ff434d0afd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e3d65d308a48a99f9ceddffda25397'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:24.708314 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1382/2792] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:17:24 2022] DELETE /identity/v3/users/92e3d65d308a48a99f9ceddffda25397 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:24.713400 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677a896-7bdc-4a78-8740-ad8841143bb0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:24.714183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677a896-7bdc-4a78-8740-ad8841143bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:24.714183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677a896-7bdc-4a78-8740-ad8841143bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:24.733580 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6677a896-7bdc-4a78-8740-ad8841143bb0 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:24.734786 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6677a896-7bdc-4a78-8740-ad8841143bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:24.814813 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1411/2793] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:24.827167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa618b-da63-4e46-98e6-28ff434d0afd admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:24.828642 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-72aa618b-da63-4e46-98e6-28ff434d0afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:24.893435 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa618b-da63-4e46-98e6-28ff434d0afd admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:24.897171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d4624-e20c-4736-96d2-cb1435ff39bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:24.897776 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d4624-e20c-4736-96d2-cb1435ff39bc service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:24.898047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d4624-e20c-4736-96d2-cb1435ff39bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:24.898315 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d4624-e20c-4736-96d2-cb1435ff39bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:24.908190 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d4624-e20c-4736-96d2-cb1435ff39bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:24.909616 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d4624-e20c-4736-96d2-cb1435ff39bc service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:24.919516 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1383/2794] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:25.211834 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677a896-7bdc-4a78-8740-ad8841143bb0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:25.213360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6677a896-7bdc-4a78-8740-ad8841143bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:25.227181 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677a896-7bdc-4a78-8740-ad8841143bb0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:25.235460 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b79c16-8c07-4375-bf9f-f70bb19553db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:25.236282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b79c16-8c07-4375-bf9f-f70bb19553db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:25.236557 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b79c16-8c07-4375-bf9f-f70bb19553db admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:25.236823 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b79c16-8c07-4375-bf9f-f70bb19553db admin admin] PATH_INFO: `/v3/projects/ce99544d2a5f4d27a8a82d1345938a6e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:25.238113 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b79c16-8c07-4375-bf9f-f70bb19553db admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce99544d2a5f4d27a8a82d1345938a6e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:25.240078 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b79c16-8c07-4375-bf9f-f70bb19553db admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:25.291833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d2b79c16-8c07-4375-bf9f-f70bb19553db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce99544d2a5f4d27a8a82d1345938a6e', 'request_id': 'req-d2b79c16-8c07-4375-bf9f-f70bb19553db'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:25.297254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d2b79c16-8c07-4375-bf9f-f70bb19553db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce99544d2a5f4d27a8a82d1345938a6e', 'request_id': 'req-d2b79c16-8c07-4375-bf9f-f70bb19553db'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:25.305606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d2b79c16-8c07-4375-bf9f-f70bb19553db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce99544d2a5f4d27a8a82d1345938a6e', 'request_id': 'req-d2b79c16-8c07-4375-bf9f-f70bb19553db'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:25.317770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d2b79c16-8c07-4375-bf9f-f70bb19553db admin admin] The token cache is being invalidate because project ce99544d2a5f4d27a8a82d1345938a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:25.318120 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d2b79c16-8c07-4375-bf9f-f70bb19553db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:25.319263 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d2b79c16-8c07-4375-bf9f-f70bb19553db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:25.320785 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1412/2795] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:25 2022] DELETE /identity/v3/projects/ce99544d2a5f4d27a8a82d1345938a6e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:25.329778 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f0d86-fb1f-42a9-9788-56df0dbfbaff None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:25.330045 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f0d86-fb1f-42a9-9788-56df0dbfbaff None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:25.330340 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f0d86-fb1f-42a9-9788-56df0dbfbaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:25.350131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-496f0d86-fb1f-42a9-9788-56df0dbfbaff None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:25.351337 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-496f0d86-fb1f-42a9-9788-56df0dbfbaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:25.410657 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1384/2796] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:25.420000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8e8c2-023b-4009-b5cb-3b03732685e8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:25.420384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8e8c2-023b-4009-b5cb-3b03732685e8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:25.420764 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8e8c2-023b-4009-b5cb-3b03732685e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:25.441898 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-51b8e8c2-023b-4009-b5cb-3b03732685e8 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:25.443138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-51b8e8c2-023b-4009-b5cb-3b03732685e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:25.453713 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1413/2797] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:25.457937 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f0d86-fb1f-42a9-9788-56df0dbfbaff None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:25.467634 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f0d86-fb1f-42a9-9788-56df0dbfbaff None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:25.473310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cea52-dca2-4c1d-801d-b64cf07096c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:25.473940 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cea52-dca2-4c1d-801d-b64cf07096c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:25.474216 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cea52-dca2-4c1d-801d-b64cf07096c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:25.474617 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cea52-dca2-4c1d-801d-b64cf07096c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:25.475293 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cea52-dca2-4c1d-801d-b64cf07096c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:17:25.475592 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cea52-dca2-4c1d-801d-b64cf07096c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:25.477212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cea52-dca2-4c1d-801d-b64cf07096c3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:25.489464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1385/2798] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:17:25.493837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8e8c2-023b-4009-b5cb-3b03732685e8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:25.504815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8e8c2-023b-4009-b5cb-3b03732685e8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:25.509446 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d2e53-3324-460b-a204-04135a67d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:25.511375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d2e53-3324-460b-a204-04135a67d6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:25.511679 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d2e53-3324-460b-a204-04135a67d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:25.512014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d2e53-3324-460b-a204-04135a67d6a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:25.512659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d2e53-3324-460b-a204-04135a67d6a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:25.514631 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d2e53-3324-460b-a204-04135a67d6a0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:25.542204 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1414/2799] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:17:25 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:17:25.546532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cea52-dca2-4c1d-801d-b64cf07096c3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:25.556528 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cea52-dca2-4c1d-801d-b64cf07096c3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:25.568526 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:25.617546 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19a861-3db4-40ad-b006-f601212e393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:25.618150 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a861-3db4-40ad-b006-f601212e393a admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:25.618426 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a861-3db4-40ad-b006-f601212e393a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:25.618694 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a861-3db4-40ad-b006-f601212e393a admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:25.619326 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19a861-3db4-40ad-b006-f601212e393a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:25.621910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19a861-3db4-40ad-b006-f601212e393a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:25.643107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1386/2800] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:17:25 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:17:25.647438 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d2e53-3324-460b-a204-04135a67d6a0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:25.658529 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d2e53-3324-460b-a204-04135a67d6a0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:25.663178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651de156-ea1f-46c4-8e2e-1d3f9cf6cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:25.663853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651de156-ea1f-46c4-8e2e-1d3f9cf6cd3d admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:25.664167 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651de156-ea1f-46c4-8e2e-1d3f9cf6cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:25.664719 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651de156-ea1f-46c4-8e2e-1d3f9cf6cd3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:25.665041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651de156-ea1f-46c4-8e2e-1d3f9cf6cd3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:25.667259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651de156-ea1f-46c4-8e2e-1d3f9cf6cd3d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:25.677337 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1415/2801] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:25.681385 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19a861-3db4-40ad-b006-f601212e393a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:25.692519 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19a861-3db4-40ad-b006-f601212e393a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:25.697123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262e74c-73f0-41ca-8217-52d8c11e0b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:25.698725 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262e74c-73f0-41ca-8217-52d8c11e0b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:25.699002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262e74c-73f0-41ca-8217-52d8c11e0b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:25.699269 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262e74c-73f0-41ca-8217-52d8c11e0b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:25.699902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262e74c-73f0-41ca-8217-52d8c11e0b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:25.701522 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262e74c-73f0-41ca-8217-52d8c11e0b0b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:25.711780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1387/2802] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:25.716674 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651de156-ea1f-46c4-8e2e-1d3f9cf6cd3d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:25.726586 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651de156-ea1f-46c4-8e2e-1d3f9cf6cd3d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:25.732138 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75da83b-8d14-49fe-8237-c82da009c8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:25.732795 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75da83b-8d14-49fe-8237-c82da009c8c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:25.733073 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75da83b-8d14-49fe-8237-c82da009c8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:25.733346 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75da83b-8d14-49fe-8237-c82da009c8c5 admin admin] PATH_INFO: `/v3/projects/d952721db38b42af825acf0afbb04b8d/users/8437a0e26ba049c8b49ae79688ef31a3/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:25.749491 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75da83b-8d14-49fe-8237-c82da009c8c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d952721db38b42af825acf0afbb04b8d, user_id=8437a0e26ba049c8b49ae79688ef31a3, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:25.752455 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75da83b-8d14-49fe-8237-c82da009c8c5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:25.765739 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1416/2803] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:17:25 2022] PUT /identity/v3/projects/d952721db38b42af825acf0afbb04b8d/users/8437a0e26ba049c8b49ae79688ef31a3/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:25.776038 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc13969-0df5-4e5e-8e2c-b01942794193 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:25.776310 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc13969-0df5-4e5e-8e2c-b01942794193 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:25.776579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc13969-0df5-4e5e-8e2c-b01942794193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:25.804801 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8dc13969-0df5-4e5e-8e2c-b01942794193 None None] MFA Rules not processed for user `8437a0e26ba049c8b49ae79688ef31a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:25.806162 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8dc13969-0df5-4e5e-8e2c-b01942794193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:25.872433 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1388/2804] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:25.884892 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75da83b-8d14-49fe-8237-c82da009c8c5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:25.886853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b75da83b-8d14-49fe-8237-c82da009c8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:25.901258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:25.946360 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75da83b-8d14-49fe-8237-c82da009c8c5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:25.949966 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b9255-0a92-41b3-b750-6fc30254341b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d3889156524b388b761cedfac8ed6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:25.950560 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b9255-0a92-41b3-b750-6fc30254341b service glance] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:25.950833 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b9255-0a92-41b3-b750-6fc30254341b service glance] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:25.951152 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b9255-0a92-41b3-b750-6fc30254341b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:25.959462 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b9255-0a92-41b3-b750-6fc30254341b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:25.960913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b9255-0a92-41b3-b750-6fc30254341b service glance] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:25.970894 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1417/2805] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:28.266773 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc13969-0df5-4e5e-8e2c-b01942794193 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:28.268652 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8dc13969-0df5-4e5e-8e2c-b01942794193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:28.333818 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc13969-0df5-4e5e-8e2c-b01942794193 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:28.337734 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583510bb-bc73-4f5a-b8ee-1e1d1b8f906f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:28.338377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583510bb-bc73-4f5a-b8ee-1e1d1b8f906f service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:28.338655 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583510bb-bc73-4f5a-b8ee-1e1d1b8f906f service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:28.338928 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583510bb-bc73-4f5a-b8ee-1e1d1b8f906f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:28.345795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-583510bb-bc73-4f5a-b8ee-1e1d1b8f906f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:28.389919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:28.410513 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583510bb-bc73-4f5a-b8ee-1e1d1b8f906f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:28.411974 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583510bb-bc73-4f5a-b8ee-1e1d1b8f906f service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:28.421079 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1389/2806] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:17:29.357695 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b9255-0a92-41b3-b750-6fc30254341b service glance] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:29.359302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b96b9255-0a92-41b3-b750-6fc30254341b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:29.470259 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b9255-0a92-41b3-b750-6fc30254341b service glance] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:29.481839 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e0183-8f53-4d9a-a57e-20e6f35480fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa002909502426b80c97dbf05dca008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:29.482672 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e0183-8f53-4d9a-a57e-20e6f35480fd service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:29.483022 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e0183-8f53-4d9a-a57e-20e6f35480fd service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:29.483372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e0183-8f53-4d9a-a57e-20e6f35480fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:29.485317 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f19e0183-8f53-4d9a-a57e-20e6f35480fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:29.500463 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e0183-8f53-4d9a-a57e-20e6f35480fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:29.503143 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e0183-8f53-4d9a-a57e-20e6f35480fd service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:29.533478 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1418/2807] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:33.800632 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583510bb-bc73-4f5a-b8ee-1e1d1b8f906f service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:33.802276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-583510bb-bc73-4f5a-b8ee-1e1d1b8f906f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:33.816212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583510bb-bc73-4f5a-b8ee-1e1d1b8f906f service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:33.820176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fcd52-f38e-4cc5-ac74-c3f995760fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:33.820789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fcd52-f38e-4cc5-ac74-c3f995760fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:33.821132 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fcd52-f38e-4cc5-ac74-c3f995760fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:33.821550 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fcd52-f38e-4cc5-ac74-c3f995760fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:33.824117 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-545fcd52-f38e-4cc5-ac74-c3f995760fc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:33.894500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fcd52-f38e-4cc5-ac74-c3f995760fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:33.895938 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fcd52-f38e-4cc5-ac74-c3f995760fc6 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:33.906959 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1390/2808] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:39.525786 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=55 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:40.962931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e0183-8f53-4d9a-a57e-20e6f35480fd service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:40.964706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f19e0183-8f53-4d9a-a57e-20e6f35480fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:41.061885 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e0183-8f53-4d9a-a57e-20e6f35480fd service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:41.069757 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1803a1-5935-4551-8f80-7de3a07bcd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:41.070156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1803a1-5935-4551-8f80-7de3a07bcd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:41.070432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1803a1-5935-4551-8f80-7de3a07bcd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:41.070705 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1803a1-5935-4551-8f80-7de3a07bcd85 admin admin] PATH_INFO: `/v3/users/bbd08b29c5d64ecbb7f2dbfbd328d0c1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:41.071994 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1803a1-5935-4551-8f80-7de3a07bcd85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd08b29c5d64ecbb7f2dbfbd328d0c1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:41.074832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1803a1-5935-4551-8f80-7de3a07bcd85 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:41.172105 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4b1803a1-5935-4551-8f80-7de3a07bcd85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd08b29c5d64ecbb7f2dbfbd328d0c1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:41.181566 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4b1803a1-5935-4551-8f80-7de3a07bcd85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd08b29c5d64ecbb7f2dbfbd328d0c1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:41.192453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4b1803a1-5935-4551-8f80-7de3a07bcd85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd08b29c5d64ecbb7f2dbfbd328d0c1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:41.193305 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4b1803a1-5935-4551-8f80-7de3a07bcd85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd08b29c5d64ecbb7f2dbfbd328d0c1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:41.208749 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4b1803a1-5935-4551-8f80-7de3a07bcd85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd08b29c5d64ecbb7f2dbfbd328d0c1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:41.215616 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1419/2809] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:17:40 2022] DELETE /identity/v3/users/bbd08b29c5d64ecbb7f2dbfbd328d0c1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:17:41.396076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fcd52-f38e-4cc5-ac74-c3f995760fc6 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:41.454074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fcd52-f38e-4cc5-ac74-c3f995760fc6 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:41.512726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:41.513360 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:41.513639 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:41.513911 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84 admin admin] PATH_INFO: `/v3/projects/c4c952c4521d4515ad969cd9f6209904` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:41.515050 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c952c4521d4515ad969cd9f6209904)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:41.517005 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:41.554116 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:41.564920 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c952c4521d4515ad969cd9f6209904', 'request_id': 'req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:41.571123 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c952c4521d4515ad969cd9f6209904', 'request_id': 'req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:41.576667 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c952c4521d4515ad969cd9f6209904', 'request_id': 'req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:41.589485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84 admin admin] The token cache is being invalidate because project c4c952c4521d4515ad969cd9f6209904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:41.589795 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:41.590405 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:41.591853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1391/2810] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:41 2022] DELETE /identity/v3/projects/c4c952c4521d4515ad969cd9f6209904 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:41.595811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1803a1-5935-4551-8f80-7de3a07bcd85 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:41.597258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4b1803a1-5935-4551-8f80-7de3a07bcd85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:41.610567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1803a1-5935-4551-8f80-7de3a07bcd85 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:41.666621 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab945b-1a8f-49d6-b645-ba7bde240e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:41.667853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab945b-1a8f-49d6-b645-ba7bde240e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:41.668164 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab945b-1a8f-49d6-b645-ba7bde240e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:41.668435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab945b-1a8f-49d6-b645-ba7bde240e2f admin admin] PATH_INFO: `/v3/users/0aa1501962254cc482980a7f6fc234fc` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:41.669564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab945b-1a8f-49d6-b645-ba7bde240e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa1501962254cc482980a7f6fc234fc)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:41.671475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab945b-1a8f-49d6-b645-ba7bde240e2f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:41.683754 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:41.718010 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-40ab945b-1a8f-49d6-b645-ba7bde240e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa1501962254cc482980a7f6fc234fc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:41.724900 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-40ab945b-1a8f-49d6-b645-ba7bde240e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa1501962254cc482980a7f6fc234fc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:41.732678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-40ab945b-1a8f-49d6-b645-ba7bde240e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa1501962254cc482980a7f6fc234fc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:41.733510 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-40ab945b-1a8f-49d6-b645-ba7bde240e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa1501962254cc482980a7f6fc234fc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:41.745849 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-40ab945b-1a8f-49d6-b645-ba7bde240e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa1501962254cc482980a7f6fc234fc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:41.751831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1420/2811] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:17:41 2022] DELETE /identity/v3/users/0aa1501962254cc482980a7f6fc234fc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:41.927245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:41.928735 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:41.942861 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ecf4b-6421-4605-ae1b-a59bb07e0b84 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:42.010203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51834a6f-cda5-4d68-b07a-783218bb049b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:42.011972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51834a6f-cda5-4d68-b07a-783218bb049b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:42.012272 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51834a6f-cda5-4d68-b07a-783218bb049b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:42.012544 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51834a6f-cda5-4d68-b07a-783218bb049b admin admin] PATH_INFO: `/v3/projects/1bfbb0ab4eab40ad992014310dc06ce1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:42.013681 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51834a6f-cda5-4d68-b07a-783218bb049b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bfbb0ab4eab40ad992014310dc06ce1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:42.015623 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51834a6f-cda5-4d68-b07a-783218bb049b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:42.067185 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-51834a6f-cda5-4d68-b07a-783218bb049b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfbb0ab4eab40ad992014310dc06ce1', 'request_id': 'req-51834a6f-cda5-4d68-b07a-783218bb049b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:42.074295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-51834a6f-cda5-4d68-b07a-783218bb049b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfbb0ab4eab40ad992014310dc06ce1', 'request_id': 'req-51834a6f-cda5-4d68-b07a-783218bb049b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:42.080995 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-51834a6f-cda5-4d68-b07a-783218bb049b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfbb0ab4eab40ad992014310dc06ce1', 'request_id': 'req-51834a6f-cda5-4d68-b07a-783218bb049b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:42.097128 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-51834a6f-cda5-4d68-b07a-783218bb049b admin admin] The token cache is being invalidate because project 1bfbb0ab4eab40ad992014310dc06ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:42.097505 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-51834a6f-cda5-4d68-b07a-783218bb049b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:42.098221 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-51834a6f-cda5-4d68-b07a-783218bb049b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:42.099815 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1392/2812] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:41 2022] DELETE /identity/v3/projects/1bfbb0ab4eab40ad992014310dc06ce1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:48.240290 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab945b-1a8f-49d6-b645-ba7bde240e2f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:48.241677 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-40ab945b-1a8f-49d6-b645-ba7bde240e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:48.255491 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab945b-1a8f-49d6-b645-ba7bde240e2f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:48.310905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27ceda-4ec5-4169-8e0a-835249de3986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:48.311535 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27ceda-4ec5-4169-8e0a-835249de3986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:48.311810 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27ceda-4ec5-4169-8e0a-835249de3986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:48.312116 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27ceda-4ec5-4169-8e0a-835249de3986 admin admin] PATH_INFO: `/v3/users/8437a0e26ba049c8b49ae79688ef31a3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:48.313227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27ceda-4ec5-4169-8e0a-835249de3986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8437a0e26ba049c8b49ae79688ef31a3)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:48.315121 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27ceda-4ec5-4169-8e0a-835249de3986 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:48.363092 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5d27ceda-4ec5-4169-8e0a-835249de3986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8437a0e26ba049c8b49ae79688ef31a3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:48.371163 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5d27ceda-4ec5-4169-8e0a-835249de3986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8437a0e26ba049c8b49ae79688ef31a3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:48.380773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5d27ceda-4ec5-4169-8e0a-835249de3986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8437a0e26ba049c8b49ae79688ef31a3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:48.381531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5d27ceda-4ec5-4169-8e0a-835249de3986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8437a0e26ba049c8b49ae79688ef31a3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:48.395799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5d27ceda-4ec5-4169-8e0a-835249de3986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8437a0e26ba049c8b49ae79688ef31a3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:48.398621 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51834a6f-cda5-4d68-b07a-783218bb049b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:48.400692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-51834a6f-cda5-4d68-b07a-783218bb049b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:48.402617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1421/2813] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:17:48 2022] DELETE /identity/v3/users/8437a0e26ba049c8b49ae79688ef31a3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:48.406789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32547d2c-1224-40e0-8265-2e2c395fc18d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:48.407075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32547d2c-1224-40e0-8265-2e2c395fc18d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:48.407344 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32547d2c-1224-40e0-8265-2e2c395fc18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:48.426706 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:48.439358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-32547d2c-1224-40e0-8265-2e2c395fc18d None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:48.441264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-32547d2c-1224-40e0-8265-2e2c395fc18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:48.463363 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:48.505049 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1422/2814] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:48.515399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32547d2c-1224-40e0-8265-2e2c395fc18d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:48.516990 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-32547d2c-1224-40e0-8265-2e2c395fc18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:48.520225 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51834a6f-cda5-4d68-b07a-783218bb049b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:48.574108 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32547d2c-1224-40e0-8265-2e2c395fc18d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:48.578398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7210c7-19a1-4cea-aa3c-aaf5bdef046e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:48.578998 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7210c7-19a1-4cea-aa3c-aaf5bdef046e service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:48.579404 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7210c7-19a1-4cea-aa3c-aaf5bdef046e service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:48.579683 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7210c7-19a1-4cea-aa3c-aaf5bdef046e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:48.583227 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f83f5-3de0-452c-98ca-054c61777978 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed835047051142d2bc98bb1564e3a98f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:48.583830 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f83f5-3de0-452c-98ca-054c61777978 service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:48.584133 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f83f5-3de0-452c-98ca-054c61777978 service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:48.584433 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f83f5-3de0-452c-98ca-054c61777978 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:48.586186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2e3f83f5-3de0-452c-98ca-054c61777978 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:48.588965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7210c7-19a1-4cea-aa3c-aaf5bdef046e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:48.590537 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7210c7-19a1-4cea-aa3c-aaf5bdef046e service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:48.597485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f83f5-3de0-452c-98ca-054c61777978 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:48.599153 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f83f5-3de0-452c-98ca-054c61777978 service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:48.600973 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1423/2815] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:17:48.613287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1393/2816] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:17:48.892627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7210c7-19a1-4cea-aa3c-aaf5bdef046e service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:48.894155 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ca7210c7-19a1-4cea-aa3c-aaf5bdef046e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:48.909629 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7210c7-19a1-4cea-aa3c-aaf5bdef046e service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:48.914263 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ec572-216d-43b1-8be8-471b9a534583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:48.915586 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ec572-216d-43b1-8be8-471b9a534583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:48.916226 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ec572-216d-43b1-8be8-471b9a534583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:48.916516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ec572-216d-43b1-8be8-471b9a534583 admin admin] PATH_INFO: `/v3/projects/d952721db38b42af825acf0afbb04b8d` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:48.917703 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ec572-216d-43b1-8be8-471b9a534583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d952721db38b42af825acf0afbb04b8d)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:48.919617 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ec572-216d-43b1-8be8-471b9a534583 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:48.966728 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d93ec572-216d-43b1-8be8-471b9a534583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd952721db38b42af825acf0afbb04b8d', 'request_id': 'req-d93ec572-216d-43b1-8be8-471b9a534583'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:48.972767 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d93ec572-216d-43b1-8be8-471b9a534583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd952721db38b42af825acf0afbb04b8d', 'request_id': 'req-d93ec572-216d-43b1-8be8-471b9a534583'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:48.980637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d93ec572-216d-43b1-8be8-471b9a534583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd952721db38b42af825acf0afbb04b8d', 'request_id': 'req-d93ec572-216d-43b1-8be8-471b9a534583'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:48.995375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d93ec572-216d-43b1-8be8-471b9a534583 admin admin] The token cache is being invalidate because project d952721db38b42af825acf0afbb04b8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:48.995685 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d93ec572-216d-43b1-8be8-471b9a534583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:48.996400 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d93ec572-216d-43b1-8be8-471b9a534583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:48.998171 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1424/2817] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:48 2022] DELETE /identity/v3/projects/d952721db38b42af825acf0afbb04b8d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:58.608627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=50 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:58.992134 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:22.767163 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1254b56-15be-4abd-9572-c181bbc2d2e3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:18:22.767693 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1254b56-15be-4abd-9572-c181bbc2d2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:18:22.767821 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1254b56-15be-4abd-9572-c181bbc2d2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:18:22.787318 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d1254b56-15be-4abd-9572-c181bbc2d2e3 None None] MFA Rules not processed for user `9754e3aad3674c789276ca823dd03411`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:18:22.788561 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d1254b56-15be-4abd-9572-c181bbc2d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:18:22.841700 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1394/2818] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:18:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:18:32.835118 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=25 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:31.173912 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ec572-216d-43b1-8be8-471b9a534583 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:31.176303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d93ec572-216d-43b1-8be8-471b9a534583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:31.256983 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ec572-216d-43b1-8be8-471b9a534583 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:31.261711 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e497e5-a453-44ae-b751-60d69bf8868d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:31.262339 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e497e5-a453-44ae-b751-60d69bf8868d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:31.262609 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e497e5-a453-44ae-b751-60d69bf8868d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:31.262873 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e497e5-a453-44ae-b751-60d69bf8868d admin admin] PATH_INFO: `/v3/users/9754e3aad3674c789276ca823dd03411` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:31.264000 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e497e5-a453-44ae-b751-60d69bf8868d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9754e3aad3674c789276ca823dd03411)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:31.266437 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e497e5-a453-44ae-b751-60d69bf8868d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:31.313069 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c2e497e5-a453-44ae-b751-60d69bf8868d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9754e3aad3674c789276ca823dd03411'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:31.321700 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c2e497e5-a453-44ae-b751-60d69bf8868d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9754e3aad3674c789276ca823dd03411'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:31.329966 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c2e497e5-a453-44ae-b751-60d69bf8868d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9754e3aad3674c789276ca823dd03411'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:31.330648 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c2e497e5-a453-44ae-b751-60d69bf8868d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9754e3aad3674c789276ca823dd03411'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:31.343125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c2e497e5-a453-44ae-b751-60d69bf8868d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9754e3aad3674c789276ca823dd03411'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:31.349077 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1425/2819] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:19:31 2022] DELETE /identity/v3/users/9754e3aad3674c789276ca823dd03411 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:31.539152 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1254b56-15be-4abd-9572-c181bbc2d2e3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:31.551263 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1254b56-15be-4abd-9572-c181bbc2d2e3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:31.624669 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dba01-a2ba-44a1-88f8-9879fae8de9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:31.625391 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dba01-a2ba-44a1-88f8-9879fae8de9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:31.625667 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dba01-a2ba-44a1-88f8-9879fae8de9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:31.625980 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dba01-a2ba-44a1-88f8-9879fae8de9b admin admin] PATH_INFO: `/v3/projects/359a50074dbb4502902d024e9990278d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:31.627074 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dba01-a2ba-44a1-88f8-9879fae8de9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=359a50074dbb4502902d024e9990278d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:31.629003 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dba01-a2ba-44a1-88f8-9879fae8de9b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:31.682172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-709dba01-a2ba-44a1-88f8-9879fae8de9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '359a50074dbb4502902d024e9990278d', 'request_id': 'req-709dba01-a2ba-44a1-88f8-9879fae8de9b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:31.689741 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-709dba01-a2ba-44a1-88f8-9879fae8de9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '359a50074dbb4502902d024e9990278d', 'request_id': 'req-709dba01-a2ba-44a1-88f8-9879fae8de9b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:31.695293 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-709dba01-a2ba-44a1-88f8-9879fae8de9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '359a50074dbb4502902d024e9990278d', 'request_id': 'req-709dba01-a2ba-44a1-88f8-9879fae8de9b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:31.708590 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-709dba01-a2ba-44a1-88f8-9879fae8de9b admin admin] The token cache is being invalidate because project 359a50074dbb4502902d024e9990278d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:19:31.708895 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-709dba01-a2ba-44a1-88f8-9879fae8de9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:31.709524 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-709dba01-a2ba-44a1-88f8-9879fae8de9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:31.711055 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1395/2820] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:19:31 2022] DELETE /identity/v3/projects/359a50074dbb4502902d024e9990278d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:31.715963 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c537dbf-f437-43cc-a406-92cf9b6f46b8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:31.716252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c537dbf-f437-43cc-a406-92cf9b6f46b8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:31.716526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c537dbf-f437-43cc-a406-92cf9b6f46b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:31.767130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8c537dbf-f437-43cc-a406-92cf9b6f46b8 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:31.768409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8c537dbf-f437-43cc-a406-92cf9b6f46b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:31.819227 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:31.837515 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1426/2821] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:19:31.842434 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e88d98-5dfc-4374-8109-af278854d06c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:31.843218 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e88d98-5dfc-4374-8109-af278854d06c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:31.843485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e88d98-5dfc-4374-8109-af278854d06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:31.864021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d8e88d98-5dfc-4374-8109-af278854d06c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:31.865438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d8e88d98-5dfc-4374-8109-af278854d06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:31.873474 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1396/2822] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:31.878570 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c537dbf-f437-43cc-a406-92cf9b6f46b8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:31.888455 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c537dbf-f437-43cc-a406-92cf9b6f46b8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:31.893911 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3380d-fc20-44cc-a999-446e3b0947a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:31.894529 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3380d-fc20-44cc-a999-446e3b0947a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:31.894807 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3380d-fc20-44cc-a999-446e3b0947a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:31.895081 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3380d-fc20-44cc-a999-446e3b0947a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:31.895732 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3380d-fc20-44cc-a999-446e3b0947a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:19:31.896059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3380d-fc20-44cc-a999-446e3b0947a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:31.902913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3380d-fc20-44cc-a999-446e3b0947a3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:31.911088 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1427/2823] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:19:31.915270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e88d98-5dfc-4374-8109-af278854d06c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:31.925064 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e88d98-5dfc-4374-8109-af278854d06c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:31.931562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cc51a-354b-4f8b-81be-c7ed6ed53882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:31.932208 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cc51a-354b-4f8b-81be-c7ed6ed53882 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:31.932487 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cc51a-354b-4f8b-81be-c7ed6ed53882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:31.932757 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cc51a-354b-4f8b-81be-c7ed6ed53882 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:31.933403 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cc51a-354b-4f8b-81be-c7ed6ed53882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:31.935332 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cc51a-354b-4f8b-81be-c7ed6ed53882 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:31.975449 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1397/2824] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:19:31 2022] POST /identity/v3/projects => generated 403 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:31.979684 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3380d-fc20-44cc-a999-446e3b0947a3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:31.990614 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3380d-fc20-44cc-a999-446e3b0947a3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:32.051606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6398224-5ec4-4156-b0d3-4665afafff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:32.052246 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6398224-5ec4-4156-b0d3-4665afafff9a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:32.052525 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6398224-5ec4-4156-b0d3-4665afafff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:32.052797 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6398224-5ec4-4156-b0d3-4665afafff9a admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:32.053433 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6398224-5ec4-4156-b0d3-4665afafff9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:32.055338 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6398224-5ec4-4156-b0d3-4665afafff9a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:32.082673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1428/2825] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:19:31 2022] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:32.083939 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cc51a-354b-4f8b-81be-c7ed6ed53882 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:32.095002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cc51a-354b-4f8b-81be-c7ed6ed53882 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:32.099583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e70ea-02b6-41f5-a678-4a71be84e1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:32.100209 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e70ea-02b6-41f5-a678-4a71be84e1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:32.100487 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e70ea-02b6-41f5-a678-4a71be84e1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:32.100765 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e70ea-02b6-41f5-a678-4a71be84e1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:32.101404 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e70ea-02b6-41f5-a678-4a71be84e1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:32.102996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e70ea-02b6-41f5-a678-4a71be84e1e8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:32.113486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1398/2826] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:19:32.117683 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6398224-5ec4-4156-b0d3-4665afafff9a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:32.128118 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6398224-5ec4-4156-b0d3-4665afafff9a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:32.132773 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bcc77-542e-4ccf-bce5-47b800fbd1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:32.133369 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bcc77-542e-4ccf-bce5-47b800fbd1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:32.133644 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bcc77-542e-4ccf-bce5-47b800fbd1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:32.133913 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bcc77-542e-4ccf-bce5-47b800fbd1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:32.134548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bcc77-542e-4ccf-bce5-47b800fbd1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:32.136418 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bcc77-542e-4ccf-bce5-47b800fbd1e4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:32.147796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1429/2827] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:19:32.152128 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e70ea-02b6-41f5-a678-4a71be84e1e8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:32.163764 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e70ea-02b6-41f5-a678-4a71be84e1e8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:32.168624 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce2e8b-d754-4976-ae3a-3f2e8e6f3141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:32.169297 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce2e8b-d754-4976-ae3a-3f2e8e6f3141 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:32.169568 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce2e8b-d754-4976-ae3a-3f2e8e6f3141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:32.169842 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce2e8b-d754-4976-ae3a-3f2e8e6f3141 admin admin] PATH_INFO: `/v3/projects/ec3da811ae2843f3a23a5e2d1d6ff909/users/fe7996e0966f4673936a248b7a1475b2/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:32.189503 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce2e8b-d754-4976-ae3a-3f2e8e6f3141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3da811ae2843f3a23a5e2d1d6ff909, user_id=fe7996e0966f4673936a248b7a1475b2, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:32.192185 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce2e8b-d754-4976-ae3a-3f2e8e6f3141 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:32.206186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1399/2828] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:19:32 2022] PUT /identity/v3/projects/ec3da811ae2843f3a23a5e2d1d6ff909/users/fe7996e0966f4673936a248b7a1475b2/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:32.221578 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601ea70-7ada-4d53-89a7-bbd9a3fad730 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:32.222125 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601ea70-7ada-4d53-89a7-bbd9a3fad730 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:32.222261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601ea70-7ada-4d53-89a7-bbd9a3fad730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:32.252432 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4601ea70-7ada-4d53-89a7-bbd9a3fad730 None None] MFA Rules not processed for user `fe7996e0966f4673936a248b7a1475b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:32.253650 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4601ea70-7ada-4d53-89a7-bbd9a3fad730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:32.327722 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1430/2829] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:32 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:32.332257 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce2e8b-d754-4976-ae3a-3f2e8e6f3141 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:32.352616 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:32.398774 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce2e8b-d754-4976-ae3a-3f2e8e6f3141 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:32.403424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de3dc3-cfd5-4dbd-a0b5-0786fb4b4129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:32.404060 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de3dc3-cfd5-4dbd-a0b5-0786fb4b4129 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:32.404336 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de3dc3-cfd5-4dbd-a0b5-0786fb4b4129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:32.404607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de3dc3-cfd5-4dbd-a0b5-0786fb4b4129 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:32.405788 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de3dc3-cfd5-4dbd-a0b5-0786fb4b4129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:32.407705 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de3dc3-cfd5-4dbd-a0b5-0786fb4b4129 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:32.437974 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1400/2830] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:19:32 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:32.442236 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601ea70-7ada-4d53-89a7-bbd9a3fad730 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:32.454475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601ea70-7ada-4d53-89a7-bbd9a3fad730 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:32.513326 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:32.531195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4972d6-bc2c-4ede-a49f-86a1b7dff880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:32.531825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4972d6-bc2c-4ede-a49f-86a1b7dff880 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:32.532147 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4972d6-bc2c-4ede-a49f-86a1b7dff880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:32.532422 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4972d6-bc2c-4ede-a49f-86a1b7dff880 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:32.533076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4972d6-bc2c-4ede-a49f-86a1b7dff880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:32.535045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4972d6-bc2c-4ede-a49f-86a1b7dff880 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:32.560358 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1431/2831] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:19:32 2022] POST /identity/v3/users => generated 309 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:32.564691 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de3dc3-cfd5-4dbd-a0b5-0786fb4b4129 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:32.575783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de3dc3-cfd5-4dbd-a0b5-0786fb4b4129 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:32.584912 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6d0d7-7031-4fa0-ac78-20c3bc7bf024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:32.585528 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6d0d7-7031-4fa0-ac78-20c3bc7bf024 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:32.585811 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6d0d7-7031-4fa0-ac78-20c3bc7bf024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:32.586081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6d0d7-7031-4fa0-ac78-20c3bc7bf024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:32.586732 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6d0d7-7031-4fa0-ac78-20c3bc7bf024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:32.588377 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6d0d7-7031-4fa0-ac78-20c3bc7bf024 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:32.600228 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1401/2832] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:19:32.604837 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4972d6-bc2c-4ede-a49f-86a1b7dff880 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:32.615838 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4972d6-bc2c-4ede-a49f-86a1b7dff880 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:32.621176 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94183a-92cb-4027-b638-10a70b0faa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:32.621840 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94183a-92cb-4027-b638-10a70b0faa25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:32.622811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94183a-92cb-4027-b638-10a70b0faa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:32.622811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94183a-92cb-4027-b638-10a70b0faa25 admin admin] PATH_INFO: `/v3/projects/7da2b216623a471d91a9f8fa8283e0f7/users/89b76b12edd449c0ac04049b2eec294a/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:32.638606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94183a-92cb-4027-b638-10a70b0faa25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da2b216623a471d91a9f8fa8283e0f7, user_id=89b76b12edd449c0ac04049b2eec294a, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:32.641335 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94183a-92cb-4027-b638-10a70b0faa25 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:32.654804 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1432/2833] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:19:32 2022] PUT /identity/v3/projects/7da2b216623a471d91a9f8fa8283e0f7/users/89b76b12edd449c0ac04049b2eec294a/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:32.659534 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6d0d7-7031-4fa0-ac78-20c3bc7bf024 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:32.669854 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6d0d7-7031-4fa0-ac78-20c3bc7bf024 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:32.728754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de445a-9961-4c07-af0d-00efd0a5c4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:32.729372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de445a-9961-4c07-af0d-00efd0a5c4cc admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:32.729641 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de445a-9961-4c07-af0d-00efd0a5c4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:32.729910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de445a-9961-4c07-af0d-00efd0a5c4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:32.730552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de445a-9961-4c07-af0d-00efd0a5c4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:32.732177 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de445a-9961-4c07-af0d-00efd0a5c4cc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:32.742876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1402/2834] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:19:32.747118 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94183a-92cb-4027-b638-10a70b0faa25 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:32.759727 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94183a-92cb-4027-b638-10a70b0faa25 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:32.765284 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48665995-e7a3-4321-af6b-c3ed7791cdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:32.765937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665995-e7a3-4321-af6b-c3ed7791cdaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:32.766208 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665995-e7a3-4321-af6b-c3ed7791cdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:32.766474 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665995-e7a3-4321-af6b-c3ed7791cdaf admin admin] PATH_INFO: `/v3/projects/7da2b216623a471d91a9f8fa8283e0f7/users/89b76b12edd449c0ac04049b2eec294a/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:32.768409 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48665995-e7a3-4321-af6b-c3ed7791cdaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da2b216623a471d91a9f8fa8283e0f7, user_id=89b76b12edd449c0ac04049b2eec294a, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:32.771005 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48665995-e7a3-4321-af6b-c3ed7791cdaf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:32.782173 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1433/2835] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:19:32 2022] PUT /identity/v3/projects/7da2b216623a471d91a9f8fa8283e0f7/users/89b76b12edd449c0ac04049b2eec294a/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:32.792528 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de78eb-8ad0-4c94-9f95-294918bb22cd None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:32.792862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de78eb-8ad0-4c94-9f95-294918bb22cd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:32.793073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de78eb-8ad0-4c94-9f95-294918bb22cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:32.945708 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b5de78eb-8ad0-4c94-9f95-294918bb22cd None None] MFA Rules not processed for user `89b76b12edd449c0ac04049b2eec294a`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:32.946942 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b5de78eb-8ad0-4c94-9f95-294918bb22cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:33.018581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1403/2836] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:32 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:19:33.029810 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48665995-e7a3-4321-af6b-c3ed7791cdaf admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:33.032179 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-48665995-e7a3-4321-af6b-c3ed7791cdaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:33.114574 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48665995-e7a3-4321-af6b-c3ed7791cdaf admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:33.118235 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abb734-7bab-4640-9b29-e939f0f82201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:33.118841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb734-7bab-4640-9b29-e939f0f82201 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:33.119115 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb734-7bab-4640-9b29-e939f0f82201 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:33.119383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb734-7bab-4640-9b29-e939f0f82201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:33.131121 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abb734-7bab-4640-9b29-e939f0f82201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:33.132739 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abb734-7bab-4640-9b29-e939f0f82201 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:33.143264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1434/2837] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:19:33 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:19:33.289069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de78eb-8ad0-4c94-9f95-294918bb22cd None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:33.306203 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:33.363682 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de78eb-8ad0-4c94-9f95-294918bb22cd None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:33.368171 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b3e70-5706-42f9-a415-caed052c52f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:33.368798 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b3e70-5706-42f9-a415-caed052c52f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:33.369069 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b3e70-5706-42f9-a415-caed052c52f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:33.369333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b3e70-5706-42f9-a415-caed052c52f8 admin admin] PATH_INFO: `/v3/users/fe7996e0966f4673936a248b7a1475b2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:33.370440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b3e70-5706-42f9-a415-caed052c52f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7996e0966f4673936a248b7a1475b2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:33.372405 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b3e70-5706-42f9-a415-caed052c52f8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:33.420450 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-868b3e70-5706-42f9-a415-caed052c52f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7996e0966f4673936a248b7a1475b2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:33.432113 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-868b3e70-5706-42f9-a415-caed052c52f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7996e0966f4673936a248b7a1475b2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:33.439288 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-868b3e70-5706-42f9-a415-caed052c52f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7996e0966f4673936a248b7a1475b2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:33.439975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-868b3e70-5706-42f9-a415-caed052c52f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7996e0966f4673936a248b7a1475b2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:33.440562 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-868b3e70-5706-42f9-a415-caed052c52f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7996e0966f4673936a248b7a1475b2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:33.453607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1404/2838] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:19:33 2022] DELETE /identity/v3/users/fe7996e0966f4673936a248b7a1475b2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:33.458178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c81b82-e1e2-40af-a493-237a3cd244e2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:33.458668 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c81b82-e1e2-40af-a493-237a3cd244e2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:33.458782 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c81b82-e1e2-40af-a493-237a3cd244e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:33.477361 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-25c81b82-e1e2-40af-a493-237a3cd244e2 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:33.478558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-25c81b82-e1e2-40af-a493-237a3cd244e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:33.538472 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1435/2839] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:33.548914 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b3e70-5706-42f9-a415-caed052c52f8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:33.550345 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-868b3e70-5706-42f9-a415-caed052c52f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:33.635608 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b3e70-5706-42f9-a415-caed052c52f8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:33.639381 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32c7f6-070b-4f16-8159-bccc53f392ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:33.640006 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32c7f6-070b-4f16-8159-bccc53f392ca service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:33.640277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32c7f6-070b-4f16-8159-bccc53f392ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:33.640538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32c7f6-070b-4f16-8159-bccc53f392ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:33.649857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32c7f6-070b-4f16-8159-bccc53f392ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:33.651271 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32c7f6-070b-4f16-8159-bccc53f392ca service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:33.662382 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1405/2840] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:19:33.953717 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c81b82-e1e2-40af-a493-237a3cd244e2 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:33.955577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-25c81b82-e1e2-40af-a493-237a3cd244e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:33.968281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c81b82-e1e2-40af-a493-237a3cd244e2 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:33.973161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29881dec-65e3-4df0-b7a8-7da00a0f01f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:33.973818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29881dec-65e3-4df0-b7a8-7da00a0f01f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:33.974076 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29881dec-65e3-4df0-b7a8-7da00a0f01f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:33.974352 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29881dec-65e3-4df0-b7a8-7da00a0f01f2 admin admin] PATH_INFO: `/v3/projects/ec3da811ae2843f3a23a5e2d1d6ff909` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:33.975470 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29881dec-65e3-4df0-b7a8-7da00a0f01f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec3da811ae2843f3a23a5e2d1d6ff909)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:33.977407 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29881dec-65e3-4df0-b7a8-7da00a0f01f2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:34.003008 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:34.029233 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-29881dec-65e3-4df0-b7a8-7da00a0f01f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3da811ae2843f3a23a5e2d1d6ff909', 'request_id': 'req-29881dec-65e3-4df0-b7a8-7da00a0f01f2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:34.037623 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-29881dec-65e3-4df0-b7a8-7da00a0f01f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3da811ae2843f3a23a5e2d1d6ff909', 'request_id': 'req-29881dec-65e3-4df0-b7a8-7da00a0f01f2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:34.046352 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-29881dec-65e3-4df0-b7a8-7da00a0f01f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3da811ae2843f3a23a5e2d1d6ff909', 'request_id': 'req-29881dec-65e3-4df0-b7a8-7da00a0f01f2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:34.058210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-29881dec-65e3-4df0-b7a8-7da00a0f01f2 admin admin] The token cache is being invalidate because project ec3da811ae2843f3a23a5e2d1d6ff909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:19:34.058500 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-29881dec-65e3-4df0-b7a8-7da00a0f01f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:34.059149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-29881dec-65e3-4df0-b7a8-7da00a0f01f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:34.060679 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1436/2841] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:19:33 2022] DELETE /identity/v3/projects/ec3da811ae2843f3a23a5e2d1d6ff909 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:34.065250 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32c7f6-070b-4f16-8159-bccc53f392ca service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:34.075243 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32c7f6-070b-4f16-8159-bccc53f392ca service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:34.087987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:34.137088 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbab4db-d834-47aa-b14f-6001f9bd0e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:34.137723 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbab4db-d834-47aa-b14f-6001f9bd0e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:34.137993 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbab4db-d834-47aa-b14f-6001f9bd0e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:34.138263 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbab4db-d834-47aa-b14f-6001f9bd0e63 admin admin] PATH_INFO: `/v3/users/89b76b12edd449c0ac04049b2eec294a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:34.139427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbab4db-d834-47aa-b14f-6001f9bd0e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b76b12edd449c0ac04049b2eec294a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:34.141358 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbab4db-d834-47aa-b14f-6001f9bd0e63 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:34.191049 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1fbab4db-d834-47aa-b14f-6001f9bd0e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b76b12edd449c0ac04049b2eec294a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:34.203352 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1fbab4db-d834-47aa-b14f-6001f9bd0e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b76b12edd449c0ac04049b2eec294a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:34.210438 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1fbab4db-d834-47aa-b14f-6001f9bd0e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b76b12edd449c0ac04049b2eec294a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:34.211185 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1fbab4db-d834-47aa-b14f-6001f9bd0e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b76b12edd449c0ac04049b2eec294a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:34.211789 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1fbab4db-d834-47aa-b14f-6001f9bd0e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b76b12edd449c0ac04049b2eec294a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:34.240411 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1406/2842] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:19:34 2022] DELETE /identity/v3/users/89b76b12edd449c0ac04049b2eec294a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:34.534516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29881dec-65e3-4df0-b7a8-7da00a0f01f2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:34.536105 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-29881dec-65e3-4df0-b7a8-7da00a0f01f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:34.559051 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29881dec-65e3-4df0-b7a8-7da00a0f01f2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:34.619394 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e028e22-188d-46b7-8895-c5b7c346a2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:34.620228 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e028e22-188d-46b7-8895-c5b7c346a2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:34.620595 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e028e22-188d-46b7-8895-c5b7c346a2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:34.620974 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e028e22-188d-46b7-8895-c5b7c346a2f2 admin admin] PATH_INFO: `/v3/projects/7da2b216623a471d91a9f8fa8283e0f7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:34.622269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e028e22-188d-46b7-8895-c5b7c346a2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da2b216623a471d91a9f8fa8283e0f7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:34.625538 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e028e22-188d-46b7-8895-c5b7c346a2f2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:34.670367 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7e028e22-188d-46b7-8895-c5b7c346a2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da2b216623a471d91a9f8fa8283e0f7', 'request_id': 'req-7e028e22-188d-46b7-8895-c5b7c346a2f2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:34.676429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7e028e22-188d-46b7-8895-c5b7c346a2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da2b216623a471d91a9f8fa8283e0f7', 'request_id': 'req-7e028e22-188d-46b7-8895-c5b7c346a2f2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:34.683531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7e028e22-188d-46b7-8895-c5b7c346a2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da2b216623a471d91a9f8fa8283e0f7', 'request_id': 'req-7e028e22-188d-46b7-8895-c5b7c346a2f2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:34.694979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7e028e22-188d-46b7-8895-c5b7c346a2f2 admin admin] The token cache is being invalidate because project 7da2b216623a471d91a9f8fa8283e0f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:19:34.695257 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7e028e22-188d-46b7-8895-c5b7c346a2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:34.695903 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7e028e22-188d-46b7-8895-c5b7c346a2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:34.697378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1437/2843] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:19:34 2022] DELETE /identity/v3/projects/7da2b216623a471d91a9f8fa8283e0f7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:34.703083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5dc37-46cc-45cd-b50c-978632aa2647 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:34.703569 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5dc37-46cc-45cd-b50c-978632aa2647 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:34.703775 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5dc37-46cc-45cd-b50c-978632aa2647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:34.723318 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0df5dc37-46cc-45cd-b50c-978632aa2647 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:34.724549 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0df5dc37-46cc-45cd-b50c-978632aa2647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:34.783365 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1407/2844] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:34.791089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0ce0a-0f9a-47da-84ac-b42292e3fb15 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:34.791375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0ce0a-0f9a-47da-84ac-b42292e3fb15 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:34.791645 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0ce0a-0f9a-47da-84ac-b42292e3fb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:34.811856 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-faf0ce0a-0f9a-47da-84ac-b42292e3fb15 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:34.813193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-faf0ce0a-0f9a-47da-84ac-b42292e3fb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:34.824425 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1438/2845] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:34.829165 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5dc37-46cc-45cd-b50c-978632aa2647 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:34.840817 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5dc37-46cc-45cd-b50c-978632aa2647 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:34.845871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48d0f1-3e68-4719-b474-1f48e93150b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:34.846468 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48d0f1-3e68-4719-b474-1f48e93150b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:34.846745 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48d0f1-3e68-4719-b474-1f48e93150b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:34.847012 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48d0f1-3e68-4719-b474-1f48e93150b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:34.847680 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48d0f1-3e68-4719-b474-1f48e93150b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:19:34.848026 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48d0f1-3e68-4719-b474-1f48e93150b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:34.849579 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48d0f1-3e68-4719-b474-1f48e93150b4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:34.861554 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1408/2846] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:19:34.866058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0ce0a-0f9a-47da-84ac-b42292e3fb15 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:34.875882 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0ce0a-0f9a-47da-84ac-b42292e3fb15 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:34.880595 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade957f-1ac2-47e8-aa20-50edec785e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:34.881191 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade957f-1ac2-47e8-aa20-50edec785e29 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:34.881469 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade957f-1ac2-47e8-aa20-50edec785e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:34.881741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade957f-1ac2-47e8-aa20-50edec785e29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:34.882378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade957f-1ac2-47e8-aa20-50edec785e29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:34.884304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade957f-1ac2-47e8-aa20-50edec785e29 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:34.913017 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1439/2847] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:19:34 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:34.917329 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48d0f1-3e68-4719-b474-1f48e93150b4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:34.927972 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48d0f1-3e68-4719-b474-1f48e93150b4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:34.946316 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:34.985214 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a551e-0a90-4ae9-8362-17573c6aa00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:34.985826 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a551e-0a90-4ae9-8362-17573c6aa00f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:34.986103 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a551e-0a90-4ae9-8362-17573c6aa00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:34.986372 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a551e-0a90-4ae9-8362-17573c6aa00f admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:34.986997 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a551e-0a90-4ae9-8362-17573c6aa00f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:34.989175 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a551e-0a90-4ae9-8362-17573c6aa00f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:35.012030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1409/2848] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:19:34 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:19:35.016936 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade957f-1ac2-47e8-aa20-50edec785e29 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:35.027264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade957f-1ac2-47e8-aa20-50edec785e29 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:35.032686 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf1920-f43b-469b-b523-b625594a7ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:35.033355 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf1920-f43b-469b-b523-b625594a7ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:35.033652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf1920-f43b-469b-b523-b625594a7ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:35.033853 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf1920-f43b-469b-b523-b625594a7ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:35.034514 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf1920-f43b-469b-b523-b625594a7ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:35.036150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf1920-f43b-469b-b523-b625594a7ed0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:35.041895 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:35.047196 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1440/2849] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:19:35.051112 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a551e-0a90-4ae9-8362-17573c6aa00f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:35.060924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a551e-0a90-4ae9-8362-17573c6aa00f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:35.065677 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff365b-d22a-4c93-95fe-a2f9c6e022e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:35.066276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff365b-d22a-4c93-95fe-a2f9c6e022e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:35.066552 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff365b-d22a-4c93-95fe-a2f9c6e022e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:35.066823 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff365b-d22a-4c93-95fe-a2f9c6e022e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:35.067459 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff365b-d22a-4c93-95fe-a2f9c6e022e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:35.069075 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff365b-d22a-4c93-95fe-a2f9c6e022e6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:35.079910 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1410/2850] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:19:35.083998 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf1920-f43b-469b-b523-b625594a7ed0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:35.094465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf1920-f43b-469b-b523-b625594a7ed0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:35.099271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13d740-02ca-4605-a8b9-e215749a626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:35.099969 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13d740-02ca-4605-a8b9-e215749a626e admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:35.100255 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13d740-02ca-4605-a8b9-e215749a626e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:35.100531 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13d740-02ca-4605-a8b9-e215749a626e admin admin] PATH_INFO: `/v3/projects/12eab706282e4a23a1d9ccfa22a50e5c/users/47a9997d30d84b3b9704d0fe3f2b8fd5/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:35.115659 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13d740-02ca-4605-a8b9-e215749a626e admin admin] RBAC: Authorizing `identity:create_grant(project_id=12eab706282e4a23a1d9ccfa22a50e5c, user_id=47a9997d30d84b3b9704d0fe3f2b8fd5, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:35.118301 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13d740-02ca-4605-a8b9-e215749a626e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:35.131331 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1441/2851] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:19:35 2022] PUT /identity/v3/projects/12eab706282e4a23a1d9ccfa22a50e5c/users/47a9997d30d84b3b9704d0fe3f2b8fd5/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:35.143096 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6679c-5ab1-4244-94b4-ef1859316c29 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:35.143379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6679c-5ab1-4244-94b4-ef1859316c29 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:35.143647 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6679c-5ab1-4244-94b4-ef1859316c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:35.172213 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1cd6679c-5ab1-4244-94b4-ef1859316c29 None None] MFA Rules not processed for user `47a9997d30d84b3b9704d0fe3f2b8fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:35.173423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1cd6679c-5ab1-4244-94b4-ef1859316c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:35.236580 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1411/2852] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:35.240999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13d740-02ca-4605-a8b9-e215749a626e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:35.308460 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13d740-02ca-4605-a8b9-e215749a626e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:35.313310 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a611bfe-b863-439f-a276-f1835b565b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:35.314006 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a611bfe-b863-439f-a276-f1835b565b8d admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:35.314238 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a611bfe-b863-439f-a276-f1835b565b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:35.314509 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a611bfe-b863-439f-a276-f1835b565b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:35.315150 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a611bfe-b863-439f-a276-f1835b565b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:35.317072 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a611bfe-b863-439f-a276-f1835b565b8d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:35.344410 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1442/2853] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:19:35 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:35.348511 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6679c-5ab1-4244-94b4-ef1859316c29 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:35.359021 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6679c-5ab1-4244-94b4-ef1859316c29 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:35.414945 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f457bf-e0f4-4248-84e0-0a185b270335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:35.415548 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f457bf-e0f4-4248-84e0-0a185b270335 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:35.415825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f457bf-e0f4-4248-84e0-0a185b270335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:35.416134 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f457bf-e0f4-4248-84e0-0a185b270335 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:35.416754 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f457bf-e0f4-4248-84e0-0a185b270335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:35.418646 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f457bf-e0f4-4248-84e0-0a185b270335 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:35.439707 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1412/2854] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:19:35 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:35.443783 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a611bfe-b863-439f-a276-f1835b565b8d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:35.454863 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a611bfe-b863-439f-a276-f1835b565b8d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:35.459472 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af794b2d-3f19-4a69-b3d0-7c373770e958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:35.460104 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af794b2d-3f19-4a69-b3d0-7c373770e958 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:35.460379 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af794b2d-3f19-4a69-b3d0-7c373770e958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:35.460664 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af794b2d-3f19-4a69-b3d0-7c373770e958 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:35.461273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af794b2d-3f19-4a69-b3d0-7c373770e958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:35.462844 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af794b2d-3f19-4a69-b3d0-7c373770e958 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:35.473169 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1443/2855] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:19:35.477354 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f457bf-e0f4-4248-84e0-0a185b270335 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:35.487176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f457bf-e0f4-4248-84e0-0a185b270335 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:35.494041 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d2f22-b418-41b0-bcf2-e9d740dbc9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:35.494730 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d2f22-b418-41b0-bcf2-e9d740dbc9cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:35.495032 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d2f22-b418-41b0-bcf2-e9d740dbc9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:35.495304 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d2f22-b418-41b0-bcf2-e9d740dbc9cb admin admin] PATH_INFO: `/v3/projects/18760b37a0334f24adca9e97f352cd99/users/3940fa31af3d4957b2c9cc5fe0d2b5bc/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:35.511366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d2f22-b418-41b0-bcf2-e9d740dbc9cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=18760b37a0334f24adca9e97f352cd99, user_id=3940fa31af3d4957b2c9cc5fe0d2b5bc, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:35.514073 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d2f22-b418-41b0-bcf2-e9d740dbc9cb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:35.518126 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:35.531121 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1413/2856] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:19:35 2022] PUT /identity/v3/projects/18760b37a0334f24adca9e97f352cd99/users/3940fa31af3d4957b2c9cc5fe0d2b5bc/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:19:35.535178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af794b2d-3f19-4a69-b3d0-7c373770e958 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:35.545300 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af794b2d-3f19-4a69-b3d0-7c373770e958 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:35.602304 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289c5ee-7cbe-4e2c-949c-a60f6e4b8061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:35.602915 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289c5ee-7cbe-4e2c-949c-a60f6e4b8061 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:35.603194 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289c5ee-7cbe-4e2c-949c-a60f6e4b8061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:35.603465 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289c5ee-7cbe-4e2c-949c-a60f6e4b8061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:35.604161 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289c5ee-7cbe-4e2c-949c-a60f6e4b8061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:35.605746 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289c5ee-7cbe-4e2c-949c-a60f6e4b8061 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:35.615784 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1444/2857] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:19:35.619882 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d2f22-b418-41b0-bcf2-e9d740dbc9cb admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:35.631491 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d2f22-b418-41b0-bcf2-e9d740dbc9cb admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:35.636063 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7f1e8-da31-4983-ae5e-4469171f2b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:35.636707 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7f1e8-da31-4983-ae5e-4469171f2b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:35.636982 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7f1e8-da31-4983-ae5e-4469171f2b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:35.637252 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7f1e8-da31-4983-ae5e-4469171f2b05 admin admin] PATH_INFO: `/v3/projects/18760b37a0334f24adca9e97f352cd99/users/3940fa31af3d4957b2c9cc5fe0d2b5bc/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:35.639134 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7f1e8-da31-4983-ae5e-4469171f2b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18760b37a0334f24adca9e97f352cd99, user_id=3940fa31af3d4957b2c9cc5fe0d2b5bc, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:35.642417 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7f1e8-da31-4983-ae5e-4469171f2b05 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:35.652452 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1414/2858] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:19:35 2022] PUT /identity/v3/projects/18760b37a0334f24adca9e97f352cd99/users/3940fa31af3d4957b2c9cc5fe0d2b5bc/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:35.662402 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1227cd-85ac-4355-acb3-715735d89706 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:35.662684 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1227cd-85ac-4355-acb3-715735d89706 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:35.662979 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1227cd-85ac-4355-acb3-715735d89706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:35.690260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-da1227cd-85ac-4355-acb3-715735d89706 None None] MFA Rules not processed for user `3940fa31af3d4957b2c9cc5fe0d2b5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:35.691473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-da1227cd-85ac-4355-acb3-715735d89706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:35.724398 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:35.759330 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1445/2859] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:19:35.770717 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7f1e8-da31-4983-ae5e-4469171f2b05 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:35.772508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e5d7f1e8-da31-4983-ae5e-4469171f2b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:35.831385 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7f1e8-da31-4983-ae5e-4469171f2b05 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:35.834987 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb05858-59ab-4123-9092-be35d31e4178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:35.835586 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb05858-59ab-4123-9092-be35d31e4178 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:35.835862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb05858-59ab-4123-9092-be35d31e4178 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:35.836186 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb05858-59ab-4123-9092-be35d31e4178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:35.845321 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb05858-59ab-4123-9092-be35d31e4178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:35.846781 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb05858-59ab-4123-9092-be35d31e4178 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:35.856140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1415/2860] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:19:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:19:35.885378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1227cd-85ac-4355-acb3-715735d89706 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:35.949625 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1227cd-85ac-4355-acb3-715735d89706 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:35.954574 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba2aa2-2ea8-4ae2-8346-92f18a7b1885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:35.955209 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba2aa2-2ea8-4ae2-8346-92f18a7b1885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:35.955487 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba2aa2-2ea8-4ae2-8346-92f18a7b1885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:35.955760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba2aa2-2ea8-4ae2-8346-92f18a7b1885 admin admin] PATH_INFO: `/v3/users/47a9997d30d84b3b9704d0fe3f2b8fd5` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:35.956930 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba2aa2-2ea8-4ae2-8346-92f18a7b1885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a9997d30d84b3b9704d0fe3f2b8fd5)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:35.958840 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba2aa2-2ea8-4ae2-8346-92f18a7b1885 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:36.004936 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-45ba2aa2-2ea8-4ae2-8346-92f18a7b1885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a9997d30d84b3b9704d0fe3f2b8fd5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:36.012086 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-45ba2aa2-2ea8-4ae2-8346-92f18a7b1885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a9997d30d84b3b9704d0fe3f2b8fd5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:36.019747 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-45ba2aa2-2ea8-4ae2-8346-92f18a7b1885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a9997d30d84b3b9704d0fe3f2b8fd5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:36.020405 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-45ba2aa2-2ea8-4ae2-8346-92f18a7b1885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a9997d30d84b3b9704d0fe3f2b8fd5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:36.032415 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-45ba2aa2-2ea8-4ae2-8346-92f18a7b1885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a9997d30d84b3b9704d0fe3f2b8fd5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:36.038309 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1446/2861] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:19:35 2022] DELETE /identity/v3/users/47a9997d30d84b3b9704d0fe3f2b8fd5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:36.042747 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3603ca-05f8-44e1-8548-0d60c97aae3c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:36.043061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3603ca-05f8-44e1-8548-0d60c97aae3c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:36.043333 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3603ca-05f8-44e1-8548-0d60c97aae3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:36.063787 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-eb3603ca-05f8-44e1-8548-0d60c97aae3c None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:36.065005 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-eb3603ca-05f8-44e1-8548-0d60c97aae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:36.123007 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1416/2862] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:36.133640 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba2aa2-2ea8-4ae2-8346-92f18a7b1885 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:36.135056 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-45ba2aa2-2ea8-4ae2-8346-92f18a7b1885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:36.192507 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba2aa2-2ea8-4ae2-8346-92f18a7b1885 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:36.196131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade1c2f-810f-43d9-9e09-0725c2b62ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:36.196839 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade1c2f-810f-43d9-9e09-0725c2b62ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:36.197123 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade1c2f-810f-43d9-9e09-0725c2b62ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:36.197392 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade1c2f-810f-43d9-9e09-0725c2b62ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:36.203184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:36.213271 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade1c2f-810f-43d9-9e09-0725c2b62ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:36.214709 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade1c2f-810f-43d9-9e09-0725c2b62ba8 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:36.225221 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1447/2863] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:19:36.497307 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3603ca-05f8-44e1-8548-0d60c97aae3c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:36.498760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-eb3603ca-05f8-44e1-8548-0d60c97aae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:36.511112 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3603ca-05f8-44e1-8548-0d60c97aae3c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:36.516452 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3fdef-fcdf-4af6-b109-745278e7d635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:36.517170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3fdef-fcdf-4af6-b109-745278e7d635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:36.517509 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3fdef-fcdf-4af6-b109-745278e7d635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:36.517780 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3fdef-fcdf-4af6-b109-745278e7d635 admin admin] PATH_INFO: `/v3/projects/12eab706282e4a23a1d9ccfa22a50e5c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:36.518986 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3fdef-fcdf-4af6-b109-745278e7d635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12eab706282e4a23a1d9ccfa22a50e5c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:36.520979 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3fdef-fcdf-4af6-b109-745278e7d635 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:36.571832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-80a3fdef-fcdf-4af6-b109-745278e7d635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12eab706282e4a23a1d9ccfa22a50e5c', 'request_id': 'req-80a3fdef-fcdf-4af6-b109-745278e7d635'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:36.578517 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-80a3fdef-fcdf-4af6-b109-745278e7d635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12eab706282e4a23a1d9ccfa22a50e5c', 'request_id': 'req-80a3fdef-fcdf-4af6-b109-745278e7d635'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:36.584292 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-80a3fdef-fcdf-4af6-b109-745278e7d635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12eab706282e4a23a1d9ccfa22a50e5c', 'request_id': 'req-80a3fdef-fcdf-4af6-b109-745278e7d635'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:36.596917 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-80a3fdef-fcdf-4af6-b109-745278e7d635 admin admin] The token cache is being invalidate because project 12eab706282e4a23a1d9ccfa22a50e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:19:36.597228 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-80a3fdef-fcdf-4af6-b109-745278e7d635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:36.597870 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-80a3fdef-fcdf-4af6-b109-745278e7d635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:36.599797 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1417/2864] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:19:36 2022] DELETE /identity/v3/projects/12eab706282e4a23a1d9ccfa22a50e5c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:36.603378 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade1c2f-810f-43d9-9e09-0725c2b62ba8 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:36.614265 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade1c2f-810f-43d9-9e09-0725c2b62ba8 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:36.676159 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dcfb7-e636-4aeb-bda6-556aa6567e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:36.676704 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dcfb7-e636-4aeb-bda6-556aa6567e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:36.676981 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dcfb7-e636-4aeb-bda6-556aa6567e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:36.677252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dcfb7-e636-4aeb-bda6-556aa6567e6f admin admin] PATH_INFO: `/v3/users/3940fa31af3d4957b2c9cc5fe0d2b5bc` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:36.678372 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9dcfb7-e636-4aeb-bda6-556aa6567e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3940fa31af3d4957b2c9cc5fe0d2b5bc)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:36.680332 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9dcfb7-e636-4aeb-bda6-556aa6567e6f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:36.730045 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3d9dcfb7-e636-4aeb-bda6-556aa6567e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3940fa31af3d4957b2c9cc5fe0d2b5bc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:36.737270 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3d9dcfb7-e636-4aeb-bda6-556aa6567e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3940fa31af3d4957b2c9cc5fe0d2b5bc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:36.746603 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3d9dcfb7-e636-4aeb-bda6-556aa6567e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3940fa31af3d4957b2c9cc5fe0d2b5bc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:36.746811 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3d9dcfb7-e636-4aeb-bda6-556aa6567e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3940fa31af3d4957b2c9cc5fe0d2b5bc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:36.761007 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3d9dcfb7-e636-4aeb-bda6-556aa6567e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3940fa31af3d4957b2c9cc5fe0d2b5bc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:36.767742 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1448/2865] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:19:36 2022] DELETE /identity/v3/users/3940fa31af3d4957b2c9cc5fe0d2b5bc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:19:37.069955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3fdef-fcdf-4af6-b109-745278e7d635 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:37.071467 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-80a3fdef-fcdf-4af6-b109-745278e7d635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:37.090078 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3fdef-fcdf-4af6-b109-745278e7d635 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:37.098583 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:37.168047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2783f3-4187-4dca-9dce-46997f5b1d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:37.168682 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2783f3-4187-4dca-9dce-46997f5b1d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:37.168959 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2783f3-4187-4dca-9dce-46997f5b1d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:37.169245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2783f3-4187-4dca-9dce-46997f5b1d38 admin admin] PATH_INFO: `/v3/projects/18760b37a0334f24adca9e97f352cd99` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:37.170367 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2783f3-4187-4dca-9dce-46997f5b1d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18760b37a0334f24adca9e97f352cd99)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:37.172303 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2783f3-4187-4dca-9dce-46997f5b1d38 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:37.227575 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8a2783f3-4187-4dca-9dce-46997f5b1d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18760b37a0334f24adca9e97f352cd99', 'request_id': 'req-8a2783f3-4187-4dca-9dce-46997f5b1d38'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:37.234824 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8a2783f3-4187-4dca-9dce-46997f5b1d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18760b37a0334f24adca9e97f352cd99', 'request_id': 'req-8a2783f3-4187-4dca-9dce-46997f5b1d38'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:37.240446 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8a2783f3-4187-4dca-9dce-46997f5b1d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18760b37a0334f24adca9e97f352cd99', 'request_id': 'req-8a2783f3-4187-4dca-9dce-46997f5b1d38'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:37.255246 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8a2783f3-4187-4dca-9dce-46997f5b1d38 admin admin] The token cache is being invalidate because project 18760b37a0334f24adca9e97f352cd99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:19:37.255531 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8a2783f3-4187-4dca-9dce-46997f5b1d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:37.256194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8a2783f3-4187-4dca-9dce-46997f5b1d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:37.257697 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1418/2866] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:19:37 2022] DELETE /identity/v3/projects/18760b37a0334f24adca9e97f352cd99 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:37.263454 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb8db6-67db-4248-8e49-6f2f5d33e66a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:37.263760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb8db6-67db-4248-8e49-6f2f5d33e66a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:37.264789 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb8db6-67db-4248-8e49-6f2f5d33e66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:37.285992 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9ebb8db6-67db-4248-8e49-6f2f5d33e66a None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:37.286917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9ebb8db6-67db-4248-8e49-6f2f5d33e66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:37.351058 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1449/2867] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:37.360330 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dc2b8-a5eb-49e1-8f76-799255015542 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:37.360607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dc2b8-a5eb-49e1-8f76-799255015542 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:37.360874 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dc2b8-a5eb-49e1-8f76-799255015542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:37.381767 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-069dc2b8-a5eb-49e1-8f76-799255015542 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:37.382976 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-069dc2b8-a5eb-49e1-8f76-799255015542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:37.391628 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1419/2868] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:19:37.396047 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb8db6-67db-4248-8e49-6f2f5d33e66a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:37.405655 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb8db6-67db-4248-8e49-6f2f5d33e66a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:37.410283 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcd559-6329-4fcd-a7da-67c8b0bab0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:37.410887 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcd559-6329-4fcd-a7da-67c8b0bab0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:37.411156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcd559-6329-4fcd-a7da-67c8b0bab0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:37.411419 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcd559-6329-4fcd-a7da-67c8b0bab0b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:37.412075 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcd559-6329-4fcd-a7da-67c8b0bab0b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:19:37.412399 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcd559-6329-4fcd-a7da-67c8b0bab0b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:37.413984 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcd559-6329-4fcd-a7da-67c8b0bab0b6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:37.424958 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:37.428920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1450/2869] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:19:37.433200 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069dc2b8-a5eb-49e1-8f76-799255015542 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:37.443301 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069dc2b8-a5eb-49e1-8f76-799255015542 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:37.448618 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bea83-e966-4bd7-a178-4be4b9aaa921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:37.449222 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bea83-e966-4bd7-a178-4be4b9aaa921 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:37.449496 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bea83-e966-4bd7-a178-4be4b9aaa921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:37.449792 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bea83-e966-4bd7-a178-4be4b9aaa921 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:37.450428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bea83-e966-4bd7-a178-4be4b9aaa921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:37.452889 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bea83-e966-4bd7-a178-4be4b9aaa921 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:37.486351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1420/2870] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:19:37 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:37.494593 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcd559-6329-4fcd-a7da-67c8b0bab0b6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:37.509424 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcd559-6329-4fcd-a7da-67c8b0bab0b6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:37.567790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab65696-680e-4e39-8a6a-fad71c85e01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:37.568463 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab65696-680e-4e39-8a6a-fad71c85e01d admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:37.568741 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab65696-680e-4e39-8a6a-fad71c85e01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:37.569013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab65696-680e-4e39-8a6a-fad71c85e01d admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:37.569656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab65696-680e-4e39-8a6a-fad71c85e01d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:37.571558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab65696-680e-4e39-8a6a-fad71c85e01d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:37.593614 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1451/2871] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:19:37 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:19:37.597698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bea83-e966-4bd7-a178-4be4b9aaa921 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:37.608523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bea83-e966-4bd7-a178-4be4b9aaa921 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:37.613357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d852c-0842-473b-be25-7692e7ed919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:37.613955 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d852c-0842-473b-be25-7692e7ed919d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:37.614223 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d852c-0842-473b-be25-7692e7ed919d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:37.614492 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d852c-0842-473b-be25-7692e7ed919d admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:37.615134 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d852c-0842-473b-be25-7692e7ed919d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:37.616759 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d852c-0842-473b-be25-7692e7ed919d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:37.629414 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1421/2872] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:19:37.632324 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab65696-680e-4e39-8a6a-fad71c85e01d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:37.642544 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab65696-680e-4e39-8a6a-fad71c85e01d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:37.647288 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742d3b5-2f77-4f02-9a78-783e1322bfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:37.647931 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742d3b5-2f77-4f02-9a78-783e1322bfea admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:37.648231 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742d3b5-2f77-4f02-9a78-783e1322bfea admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:37.648502 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742d3b5-2f77-4f02-9a78-783e1322bfea admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:37.649230 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742d3b5-2f77-4f02-9a78-783e1322bfea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:37.650818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742d3b5-2f77-4f02-9a78-783e1322bfea admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:37.662599 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1452/2873] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:19:37.668553 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d852c-0842-473b-be25-7692e7ed919d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:37.680872 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d852c-0842-473b-be25-7692e7ed919d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:37.685716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7bedd-fc1d-4732-b255-bea23d568bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:37.686395 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7bedd-fc1d-4732-b255-bea23d568bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:37.686672 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7bedd-fc1d-4732-b255-bea23d568bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:37.686930 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7bedd-fc1d-4732-b255-bea23d568bd1 admin admin] PATH_INFO: `/v3/projects/baee42cdf046495187eed2977ef4f05a/users/43a45d0264a148bba0bd7ba869fd3b6f/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:37.702793 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7bedd-fc1d-4732-b255-bea23d568bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baee42cdf046495187eed2977ef4f05a, user_id=43a45d0264a148bba0bd7ba869fd3b6f, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:37.705478 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7bedd-fc1d-4732-b255-bea23d568bd1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:37.719878 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1422/2874] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:19:37 2022] PUT /identity/v3/projects/baee42cdf046495187eed2977ef4f05a/users/43a45d0264a148bba0bd7ba869fd3b6f/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:37.730254 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421cd16-99f8-4077-8e27-8b64ecd5aec5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:37.730676 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421cd16-99f8-4077-8e27-8b64ecd5aec5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:37.731040 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421cd16-99f8-4077-8e27-8b64ecd5aec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:37.763686 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a421cd16-99f8-4077-8e27-8b64ecd5aec5 None None] MFA Rules not processed for user `43a45d0264a148bba0bd7ba869fd3b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:37.764910 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a421cd16-99f8-4077-8e27-8b64ecd5aec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:37.837637 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1453/2875] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:37.842802 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7bedd-fc1d-4732-b255-bea23d568bd1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:37.884992 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:37.910324 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7bedd-fc1d-4732-b255-bea23d568bd1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:37.915015 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177ea19-f2ae-4c7f-aae2-e99d0c1f61ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:37.916349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177ea19-f2ae-4c7f-aae2-e99d0c1f61ef admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:37.916349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177ea19-f2ae-4c7f-aae2-e99d0c1f61ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:37.916349 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177ea19-f2ae-4c7f-aae2-e99d0c1f61ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:37.918952 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177ea19-f2ae-4c7f-aae2-e99d0c1f61ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:37.918952 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177ea19-f2ae-4c7f-aae2-e99d0c1f61ef admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:37.948054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1423/2876] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:19:37 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:37.957869 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421cd16-99f8-4077-8e27-8b64ecd5aec5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:37.971681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421cd16-99f8-4077-8e27-8b64ecd5aec5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:38.035219 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699de0ff-9349-429e-afa7-83bc28fecb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:38.035759 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699de0ff-9349-429e-afa7-83bc28fecb5a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:38.036067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699de0ff-9349-429e-afa7-83bc28fecb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:38.036345 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699de0ff-9349-429e-afa7-83bc28fecb5a admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:38.036982 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699de0ff-9349-429e-afa7-83bc28fecb5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:38.038911 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699de0ff-9349-429e-afa7-83bc28fecb5a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:38.059678 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:38.069845 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1454/2877] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:19:37 2022] POST /identity/v3/users => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:38.071053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177ea19-f2ae-4c7f-aae2-e99d0c1f61ef admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:38.082391 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177ea19-f2ae-4c7f-aae2-e99d0c1f61ef admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:38.087312 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427d31e-0b96-4f12-bbf4-7d39432da945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:38.087929 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427d31e-0b96-4f12-bbf4-7d39432da945 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:38.088232 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427d31e-0b96-4f12-bbf4-7d39432da945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:38.088527 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427d31e-0b96-4f12-bbf4-7d39432da945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:38.089172 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427d31e-0b96-4f12-bbf4-7d39432da945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:38.090749 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427d31e-0b96-4f12-bbf4-7d39432da945 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:38.101785 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1424/2878] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:19:38.105835 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699de0ff-9349-429e-afa7-83bc28fecb5a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:38.115777 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699de0ff-9349-429e-afa7-83bc28fecb5a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:38.120375 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69719ca-e1a4-4c24-b370-744bacc842c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:38.121011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69719ca-e1a4-4c24-b370-744bacc842c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:38.121287 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69719ca-e1a4-4c24-b370-744bacc842c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:38.121554 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69719ca-e1a4-4c24-b370-744bacc842c3 admin admin] PATH_INFO: `/v3/projects/e2252d02460a4de9b669c1409f07bb07/users/86796165590c4199b132adb37eb196c8/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:38.136221 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69719ca-e1a4-4c24-b370-744bacc842c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2252d02460a4de9b669c1409f07bb07, user_id=86796165590c4199b132adb37eb196c8, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:38.138832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69719ca-e1a4-4c24-b370-744bacc842c3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:38.152379 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1455/2879] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:19:38 2022] PUT /identity/v3/projects/e2252d02460a4de9b669c1409f07bb07/users/86796165590c4199b132adb37eb196c8/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:19:38.156975 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427d31e-0b96-4f12-bbf4-7d39432da945 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:38.166927 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427d31e-0b96-4f12-bbf4-7d39432da945 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:38.222220 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37843e6-5302-4d52-a8a8-6758ddf71464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:38.222809 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37843e6-5302-4d52-a8a8-6758ddf71464 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:38.223083 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37843e6-5302-4d52-a8a8-6758ddf71464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:38.223351 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37843e6-5302-4d52-a8a8-6758ddf71464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:38.223998 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37843e6-5302-4d52-a8a8-6758ddf71464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:38.225569 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37843e6-5302-4d52-a8a8-6758ddf71464 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:38.235840 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1425/2880] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:19:38.239824 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69719ca-e1a4-4c24-b370-744bacc842c3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:38.250097 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69719ca-e1a4-4c24-b370-744bacc842c3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:38.254570 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39447b61-3fd9-4a1c-8c74-61c5b4034b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:38.255210 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39447b61-3fd9-4a1c-8c74-61c5b4034b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:38.255482 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39447b61-3fd9-4a1c-8c74-61c5b4034b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:38.255750 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39447b61-3fd9-4a1c-8c74-61c5b4034b67 admin admin] PATH_INFO: `/v3/projects/e2252d02460a4de9b669c1409f07bb07/users/86796165590c4199b132adb37eb196c8/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:38.257649 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39447b61-3fd9-4a1c-8c74-61c5b4034b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2252d02460a4de9b669c1409f07bb07, user_id=86796165590c4199b132adb37eb196c8, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:38.260282 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39447b61-3fd9-4a1c-8c74-61c5b4034b67 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:38.271130 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1456/2881] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:19:38 2022] PUT /identity/v3/projects/e2252d02460a4de9b669c1409f07bb07/users/86796165590c4199b132adb37eb196c8/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:38.281864 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2fcf9-b34e-41cb-b71f-4aed05c2ae05 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:38.282144 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2fcf9-b34e-41cb-b71f-4aed05c2ae05 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:38.282424 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2fcf9-b34e-41cb-b71f-4aed05c2ae05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:38.314760 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-68e2fcf9-b34e-41cb-b71f-4aed05c2ae05 None None] MFA Rules not processed for user `86796165590c4199b132adb37eb196c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:38.315924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-68e2fcf9-b34e-41cb-b71f-4aed05c2ae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:38.389607 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1426/2882] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:38.400217 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39447b61-3fd9-4a1c-8c74-61c5b4034b67 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:38.401998 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-39447b61-3fd9-4a1c-8c74-61c5b4034b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:38.460278 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39447b61-3fd9-4a1c-8c74-61c5b4034b67 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:38.463866 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44164e9-bdd8-4435-87f9-ec9ee6867141 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:38.464490 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44164e9-bdd8-4435-87f9-ec9ee6867141 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:38.464764 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44164e9-bdd8-4435-87f9-ec9ee6867141 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:38.465033 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44164e9-bdd8-4435-87f9-ec9ee6867141 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:38.474158 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44164e9-bdd8-4435-87f9-ec9ee6867141 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:38.475583 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44164e9-bdd8-4435-87f9-ec9ee6867141 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:38.485665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1457/2883] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:19:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:19:38.586944 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2fcf9-b34e-41cb-b71f-4aed05c2ae05 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:38.596769 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2fcf9-b34e-41cb-b71f-4aed05c2ae05 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:38.600282 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0948e6-b41d-47a2-b707-30e0e87ec78e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:38.600876 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0948e6-b41d-47a2-b707-30e0e87ec78e service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:38.601151 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0948e6-b41d-47a2-b707-30e0e87ec78e service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:38.601428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0948e6-b41d-47a2-b707-30e0e87ec78e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:38.630258 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:38.658958 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0948e6-b41d-47a2-b707-30e0e87ec78e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:38.660428 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0948e6-b41d-47a2-b707-30e0e87ec78e service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:38.669065 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1427/2884] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:19:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:19:41.250799 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44164e9-bdd8-4435-87f9-ec9ee6867141 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:41.315264 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44164e9-bdd8-4435-87f9-ec9ee6867141 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:41.319794 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937073c-f948-4777-9804-0fc6cadff107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:41.320474 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937073c-f948-4777-9804-0fc6cadff107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:41.320746 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937073c-f948-4777-9804-0fc6cadff107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:41.321015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937073c-f948-4777-9804-0fc6cadff107 admin admin] PATH_INFO: `/v3/users/43a45d0264a148bba0bd7ba869fd3b6f` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:41.322149 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937073c-f948-4777-9804-0fc6cadff107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a45d0264a148bba0bd7ba869fd3b6f)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:41.324131 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937073c-f948-4777-9804-0fc6cadff107 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:41.378897 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8937073c-f948-4777-9804-0fc6cadff107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a45d0264a148bba0bd7ba869fd3b6f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:41.385627 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8937073c-f948-4777-9804-0fc6cadff107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a45d0264a148bba0bd7ba869fd3b6f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:41.393028 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8937073c-f948-4777-9804-0fc6cadff107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a45d0264a148bba0bd7ba869fd3b6f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:41.393820 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8937073c-f948-4777-9804-0fc6cadff107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a45d0264a148bba0bd7ba869fd3b6f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:41.395842 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:41.408888 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8937073c-f948-4777-9804-0fc6cadff107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a45d0264a148bba0bd7ba869fd3b6f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:41.414679 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1458/2885] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:19:41 2022] DELETE /identity/v3/users/43a45d0264a148bba0bd7ba869fd3b6f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:41.419285 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff1ab-623e-4cdb-b97e-10298b34a734 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:41.419831 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff1ab-623e-4cdb-b97e-10298b34a734 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:41.419966 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff1ab-623e-4cdb-b97e-10298b34a734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:41.439163 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-fe3ff1ab-623e-4cdb-b97e-10298b34a734 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:41.440408 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fe3ff1ab-623e-4cdb-b97e-10298b34a734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:41.504464 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1428/2886] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:41.514102 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937073c-f948-4777-9804-0fc6cadff107 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:41.515765 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8937073c-f948-4777-9804-0fc6cadff107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:41.579674 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937073c-f948-4777-9804-0fc6cadff107 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:41.583327 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3f36c-5ea1-4a13-8f89-79743cb3a514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:41.583935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3f36c-5ea1-4a13-8f89-79743cb3a514 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:41.584242 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3f36c-5ea1-4a13-8f89-79743cb3a514 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:41.584516 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3f36c-5ea1-4a13-8f89-79743cb3a514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:41.595918 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3f36c-5ea1-4a13-8f89-79743cb3a514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:41.597364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3f36c-5ea1-4a13-8f89-79743cb3a514 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:41.606760 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1459/2887] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:19:41.891627 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ff1ab-623e-4cdb-b97e-10298b34a734 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:41.893076 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fe3ff1ab-623e-4cdb-b97e-10298b34a734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:41.905724 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ff1ab-623e-4cdb-b97e-10298b34a734 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:41.910444 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1508023-ef0c-4725-954e-b9d86b637537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:41.911082 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1508023-ef0c-4725-954e-b9d86b637537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:41.911430 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1508023-ef0c-4725-954e-b9d86b637537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:41.911715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1508023-ef0c-4725-954e-b9d86b637537 admin admin] PATH_INFO: `/v3/projects/baee42cdf046495187eed2977ef4f05a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:41.912907 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1508023-ef0c-4725-954e-b9d86b637537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baee42cdf046495187eed2977ef4f05a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:41.914888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1508023-ef0c-4725-954e-b9d86b637537 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:41.967308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d1508023-ef0c-4725-954e-b9d86b637537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baee42cdf046495187eed2977ef4f05a', 'request_id': 'req-d1508023-ef0c-4725-954e-b9d86b637537'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:41.973580 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d1508023-ef0c-4725-954e-b9d86b637537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baee42cdf046495187eed2977ef4f05a', 'request_id': 'req-d1508023-ef0c-4725-954e-b9d86b637537'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:41.979091 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d1508023-ef0c-4725-954e-b9d86b637537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baee42cdf046495187eed2977ef4f05a', 'request_id': 'req-d1508023-ef0c-4725-954e-b9d86b637537'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:41.993591 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d1508023-ef0c-4725-954e-b9d86b637537 admin admin] The token cache is being invalidate because project baee42cdf046495187eed2977ef4f05a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:19:41.993883 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d1508023-ef0c-4725-954e-b9d86b637537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:41.994581 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d1508023-ef0c-4725-954e-b9d86b637537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:41.996137 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1429/2888] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:19:41 2022] DELETE /identity/v3/projects/baee42cdf046495187eed2977ef4f05a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:19:42.001262 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3f36c-5ea1-4a13-8f89-79743cb3a514 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:42.011067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3f36c-5ea1-4a13-8f89-79743cb3a514 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:42.069068 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161eab6-d096-4462-88f7-98d9fa565d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:42.069696 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161eab6-d096-4462-88f7-98d9fa565d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:42.069972 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161eab6-d096-4462-88f7-98d9fa565d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:42.070269 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161eab6-d096-4462-88f7-98d9fa565d38 admin admin] PATH_INFO: `/v3/users/86796165590c4199b132adb37eb196c8` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:42.071430 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161eab6-d096-4462-88f7-98d9fa565d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86796165590c4199b132adb37eb196c8)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:42.073364 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161eab6-d096-4462-88f7-98d9fa565d38 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:42.119106 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f161eab6-d096-4462-88f7-98d9fa565d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86796165590c4199b132adb37eb196c8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:42.126914 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f161eab6-d096-4462-88f7-98d9fa565d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86796165590c4199b132adb37eb196c8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:42.136964 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f161eab6-d096-4462-88f7-98d9fa565d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86796165590c4199b132adb37eb196c8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:42.137597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f161eab6-d096-4462-88f7-98d9fa565d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86796165590c4199b132adb37eb196c8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:42.150453 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f161eab6-d096-4462-88f7-98d9fa565d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86796165590c4199b132adb37eb196c8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:42.157234 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1460/2889] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:19:42 2022] DELETE /identity/v3/users/86796165590c4199b132adb37eb196c8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:42.437656 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1508023-ef0c-4725-954e-b9d86b637537 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:42.439122 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d1508023-ef0c-4725-954e-b9d86b637537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:42.452084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1508023-ef0c-4725-954e-b9d86b637537 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:42.500268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:42.510357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285aa74-6068-4831-9ae7-c4f178f2968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:42.510983 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285aa74-6068-4831-9ae7-c4f178f2968e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:42.511256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285aa74-6068-4831-9ae7-c4f178f2968e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:42.511523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285aa74-6068-4831-9ae7-c4f178f2968e admin admin] PATH_INFO: `/v3/projects/e2252d02460a4de9b669c1409f07bb07` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:42.512643 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285aa74-6068-4831-9ae7-c4f178f2968e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2252d02460a4de9b669c1409f07bb07)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:42.515084 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285aa74-6068-4831-9ae7-c4f178f2968e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:42.560805 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5285aa74-6068-4831-9ae7-c4f178f2968e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2252d02460a4de9b669c1409f07bb07', 'request_id': 'req-5285aa74-6068-4831-9ae7-c4f178f2968e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:42.566671 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5285aa74-6068-4831-9ae7-c4f178f2968e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2252d02460a4de9b669c1409f07bb07', 'request_id': 'req-5285aa74-6068-4831-9ae7-c4f178f2968e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:42.572061 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5285aa74-6068-4831-9ae7-c4f178f2968e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2252d02460a4de9b669c1409f07bb07', 'request_id': 'req-5285aa74-6068-4831-9ae7-c4f178f2968e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:42.584343 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5285aa74-6068-4831-9ae7-c4f178f2968e admin admin] The token cache is being invalidate because project e2252d02460a4de9b669c1409f07bb07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:19:42.584626 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5285aa74-6068-4831-9ae7-c4f178f2968e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:42.585238 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5285aa74-6068-4831-9ae7-c4f178f2968e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:42.586678 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1430/2890] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:19:42 2022] DELETE /identity/v3/projects/e2252d02460a4de9b669c1409f07bb07 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:42.591528 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2725f-7d0c-4691-afbd-ae79f831da52 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:42.592652 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2725f-7d0c-4691-afbd-ae79f831da52 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:42.592770 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2725f-7d0c-4691-afbd-ae79f831da52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:42.601099 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:42.613356 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-92d2725f-7d0c-4691-afbd-ae79f831da52 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:42.614562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-92d2725f-7d0c-4691-afbd-ae79f831da52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:42.671272 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1461/2891] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:19:42.734772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda532f9-27a2-4e7d-9d40-33ea557434ab None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:42.735036 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda532f9-27a2-4e7d-9d40-33ea557434ab None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:42.735306 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda532f9-27a2-4e7d-9d40-33ea557434ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:42.754941 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-cda532f9-27a2-4e7d-9d40-33ea557434ab None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:42.756170 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cda532f9-27a2-4e7d-9d40-33ea557434ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:42.764379 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1431/2892] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:42.768880 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2725f-7d0c-4691-afbd-ae79f831da52 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:42.778435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2725f-7d0c-4691-afbd-ae79f831da52 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:42.783596 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbc376-b5b4-46d4-862b-9a955079f201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:42.784215 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbc376-b5b4-46d4-862b-9a955079f201 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:42.784493 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbc376-b5b4-46d4-862b-9a955079f201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:42.784755 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbc376-b5b4-46d4-862b-9a955079f201 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:42.785381 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbc376-b5b4-46d4-862b-9a955079f201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:19:42.785675 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbc376-b5b4-46d4-862b-9a955079f201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:42.787229 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbc376-b5b4-46d4-862b-9a955079f201 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:42.798483 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1462/2893] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:19:42.802692 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda532f9-27a2-4e7d-9d40-33ea557434ab None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:42.811869 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda532f9-27a2-4e7d-9d40-33ea557434ab None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:42.816445 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c917f6-ca84-4d58-97c1-80dfa09c450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:42.817030 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c917f6-ca84-4d58-97c1-80dfa09c450f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:42.817299 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c917f6-ca84-4d58-97c1-80dfa09c450f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:42.817619 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c917f6-ca84-4d58-97c1-80dfa09c450f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:42.818276 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c917f6-ca84-4d58-97c1-80dfa09c450f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:42.820198 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c917f6-ca84-4d58-97c1-80dfa09c450f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:42.848135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1432/2894] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:19:42 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:19:42.852612 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbc376-b5b4-46d4-862b-9a955079f201 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:42.862630 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbc376-b5b4-46d4-862b-9a955079f201 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:42.922043 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458a87d-9873-4cf3-95ad-4b27358886de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:42.922644 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458a87d-9873-4cf3-95ad-4b27358886de admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:42.922918 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458a87d-9873-4cf3-95ad-4b27358886de admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:42.923189 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458a87d-9873-4cf3-95ad-4b27358886de admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:42.923818 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458a87d-9873-4cf3-95ad-4b27358886de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:42.925751 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458a87d-9873-4cf3-95ad-4b27358886de admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:42.947015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1463/2895] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:19:42 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:42.951280 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c917f6-ca84-4d58-97c1-80dfa09c450f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:42.962338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c917f6-ca84-4d58-97c1-80dfa09c450f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:42.966825 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f4d40-dbe0-4a57-94c2-561cbf451ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:42.967922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f4d40-dbe0-4a57-94c2-561cbf451ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:42.968217 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f4d40-dbe0-4a57-94c2-561cbf451ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:42.968480 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f4d40-dbe0-4a57-94c2-561cbf451ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:42.969107 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f4d40-dbe0-4a57-94c2-561cbf451ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:42.970682 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f4d40-dbe0-4a57-94c2-561cbf451ccf admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:42.980429 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1433/2896] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:19:42.985117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458a87d-9873-4cf3-95ad-4b27358886de admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:42.995192 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458a87d-9873-4cf3-95ad-4b27358886de admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:43.000068 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a2c54-e269-45d0-b87c-dfc635aa05c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:43.000653 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a2c54-e269-45d0-b87c-dfc635aa05c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:43.000924 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a2c54-e269-45d0-b87c-dfc635aa05c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:43.001193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a2c54-e269-45d0-b87c-dfc635aa05c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:43.001815 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a2c54-e269-45d0-b87c-dfc635aa05c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:43.003373 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a2c54-e269-45d0-b87c-dfc635aa05c5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:43.013927 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1464/2897] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:19:43.018047 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f4d40-dbe0-4a57-94c2-561cbf451ccf admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:43.027804 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f4d40-dbe0-4a57-94c2-561cbf451ccf admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:43.033454 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc116afe-e1f8-4e0b-a21c-488950ed9309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:43.034095 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc116afe-e1f8-4e0b-a21c-488950ed9309 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:43.034366 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc116afe-e1f8-4e0b-a21c-488950ed9309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:43.034631 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc116afe-e1f8-4e0b-a21c-488950ed9309 admin admin] PATH_INFO: `/v3/projects/94919c29f91a45c29bedcf7eb8c428ef/users/078ec68f673e4765a1ac0e455920fc1f/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:43.051888 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc116afe-e1f8-4e0b-a21c-488950ed9309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94919c29f91a45c29bedcf7eb8c428ef, user_id=078ec68f673e4765a1ac0e455920fc1f, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:43.054550 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc116afe-e1f8-4e0b-a21c-488950ed9309 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:43.067560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1434/2898] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:19:43 2022] PUT /identity/v3/projects/94919c29f91a45c29bedcf7eb8c428ef/users/078ec68f673e4765a1ac0e455920fc1f/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:43.077483 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288fc07-d5f0-4074-86fa-7c6764c49c53 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:43.077758 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288fc07-d5f0-4074-86fa-7c6764c49c53 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:43.078026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288fc07-d5f0-4074-86fa-7c6764c49c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:43.105297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d288fc07-d5f0-4074-86fa-7c6764c49c53 None None] MFA Rules not processed for user `078ec68f673e4765a1ac0e455920fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:43.106639 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d288fc07-d5f0-4074-86fa-7c6764c49c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:43.166019 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:43.170117 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1465/2899] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:43.174555 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc116afe-e1f8-4e0b-a21c-488950ed9309 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:43.234167 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc116afe-e1f8-4e0b-a21c-488950ed9309 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:43.240523 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcfe9b-7701-49e7-9b59-c9b385409735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:43.241130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcfe9b-7701-49e7-9b59-c9b385409735 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:43.241401 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcfe9b-7701-49e7-9b59-c9b385409735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:43.241664 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcfe9b-7701-49e7-9b59-c9b385409735 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:43.242304 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcfe9b-7701-49e7-9b59-c9b385409735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:43.244221 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcfe9b-7701-49e7-9b59-c9b385409735 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:43.271871 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1435/2900] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:19:43 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:43.275917 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288fc07-d5f0-4074-86fa-7c6764c49c53 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:43.286589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288fc07-d5f0-4074-86fa-7c6764c49c53 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:43.345475 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b0490-fa29-4e85-8ca7-42b97bd178a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:43.346026 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b0490-fa29-4e85-8ca7-42b97bd178a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:43.346303 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b0490-fa29-4e85-8ca7-42b97bd178a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:43.346573 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b0490-fa29-4e85-8ca7-42b97bd178a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:43.347241 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b0490-fa29-4e85-8ca7-42b97bd178a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:43.349181 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b0490-fa29-4e85-8ca7-42b97bd178a0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:43.369939 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1466/2901] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:19:43 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:43.374893 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcfe9b-7701-49e7-9b59-c9b385409735 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:43.381451 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:43.385357 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcfe9b-7701-49e7-9b59-c9b385409735 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:43.391020 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b7157-fbed-4395-83f3-134c8467ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:43.391626 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b7157-fbed-4395-83f3-134c8467ec39 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:43.391898 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b7157-fbed-4395-83f3-134c8467ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:43.392508 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b7157-fbed-4395-83f3-134c8467ec39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:43.393234 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b7157-fbed-4395-83f3-134c8467ec39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:43.395125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b7157-fbed-4395-83f3-134c8467ec39 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:43.405853 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1436/2902] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:19:43.410184 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b0490-fa29-4e85-8ca7-42b97bd178a0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:43.420067 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b0490-fa29-4e85-8ca7-42b97bd178a0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:43.425298 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948728c-5309-4cbb-916d-5434e4acdee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:43.425944 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948728c-5309-4cbb-916d-5434e4acdee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:43.426222 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948728c-5309-4cbb-916d-5434e4acdee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:43.426494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948728c-5309-4cbb-916d-5434e4acdee5 admin admin] PATH_INFO: `/v3/projects/5f9828c2038849eeb1f01ec60a430126/users/5454545202a2421b963cda81065b9782/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:43.441944 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948728c-5309-4cbb-916d-5434e4acdee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9828c2038849eeb1f01ec60a430126, user_id=5454545202a2421b963cda81065b9782, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:43.444597 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948728c-5309-4cbb-916d-5434e4acdee5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:43.458356 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1467/2903] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:19:43 2022] PUT /identity/v3/projects/5f9828c2038849eeb1f01ec60a430126/users/5454545202a2421b963cda81065b9782/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:43.462277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b7157-fbed-4395-83f3-134c8467ec39 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:43.472423 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b7157-fbed-4395-83f3-134c8467ec39 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:43.543054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b64a8c-fb9d-41d9-abc9-3fdb44271fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:43.543670 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b64a8c-fb9d-41d9-abc9-3fdb44271fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:43.543969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b64a8c-fb9d-41d9-abc9-3fdb44271fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:43.544244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b64a8c-fb9d-41d9-abc9-3fdb44271fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:43.544898 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b64a8c-fb9d-41d9-abc9-3fdb44271fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:43.547130 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b64a8c-fb9d-41d9-abc9-3fdb44271fd5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:43.558028 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1437/2904] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:19:43.562887 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948728c-5309-4cbb-916d-5434e4acdee5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:43.573377 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948728c-5309-4cbb-916d-5434e4acdee5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:43.578011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed36e79-16da-4d67-826d-340bb42c0a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:43.578656 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed36e79-16da-4d67-826d-340bb42c0a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:43.578935 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed36e79-16da-4d67-826d-340bb42c0a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:43.579203 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed36e79-16da-4d67-826d-340bb42c0a05 admin admin] PATH_INFO: `/v3/projects/5f9828c2038849eeb1f01ec60a430126/users/5454545202a2421b963cda81065b9782/roles/5af25ecc20f6407189d4fe9923dcef98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:43.581145 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed36e79-16da-4d67-826d-340bb42c0a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9828c2038849eeb1f01ec60a430126, user_id=5454545202a2421b963cda81065b9782, role_id=5af25ecc20f6407189d4fe9923dcef98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:43.583775 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed36e79-16da-4d67-826d-340bb42c0a05 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:43.594193 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1468/2905] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:19:43 2022] PUT /identity/v3/projects/5f9828c2038849eeb1f01ec60a430126/users/5454545202a2421b963cda81065b9782/roles/5af25ecc20f6407189d4fe9923dcef98 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:43.604270 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbc780-63a2-4af9-964a-c703c6af5e54 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:43.604553 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbc780-63a2-4af9-964a-c703c6af5e54 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:43.604824 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbc780-63a2-4af9-964a-c703c6af5e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:43.634240 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6bdbc780-63a2-4af9-964a-c703c6af5e54 None None] MFA Rules not processed for user `5454545202a2421b963cda81065b9782`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:43.635455 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6bdbc780-63a2-4af9-964a-c703c6af5e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:43.701542 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1438/2906] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:43.712456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed36e79-16da-4d67-826d-340bb42c0a05 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:43.714220 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0ed36e79-16da-4d67-826d-340bb42c0a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:43.771787 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed36e79-16da-4d67-826d-340bb42c0a05 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:43.775446 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261d01d-cabd-4b61-afac-2b6703d0d172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:43.776071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261d01d-cabd-4b61-afac-2b6703d0d172 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:43.776347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261d01d-cabd-4b61-afac-2b6703d0d172 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:43.776615 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261d01d-cabd-4b61-afac-2b6703d0d172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:43.835127 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261d01d-cabd-4b61-afac-2b6703d0d172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:43.836923 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261d01d-cabd-4b61-afac-2b6703d0d172 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:43.847001 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1469/2907] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:19:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:19:46.392883 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbc780-63a2-4af9-964a-c703c6af5e54 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:46.454575 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbc780-63a2-4af9-964a-c703c6af5e54 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:46.459034 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d873e-3ec5-4cbd-86ee-60f65a9e262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:46.459682 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d873e-3ec5-4cbd-86ee-60f65a9e262a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:46.459969 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d873e-3ec5-4cbd-86ee-60f65a9e262a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:46.460256 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d873e-3ec5-4cbd-86ee-60f65a9e262a admin admin] PATH_INFO: `/v3/users/078ec68f673e4765a1ac0e455920fc1f` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:46.461479 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d873e-3ec5-4cbd-86ee-60f65a9e262a admin admin] RBAC: Authorizing `identity:delete_user(user_id=078ec68f673e4765a1ac0e455920fc1f)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:46.463396 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d873e-3ec5-4cbd-86ee-60f65a9e262a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:46.479237 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:46.510100 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d19d873e-3ec5-4cbd-86ee-60f65a9e262a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078ec68f673e4765a1ac0e455920fc1f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:46.522288 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d19d873e-3ec5-4cbd-86ee-60f65a9e262a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078ec68f673e4765a1ac0e455920fc1f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:46.529115 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d19d873e-3ec5-4cbd-86ee-60f65a9e262a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078ec68f673e4765a1ac0e455920fc1f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:46.529783 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d19d873e-3ec5-4cbd-86ee-60f65a9e262a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078ec68f673e4765a1ac0e455920fc1f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:46.534625 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d19d873e-3ec5-4cbd-86ee-60f65a9e262a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078ec68f673e4765a1ac0e455920fc1f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:46.551418 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1439/2908] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:19:46 2022] DELETE /identity/v3/users/078ec68f673e4765a1ac0e455920fc1f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:46.555905 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e9769-b57c-4fa7-907e-e7a7b6954c13 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:46.556421 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e9769-b57c-4fa7-907e-e7a7b6954c13 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:46.556550 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e9769-b57c-4fa7-907e-e7a7b6954c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:46.570710 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:46.577458 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6e8e9769-b57c-4fa7-907e-e7a7b6954c13 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:46.578665 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6e8e9769-b57c-4fa7-907e-e7a7b6954c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:46.636589 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1470/2909] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:19:46.646010 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d873e-3ec5-4cbd-86ee-60f65a9e262a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:46.647420 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d19d873e-3ec5-4cbd-86ee-60f65a9e262a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:46.705460 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d873e-3ec5-4cbd-86ee-60f65a9e262a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:46.709093 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbb1b9-f34d-40ce-bbd3-8717b2fe5da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:46.709696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbb1b9-f34d-40ce-bbd3-8717b2fe5da4 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:46.710057 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbb1b9-f34d-40ce-bbd3-8717b2fe5da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:46.710308 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbb1b9-f34d-40ce-bbd3-8717b2fe5da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:46.719729 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbb1b9-f34d-40ce-bbd3-8717b2fe5da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:46.721188 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbb1b9-f34d-40ce-bbd3-8717b2fe5da4 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:46.730531 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1440/2910] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:19:46.997999 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e9769-b57c-4fa7-907e-e7a7b6954c13 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:46.999858 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6e8e9769-b57c-4fa7-907e-e7a7b6954c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:47.011790 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e9769-b57c-4fa7-907e-e7a7b6954c13 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:47.017317 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025a31a-5a88-454e-8187-db04313f5569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:47.018095 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025a31a-5a88-454e-8187-db04313f5569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:47.018473 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025a31a-5a88-454e-8187-db04313f5569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:47.018840 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025a31a-5a88-454e-8187-db04313f5569 admin admin] PATH_INFO: `/v3/projects/94919c29f91a45c29bedcf7eb8c428ef` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:47.020294 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025a31a-5a88-454e-8187-db04313f5569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94919c29f91a45c29bedcf7eb8c428ef)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:47.022197 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025a31a-5a88-454e-8187-db04313f5569 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:47.071786 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8025a31a-5a88-454e-8187-db04313f5569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94919c29f91a45c29bedcf7eb8c428ef', 'request_id': 'req-8025a31a-5a88-454e-8187-db04313f5569'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:47.077763 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8025a31a-5a88-454e-8187-db04313f5569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94919c29f91a45c29bedcf7eb8c428ef', 'request_id': 'req-8025a31a-5a88-454e-8187-db04313f5569'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:47.085455 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8025a31a-5a88-454e-8187-db04313f5569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94919c29f91a45c29bedcf7eb8c428ef', 'request_id': 'req-8025a31a-5a88-454e-8187-db04313f5569'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:47.097098 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8025a31a-5a88-454e-8187-db04313f5569 admin admin] The token cache is being invalidate because project 94919c29f91a45c29bedcf7eb8c428ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:19:47.097387 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8025a31a-5a88-454e-8187-db04313f5569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:47.098011 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8025a31a-5a88-454e-8187-db04313f5569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:47.099485 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1471/2911] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:19:46 2022] DELETE /identity/v3/projects/94919c29f91a45c29bedcf7eb8c428ef => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:47.103540 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbb1b9-f34d-40ce-bbd3-8717b2fe5da4 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:47.113892 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbb1b9-f34d-40ce-bbd3-8717b2fe5da4 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:47.169321 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd757c3-6114-4ba8-8611-9cf6af8889d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:47.169867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd757c3-6114-4ba8-8611-9cf6af8889d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:47.170140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd757c3-6114-4ba8-8611-9cf6af8889d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:47.170407 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd757c3-6114-4ba8-8611-9cf6af8889d2 admin admin] PATH_INFO: `/v3/users/5454545202a2421b963cda81065b9782` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:47.172099 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd757c3-6114-4ba8-8611-9cf6af8889d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5454545202a2421b963cda81065b9782)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:47.174002 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd757c3-6114-4ba8-8611-9cf6af8889d2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:47.213962 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:47.221035 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0fd757c3-6114-4ba8-8611-9cf6af8889d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5454545202a2421b963cda81065b9782'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:47.233694 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0fd757c3-6114-4ba8-8611-9cf6af8889d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5454545202a2421b963cda81065b9782'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:47.240472 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0fd757c3-6114-4ba8-8611-9cf6af8889d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5454545202a2421b963cda81065b9782'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:47.241145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0fd757c3-6114-4ba8-8611-9cf6af8889d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5454545202a2421b963cda81065b9782'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:47.241743 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0fd757c3-6114-4ba8-8611-9cf6af8889d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5454545202a2421b963cda81065b9782'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:47.254679 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1441/2912] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:19:47 2022] DELETE /identity/v3/users/5454545202a2421b963cda81065b9782 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:47.526312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025a31a-5a88-454e-8187-db04313f5569 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:47.527463 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8025a31a-5a88-454e-8187-db04313f5569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:47.547685 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025a31a-5a88-454e-8187-db04313f5569 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:47.611050 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6833f-b841-4fde-b620-c64ada5dbccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:47.611721 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6833f-b841-4fde-b620-c64ada5dbccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:47.611971 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6833f-b841-4fde-b620-c64ada5dbccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:47.612250 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6833f-b841-4fde-b620-c64ada5dbccb admin admin] PATH_INFO: `/v3/projects/5f9828c2038849eeb1f01ec60a430126` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:47.613383 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6833f-b841-4fde-b620-c64ada5dbccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f9828c2038849eeb1f01ec60a430126)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:47.615273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6833f-b841-4fde-b620-c64ada5dbccb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:47.653195 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:47.667681 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-20a6833f-b841-4fde-b620-c64ada5dbccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f9828c2038849eeb1f01ec60a430126', 'request_id': 'req-20a6833f-b841-4fde-b620-c64ada5dbccb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:47.673718 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-20a6833f-b841-4fde-b620-c64ada5dbccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f9828c2038849eeb1f01ec60a430126', 'request_id': 'req-20a6833f-b841-4fde-b620-c64ada5dbccb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:47.681392 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-20a6833f-b841-4fde-b620-c64ada5dbccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f9828c2038849eeb1f01ec60a430126', 'request_id': 'req-20a6833f-b841-4fde-b620-c64ada5dbccb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:47.694089 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-20a6833f-b841-4fde-b620-c64ada5dbccb admin admin] The token cache is being invalidate because project 5f9828c2038849eeb1f01ec60a430126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:19:47.694363 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-20a6833f-b841-4fde-b620-c64ada5dbccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:47.695014 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-20a6833f-b841-4fde-b620-c64ada5dbccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:47.696558 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1472/2913] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:19:47 2022] DELETE /identity/v3/projects/5f9828c2038849eeb1f01ec60a430126 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:19:47.701359 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ecafd-1141-467e-8551-9291b27caf0b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:47.702440 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ecafd-1141-467e-8551-9291b27caf0b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:47.702640 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ecafd-1141-467e-8551-9291b27caf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:47.721922 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-130ecafd-1141-467e-8551-9291b27caf0b None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:47.723131 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-130ecafd-1141-467e-8551-9291b27caf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:47.781135 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1442/2914] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:47.789498 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3e128-edc7-4e91-a4bf-8cf1bfdc7401 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:47.790054 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3e128-edc7-4e91-a4bf-8cf1bfdc7401 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:47.790338 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3e128-edc7-4e91-a4bf-8cf1bfdc7401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:47.810937 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-02e3e128-edc7-4e91-a4bf-8cf1bfdc7401 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:47.812817 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-02e3e128-edc7-4e91-a4bf-8cf1bfdc7401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:47.821273 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1473/2915] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:47.825535 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ecafd-1141-467e-8551-9291b27caf0b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:47.836832 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ecafd-1141-467e-8551-9291b27caf0b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:47.841708 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0718c-d6b6-4d0b-a5ac-c784897327cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:47.842320 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0718c-d6b6-4d0b-a5ac-c784897327cb admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:47.842597 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0718c-d6b6-4d0b-a5ac-c784897327cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:47.842863 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0718c-d6b6-4d0b-a5ac-c784897327cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:47.843601 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0718c-d6b6-4d0b-a5ac-c784897327cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:19:47.843898 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0718c-d6b6-4d0b-a5ac-c784897327cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:47.845517 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0718c-d6b6-4d0b-a5ac-c784897327cb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:47.857707 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1443/2916] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:19:47.863163 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3e128-edc7-4e91-a4bf-8cf1bfdc7401 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:47.875260 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3e128-edc7-4e91-a4bf-8cf1bfdc7401 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:47.880107 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0723715-740c-43bf-9d29-744d56d56b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:47.880715 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0723715-740c-43bf-9d29-744d56d56b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:47.880993 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0723715-740c-43bf-9d29-744d56d56b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:47.881286 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0723715-740c-43bf-9d29-744d56d56b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:47.881910 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0723715-740c-43bf-9d29-744d56d56b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:47.883802 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0723715-740c-43bf-9d29-744d56d56b2b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:47.913312 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1474/2917] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:19:47 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:47.917485 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0718c-d6b6-4d0b-a5ac-c784897327cb admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:47.931338 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0718c-d6b6-4d0b-a5ac-c784897327cb admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:47.993384 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae09f3f-beae-43f1-9b9c-67e72cf85d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:47.993993 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae09f3f-beae-43f1-9b9c-67e72cf85d48 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:47.994266 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae09f3f-beae-43f1-9b9c-67e72cf85d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:47.994535 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae09f3f-beae-43f1-9b9c-67e72cf85d48 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:47.995163 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae09f3f-beae-43f1-9b9c-67e72cf85d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:47.997101 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae09f3f-beae-43f1-9b9c-67e72cf85d48 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:48.020173 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1444/2918] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:19:47 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:48.024275 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0723715-740c-43bf-9d29-744d56d56b2b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:48.034565 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0723715-740c-43bf-9d29-744d56d56b2b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:48.039174 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e19b2-b6da-4278-8af6-c3684d329bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:48.039768 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e19b2-b6da-4278-8af6-c3684d329bfe admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:48.040071 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e19b2-b6da-4278-8af6-c3684d329bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:48.040342 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e19b2-b6da-4278-8af6-c3684d329bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:48.040967 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e19b2-b6da-4278-8af6-c3684d329bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:48.042548 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e19b2-b6da-4278-8af6-c3684d329bfe admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:48.053133 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1475/2919] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:19:48.057053 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae09f3f-beae-43f1-9b9c-67e72cf85d48 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:48.067717 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae09f3f-beae-43f1-9b9c-67e72cf85d48 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:48.072541 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59018f-aa9a-4030-b705-05b7800a9c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:48.073140 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59018f-aa9a-4030-b705-05b7800a9c87 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:48.073414 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59018f-aa9a-4030-b705-05b7800a9c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:48.073716 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59018f-aa9a-4030-b705-05b7800a9c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:48.074350 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59018f-aa9a-4030-b705-05b7800a9c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:48.075961 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59018f-aa9a-4030-b705-05b7800a9c87 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:48.088906 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1445/2920] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:19:48.093315 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e19b2-b6da-4278-8af6-c3684d329bfe admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:48.109389 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e19b2-b6da-4278-8af6-c3684d329bfe admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:48.114281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504df4c6-3993-41c4-9027-75790967a47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:48.114965 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504df4c6-3993-41c4-9027-75790967a47d admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:48.115283 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504df4c6-3993-41c4-9027-75790967a47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:48.115545 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504df4c6-3993-41c4-9027-75790967a47d admin admin] PATH_INFO: `/v3/projects/340a21e861a343e99e0a2ea12da9225d/users/136d6a562df84e67b7a1228fb6cd15de/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:48.132600 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504df4c6-3993-41c4-9027-75790967a47d admin admin] RBAC: Authorizing `identity:create_grant(project_id=340a21e861a343e99e0a2ea12da9225d, user_id=136d6a562df84e67b7a1228fb6cd15de, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:48.135302 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504df4c6-3993-41c4-9027-75790967a47d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:48.150291 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1476/2921] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:19:48 2022] PUT /identity/v3/projects/340a21e861a343e99e0a2ea12da9225d/users/136d6a562df84e67b7a1228fb6cd15de/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:48.161477 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e263f6b-859a-48d4-a794-36fab9bf3fea None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:48.161746 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e263f6b-859a-48d4-a794-36fab9bf3fea None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:48.162025 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e263f6b-859a-48d4-a794-36fab9bf3fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:48.199538 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6e263f6b-859a-48d4-a794-36fab9bf3fea None None] MFA Rules not processed for user `136d6a562df84e67b7a1228fb6cd15de`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:48.200800 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6e263f6b-859a-48d4-a794-36fab9bf3fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:48.211560 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:48.278145 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1446/2922] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:48.290226 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504df4c6-3993-41c4-9027-75790967a47d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:48.291986 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-504df4c6-3993-41c4-9027-75790967a47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:48.352252 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504df4c6-3993-41c4-9027-75790967a47d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:48.355857 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54174bec-f19c-4265-b21e-4100adad5f7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:48.356582 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54174bec-f19c-4265-b21e-4100adad5f7d service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:48.356883 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54174bec-f19c-4265-b21e-4100adad5f7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:48.357122 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54174bec-f19c-4265-b21e-4100adad5f7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:48.365868 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54174bec-f19c-4265-b21e-4100adad5f7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:48.367299 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54174bec-f19c-4265-b21e-4100adad5f7d service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:48.377258 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1477/2923] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:19:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:19:50.951753 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e263f6b-859a-48d4-a794-36fab9bf3fea None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:51.013195 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e263f6b-859a-48d4-a794-36fab9bf3fea None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:51.017674 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfe615-5659-4ab6-bf3e-d3becb9dc061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:51.018294 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfe615-5659-4ab6-bf3e-d3becb9dc061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:51.018566 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfe615-5659-4ab6-bf3e-d3becb9dc061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:51.018833 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfe615-5659-4ab6-bf3e-d3becb9dc061 admin admin] PATH_INFO: `/v3/users/136d6a562df84e67b7a1228fb6cd15de` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:51.019924 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfe615-5659-4ab6-bf3e-d3becb9dc061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=136d6a562df84e67b7a1228fb6cd15de)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:51.021857 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfe615-5659-4ab6-bf3e-d3becb9dc061 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:51.069867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26cfe615-5659-4ab6-bf3e-d3becb9dc061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136d6a562df84e67b7a1228fb6cd15de'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:51.081657 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26cfe615-5659-4ab6-bf3e-d3becb9dc061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136d6a562df84e67b7a1228fb6cd15de'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:51.089017 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26cfe615-5659-4ab6-bf3e-d3becb9dc061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136d6a562df84e67b7a1228fb6cd15de'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:51.089737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26cfe615-5659-4ab6-bf3e-d3becb9dc061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136d6a562df84e67b7a1228fb6cd15de'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:51.090376 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26cfe615-5659-4ab6-bf3e-d3becb9dc061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136d6a562df84e67b7a1228fb6cd15de'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:51.104176 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1447/2924] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:19:50 2022] DELETE /identity/v3/users/136d6a562df84e67b7a1228fb6cd15de => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:51.109416 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc410a75-7cf1-4e8e-bb99-620a12d91418 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:51.109942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc410a75-7cf1-4e8e-bb99-620a12d91418 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:51.109942 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc410a75-7cf1-4e8e-bb99-620a12d91418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:51.129281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-cc410a75-7cf1-4e8e-bb99-620a12d91418 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:51.130477 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cc410a75-7cf1-4e8e-bb99-620a12d91418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:51.179647 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:51.192178 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1478/2925] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:19:51.198595 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfe615-5659-4ab6-bf3e-d3becb9dc061 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:51.200067 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-26cfe615-5659-4ab6-bf3e-d3becb9dc061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:51.234845 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:51.259699 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfe615-5659-4ab6-bf3e-d3becb9dc061 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:51.263302 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52990f3-6c57-4969-a813-3aba05e752f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:51.263902 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52990f3-6c57-4969-a813-3aba05e752f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:51.264212 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52990f3-6c57-4969-a813-3aba05e752f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:51.264481 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52990f3-6c57-4969-a813-3aba05e752f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:51.273364 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52990f3-6c57-4969-a813-3aba05e752f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:51.274786 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52990f3-6c57-4969-a813-3aba05e752f3 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:51.284500 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1448/2926] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:19:51.555606 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc410a75-7cf1-4e8e-bb99-620a12d91418 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:51.557065 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cc410a75-7cf1-4e8e-bb99-620a12d91418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:51.569185 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc410a75-7cf1-4e8e-bb99-620a12d91418 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:51.573832 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e145d-8db3-485f-bc03-5ed946d95bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:51.574552 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e145d-8db3-485f-bc03-5ed946d95bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:51.574744 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e145d-8db3-485f-bc03-5ed946d95bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:51.575015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e145d-8db3-485f-bc03-5ed946d95bc8 admin admin] PATH_INFO: `/v3/projects/340a21e861a343e99e0a2ea12da9225d` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:51.576190 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e145d-8db3-485f-bc03-5ed946d95bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=340a21e861a343e99e0a2ea12da9225d)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:51.578713 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e145d-8db3-485f-bc03-5ed946d95bc8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:51.626930 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-641e145d-8db3-485f-bc03-5ed946d95bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '340a21e861a343e99e0a2ea12da9225d', 'request_id': 'req-641e145d-8db3-485f-bc03-5ed946d95bc8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:51.632401 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-641e145d-8db3-485f-bc03-5ed946d95bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '340a21e861a343e99e0a2ea12da9225d', 'request_id': 'req-641e145d-8db3-485f-bc03-5ed946d95bc8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:51.640168 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-641e145d-8db3-485f-bc03-5ed946d95bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '340a21e861a343e99e0a2ea12da9225d', 'request_id': 'req-641e145d-8db3-485f-bc03-5ed946d95bc8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:51.651105 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-641e145d-8db3-485f-bc03-5ed946d95bc8 admin admin] The token cache is being invalidate because project 340a21e861a343e99e0a2ea12da9225d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:19:51.651393 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-641e145d-8db3-485f-bc03-5ed946d95bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:51.652041 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-641e145d-8db3-485f-bc03-5ed946d95bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:19:51.653494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1479/2927] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:19:51 2022] DELETE /identity/v3/projects/340a21e861a343e99e0a2ea12da9225d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:51.658963 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c47800-cda7-4cce-bf05-5bd31e721d66 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:51.659242 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c47800-cda7-4cce-bf05-5bd31e721d66 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:51.659510 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c47800-cda7-4cce-bf05-5bd31e721d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:51.678875 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-89c47800-cda7-4cce-bf05-5bd31e721d66 None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:51.680136 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-89c47800-cda7-4cce-bf05-5bd31e721d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:51.738532 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1449/2928] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:51.747247 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71014f8c-373c-4f86-9154-996113812b1e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:51.747526 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71014f8c-373c-4f86-9154-996113812b1e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:51.747796 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71014f8c-373c-4f86-9154-996113812b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:51.768200 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-71014f8c-373c-4f86-9154-996113812b1e None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:51.769417 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-71014f8c-373c-4f86-9154-996113812b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:51.777204 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1480/2929] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:51.781951 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c47800-cda7-4cce-bf05-5bd31e721d66 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:51.791551 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c47800-cda7-4cce-bf05-5bd31e721d66 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:51.796000 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0990d1-e773-4445-aa0d-f2a00072252d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:51.796590 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0990d1-e773-4445-aa0d-f2a00072252d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:51.796862 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0990d1-e773-4445-aa0d-f2a00072252d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:51.797125 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0990d1-e773-4445-aa0d-f2a00072252d admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:51.797759 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0990d1-e773-4445-aa0d-f2a00072252d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:19:51.798054 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0990d1-e773-4445-aa0d-f2a00072252d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:51.799644 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0990d1-e773-4445-aa0d-f2a00072252d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:51.811092 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1450/2930] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Aug 30 05:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:19:51.815467 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71014f8c-373c-4f86-9154-996113812b1e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:51.824577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71014f8c-373c-4f86-9154-996113812b1e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:51.829698 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b085c4a-daf4-4a78-b4ac-2fbcf0807ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:51.830286 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b085c4a-daf4-4a78-b4ac-2fbcf0807ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:51.830562 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b085c4a-daf4-4a78-b4ac-2fbcf0807ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:51.830831 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b085c4a-daf4-4a78-b4ac-2fbcf0807ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:51.831448 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b085c4a-daf4-4a78-b4ac-2fbcf0807ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:51.833359 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b085c4a-daf4-4a78-b4ac-2fbcf0807ef6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:51.863384 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1481/2931] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Aug 30 05:19:51 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:51.867696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0990d1-e773-4445-aa0d-f2a00072252d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:51.878753 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0990d1-e773-4445-aa0d-f2a00072252d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:51.940629 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af886280-b543-404d-81f8-dcc6ba7cd210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:51.941236 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af886280-b543-404d-81f8-dcc6ba7cd210 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:51.941507 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af886280-b543-404d-81f8-dcc6ba7cd210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:51.941771 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af886280-b543-404d-81f8-dcc6ba7cd210 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:51.942437 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af886280-b543-404d-81f8-dcc6ba7cd210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:51.946245 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af886280-b543-404d-81f8-dcc6ba7cd210 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:51.968531 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1451/2932] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Aug 30 05:19:51 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:19:51.972922 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b085c4a-daf4-4a78-b4ac-2fbcf0807ef6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:51.983297 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b085c4a-daf4-4a78-b4ac-2fbcf0807ef6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:51.988261 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b10ab8-76ac-42f3-922a-16f326693fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:51.988920 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b10ab8-76ac-42f3-922a-16f326693fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:51.989148 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b10ab8-76ac-42f3-922a-16f326693fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:51.989420 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b10ab8-76ac-42f3-922a-16f326693fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:51.990059 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b10ab8-76ac-42f3-922a-16f326693fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:51.991646 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b10ab8-76ac-42f3-922a-16f326693fd6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:52.002673 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1482/2933] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:19:52.007040 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af886280-b543-404d-81f8-dcc6ba7cd210 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:52.017919 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af886280-b543-404d-81f8-dcc6ba7cd210 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:52.022867 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737536f-5f5b-4e28-b351-b5999893cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:52.023493 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737536f-5f5b-4e28-b351-b5999893cc98 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:52.023772 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737536f-5f5b-4e28-b351-b5999893cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:52.024081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737536f-5f5b-4e28-b351-b5999893cc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:52.024720 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737536f-5f5b-4e28-b351-b5999893cc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:52.026309 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737536f-5f5b-4e28-b351-b5999893cc98 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:52.036835 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1452/2934] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Aug 30 05:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:19:52.040901 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b10ab8-76ac-42f3-922a-16f326693fd6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:52.050896 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b10ab8-76ac-42f3-922a-16f326693fd6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:52.055490 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a0ac9-cda4-4f31-ae84-18f76e324286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:52.056180 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a0ac9-cda4-4f31-ae84-18f76e324286 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:52.056455 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a0ac9-cda4-4f31-ae84-18f76e324286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:52.056720 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a0ac9-cda4-4f31-ae84-18f76e324286 admin admin] PATH_INFO: `/v3/projects/189fb4ec3ec942efb6e9c172de8db024/users/3143508595024bdd82582acd4d4879a1/roles/b0fa1b252ab74641b309e4a3d6aacc68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:52.071342 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a0ac9-cda4-4f31-ae84-18f76e324286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=189fb4ec3ec942efb6e9c172de8db024, user_id=3143508595024bdd82582acd4d4879a1, role_id=b0fa1b252ab74641b309e4a3d6aacc68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:52.074004 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a0ac9-cda4-4f31-ae84-18f76e324286 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:52.087202 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1483/2935] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Aug 30 05:19:52 2022] PUT /identity/v3/projects/189fb4ec3ec942efb6e9c172de8db024/users/3143508595024bdd82582acd4d4879a1/roles/b0fa1b252ab74641b309e4a3d6aacc68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:19:52.097715 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48346e3e-9075-45f5-976b-e4a4d759ec66 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:52.097996 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48346e3e-9075-45f5-976b-e4a4d759ec66 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:52.098268 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48346e3e-9075-45f5-976b-e4a4d759ec66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:52.126709 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-48346e3e-9075-45f5-976b-e4a4d759ec66 None None] MFA Rules not processed for user `3143508595024bdd82582acd4d4879a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:52.127964 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-48346e3e-9075-45f5-976b-e4a4d759ec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:52.156397 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:52.192427 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1453/2936] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:19:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:19:52.203740 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a0ac9-cda4-4f31-ae84-18f76e324286 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:52.205494 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-404a0ac9-cda4-4f31-ae84-18f76e324286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:52.268013 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a0ac9-cda4-4f31-ae84-18f76e324286 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:52.271544 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b1b94-2466-4dd6-a0d9-b9c7aa522c82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee3162303924aaeb91af567f02980e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:52.272183 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b1b94-2466-4dd6-a0d9-b9c7aa522c82 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:52.272463 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b1b94-2466-4dd6-a0d9-b9c7aa522c82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:52.272735 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b1b94-2466-4dd6-a0d9-b9c7aa522c82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:52.281039 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b1b94-2466-4dd6-a0d9-b9c7aa522c82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:52.282456 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b1b94-2466-4dd6-a0d9-b9c7aa522c82 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:52.291070 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1484/2937] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:19:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:20:02.189479 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=14 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:02.287281 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:02.376273 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48346e3e-9075-45f5-976b-e4a4d759ec66 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:20:02.437615 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48346e3e-9075-45f5-976b-e4a4d759ec66 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:20:02.442081 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13995a33-9294-40c7-9752-e4b682288e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:20:02.442703 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995a33-9294-40c7-9752-e4b682288e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:20:02.442978 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995a33-9294-40c7-9752-e4b682288e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:20:02.443244 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995a33-9294-40c7-9752-e4b682288e42 admin admin] PATH_INFO: `/v3/users/3143508595024bdd82582acd4d4879a1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:20:02.444380 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13995a33-9294-40c7-9752-e4b682288e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3143508595024bdd82582acd4d4879a1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:20:02.446295 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13995a33-9294-40c7-9752-e4b682288e42 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:20:02.494306 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-13995a33-9294-40c7-9752-e4b682288e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3143508595024bdd82582acd4d4879a1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:20:02.507696 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-13995a33-9294-40c7-9752-e4b682288e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3143508595024bdd82582acd4d4879a1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:20:02.515726 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-13995a33-9294-40c7-9752-e4b682288e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3143508595024bdd82582acd4d4879a1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:20:02.516904 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-13995a33-9294-40c7-9752-e4b682288e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3143508595024bdd82582acd4d4879a1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:20:02.517619 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-13995a33-9294-40c7-9752-e4b682288e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3143508595024bdd82582acd4d4879a1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:20:02.530791 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1454/2938] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Aug 30 05:20:02 2022] DELETE /identity/v3/users/3143508595024bdd82582acd4d4879a1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:20:02.535577 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae944f20-2c20-43fd-9e22-59d80a97828e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:20:02.536022 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae944f20-2c20-43fd-9e22-59d80a97828e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:20:02.536505 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae944f20-2c20-43fd-9e22-59d80a97828e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:20:02.557435 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ae944f20-2c20-43fd-9e22-59d80a97828e None None] MFA Rules not processed for user `4149212a50524852b6dbbdcbbc227d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:20:02.558574 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ae944f20-2c20-43fd-9e22-59d80a97828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:20:02.624825 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1485/2939] 10.222.0.48 () {58 vars in 958 bytes} [Tue Aug 30 05:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:20:02.634698 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13995a33-9294-40c7-9752-e4b682288e42 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:20:02.636158 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-13995a33-9294-40c7-9752-e4b682288e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:20:02.705737 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13995a33-9294-40c7-9752-e4b682288e42 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:20:02.709588 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2520aa-6188-4135-ac8a-fc39cba25703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4398d5175c8c409789d62c277da35ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:20:02.710194 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2520aa-6188-4135-ac8a-fc39cba25703 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:20:02.712486 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2520aa-6188-4135-ac8a-fc39cba25703 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:20:02.712768 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2520aa-6188-4135-ac8a-fc39cba25703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:20:02.723412 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2520aa-6188-4135-ac8a-fc39cba25703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:20:02.724877 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2520aa-6188-4135-ac8a-fc39cba25703 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:20:02.737277 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1455/2940] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:20:03.029567 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae944f20-2c20-43fd-9e22-59d80a97828e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:20:03.031347 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ae944f20-2c20-43fd-9e22-59d80a97828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:20:03.043841 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae944f20-2c20-43fd-9e22-59d80a97828e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:20:03.049216 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80748a-154a-4baf-8ae2-7f78be2d4244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4149212a50524852b6dbbdcbbc227d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30fb7a46e3a647738501ffab48bae602', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:20:03.049880 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80748a-154a-4baf-8ae2-7f78be2d4244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:20:03.050157 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80748a-154a-4baf-8ae2-7f78be2d4244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:20:03.050429 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80748a-154a-4baf-8ae2-7f78be2d4244 admin admin] PATH_INFO: `/v3/projects/189fb4ec3ec942efb6e9c172de8db024` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:20:03.051564 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80748a-154a-4baf-8ae2-7f78be2d4244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=189fb4ec3ec942efb6e9c172de8db024)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:20:03.053510 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80748a-154a-4baf-8ae2-7f78be2d4244 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:20:03.100850 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9a80748a-154a-4baf-8ae2-7f78be2d4244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '189fb4ec3ec942efb6e9c172de8db024', 'request_id': 'req-9a80748a-154a-4baf-8ae2-7f78be2d4244'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:20:03.106156 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9a80748a-154a-4baf-8ae2-7f78be2d4244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '189fb4ec3ec942efb6e9c172de8db024', 'request_id': 'req-9a80748a-154a-4baf-8ae2-7f78be2d4244'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:20:03.114084 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9a80748a-154a-4baf-8ae2-7f78be2d4244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '189fb4ec3ec942efb6e9c172de8db024', 'request_id': 'req-9a80748a-154a-4baf-8ae2-7f78be2d4244'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:20:03.126726 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9a80748a-154a-4baf-8ae2-7f78be2d4244 admin admin] The token cache is being invalidate because project 189fb4ec3ec942efb6e9c172de8db024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:20:03.127015 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9a80748a-154a-4baf-8ae2-7f78be2d4244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:20:03.127663 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9a80748a-154a-4baf-8ae2-7f78be2d4244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:20:03.129213 dv-cinder-853910-4-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1486/2941] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Aug 30 05:20:03 2022] DELETE /identity/v3/projects/189fb4ec3ec942efb6e9c172de8db024 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:20:12.730239 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:13.122212 dv-cinder-853910-4-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:53.364827 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2520aa-6188-4135-ac8a-fc39cba25703 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:22:53.366262 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ea2520aa-6188-4135-ac8a-fc39cba25703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:22:53.434391 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2520aa-6188-4135-ac8a-fc39cba25703 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:22:53.491897 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb543055-9679-4102-801f-a140fe3454ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed835047051142d2bc98bb1564e3a98f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e8aae17def04cf48190ede4bffefe70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:22:53.492537 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb543055-9679-4102-801f-a140fe3454ce service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:22:53.492814 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb543055-9679-4102-801f-a140fe3454ce service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:22:53.493087 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb543055-9679-4102-801f-a140fe3454ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:22:53.494824 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cb543055-9679-4102-801f-a140fe3454ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:22:53.506873 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb543055-9679-4102-801f-a140fe3454ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:22:53.508476 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb543055-9679-4102-801f-a140fe3454ce service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:22:53.518287 dv-cinder-853910-4-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1456/2942] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Aug 30 05:22:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:23:03.514104 dv-cinder-853910-4-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=58 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}